2024-07-24T16:13:59.391 INFO:root:teuthology version: 0.0.1.dev373+ga8aed60 2024-07-24T16:13:59.413 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-07-24T16:13:59.499 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816776 branch: main description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/snap-schedule} email: vshankar@redhat.com first_in_suite: false job_id: '7816776' kernel: client: sha1: distro flavor: default kdb: 1 sha1: 7bc81acc946e36bfc3ec8313b59200005ddf3f73 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' global: ms die on skipped message: false mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 86385b1daf5235400bbcd34a02515d168bde88e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 86385b1daf5235400bbcd34a02515d168bde88e2 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 owner: scheduled_vshankar@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1368 sha1: 86385b1daf5235400bbcd34a02515d168bde88e2 sleep_before_teardown: 0 subset: 738/1024 suite: fs suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 0325fd3c11a225c0fd9eb38fab88aad1370ad779 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi159.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCgkzFX8jGLsrMC+OAKerU7xXv2gm7bHRJgzHZSIqMC3kYfhZJ19xvZcv12AeNbUbJ90zpI/4s0wBr/BD1ScSfU= smithi193.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLlhuR9IfBQ7brL0YImfXElZeBGrVoi/HWckvb7v7Lt+eFrYLqQ/5lw2h0Gsm/+nNRL6Xyoa7fYDmBKbdOQ9CZk= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_snap_schedules teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: a8aed60fc62d4ff39d2216b360f018eba7518cfe timestamp: 2024-07-24_14:14:53 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.4074525 2024-07-24T16:13:59.499 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa; will attempt to use it 2024-07-24T16:13:59.500 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks 2024-07-24T16:13:59.500 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-07-24T16:13:59.502 INFO:teuthology.task.internal:Checking packages... 2024-07-24T16:13:59.522 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '86385b1daf5235400bbcd34a02515d168bde88e2' 2024-07-24T16:13:59.522 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-07-24T16:13:59.522 INFO:teuthology.packaging:ref: None 2024-07-24T16:13:59.522 INFO:teuthology.packaging:tag: None 2024-07-24T16:13:59.522 INFO:teuthology.packaging:branch: main 2024-07-24T16:13:59.522 INFO:teuthology.packaging:sha1: 86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T16:13:59.522 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-07-24T16:13:59.775 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-5235.gdf0a50d1 2024-07-24T16:13:59.777 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-07-24T16:13:59.786 INFO:teuthology.task.internal:no buildpackages task found 2024-07-24T16:13:59.786 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-07-24T16:13:59.800 INFO:teuthology.task.internal:Saving configuration 2024-07-24T16:13:59.815 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-07-24T16:13:59.827 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-07-24T16:13:59.851 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi159.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816776', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-07-24 16:08:46.979684', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCgkzFX8jGLsrMC+OAKerU7xXv2gm7bHRJgzHZSIqMC3kYfhZJ19xvZcv12AeNbUbJ90zpI/4s0wBr/BD1ScSfU='} 2024-07-24T16:13:59.869 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi193.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816776', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-07-24 16:08:46.980781', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLlhuR9IfBQ7brL0YImfXElZeBGrVoi/HWckvb7v7Lt+eFrYLqQ/5lw2h0Gsm/+nNRL6Xyoa7fYDmBKbdOQ9CZk='} 2024-07-24T16:13:59.869 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-07-24T16:13:59.880 INFO:teuthology.task.internal:roles: ubuntu@smithi159.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-07-24T16:13:59.880 INFO:teuthology.task.internal:roles: ubuntu@smithi193.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-07-24T16:13:59.880 INFO:teuthology.run_tasks:Running task console_log... 2024-07-24T16:13:59.938 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb491563be0>, signals=[15]) 2024-07-24T16:13:59.938 INFO:teuthology.run_tasks:Running task internal.connect... 2024-07-24T16:13:59.945 INFO:teuthology.task.internal:Opening connections... 2024-07-24T16:13:59.945 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:13:59.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T16:14:00.022 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi193.front.sepia.ceph.com 2024-07-24T16:14:00.023 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T16:14:00.096 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-07-24T16:14:00.103 DEBUG:teuthology.orchestra.run.smithi159:> uname -m 2024-07-24T16:14:00.121 INFO:teuthology.orchestra.run.smithi159.stdout:x86_64 2024-07-24T16:14:00.121 DEBUG:teuthology.orchestra.run.smithi159:> cat /etc/os-release 2024-07-24T16:14:00.178 INFO:teuthology.orchestra.run.smithi159.stdout:NAME="CentOS Stream" 2024-07-24T16:14:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION="9" 2024-07-24T16:14:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:ID="centos" 2024-07-24T16:14:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:ID_LIKE="rhel fedora" 2024-07-24T16:14:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:VERSION_ID="9" 2024-07-24T16:14:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:PLATFORM_ID="platform:el9" 2024-07-24T16:14:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:PRETTY_NAME="CentOS Stream 9" 2024-07-24T16:14:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:ANSI_COLOR="0;31" 2024-07-24T16:14:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:LOGO="fedora-logo-icon" 2024-07-24T16:14:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-07-24T16:14:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:HOME_URL="https://centos.org/" 2024-07-24T16:14:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-07-24T16:14:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-07-24T16:14:00.179 INFO:teuthology.orchestra.run.smithi159.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-07-24T16:14:00.180 INFO:teuthology.lock.ops:Updating smithi159.front.sepia.ceph.com on lock server 2024-07-24T16:14:00.204 DEBUG:teuthology.orchestra.run.smithi193:> uname -m 2024-07-24T16:14:00.221 INFO:teuthology.orchestra.run.smithi193.stdout:x86_64 2024-07-24T16:14:00.222 DEBUG:teuthology.orchestra.run.smithi193:> cat /etc/os-release 2024-07-24T16:14:00.279 INFO:teuthology.orchestra.run.smithi193.stdout:NAME="CentOS Stream" 2024-07-24T16:14:00.279 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION="9" 2024-07-24T16:14:00.279 INFO:teuthology.orchestra.run.smithi193.stdout:ID="centos" 2024-07-24T16:14:00.279 INFO:teuthology.orchestra.run.smithi193.stdout:ID_LIKE="rhel fedora" 2024-07-24T16:14:00.279 INFO:teuthology.orchestra.run.smithi193.stdout:VERSION_ID="9" 2024-07-24T16:14:00.279 INFO:teuthology.orchestra.run.smithi193.stdout:PLATFORM_ID="platform:el9" 2024-07-24T16:14:00.279 INFO:teuthology.orchestra.run.smithi193.stdout:PRETTY_NAME="CentOS Stream 9" 2024-07-24T16:14:00.279 INFO:teuthology.orchestra.run.smithi193.stdout:ANSI_COLOR="0;31" 2024-07-24T16:14:00.279 INFO:teuthology.orchestra.run.smithi193.stdout:LOGO="fedora-logo-icon" 2024-07-24T16:14:00.279 INFO:teuthology.orchestra.run.smithi193.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-07-24T16:14:00.279 INFO:teuthology.orchestra.run.smithi193.stdout:HOME_URL="https://centos.org/" 2024-07-24T16:14:00.280 INFO:teuthology.orchestra.run.smithi193.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-07-24T16:14:00.280 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-07-24T16:14:00.280 INFO:teuthology.orchestra.run.smithi193.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-07-24T16:14:00.280 INFO:teuthology.lock.ops:Updating smithi193.front.sepia.ceph.com on lock server 2024-07-24T16:14:00.303 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-07-24T16:14:00.315 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-07-24T16:14:00.322 INFO:teuthology.task.internal:Checking for old test directory... 2024-07-24T16:14:00.323 DEBUG:teuthology.orchestra.run.smithi159:> test '!' -e /home/ubuntu/cephtest 2024-07-24T16:14:00.325 DEBUG:teuthology.orchestra.run.smithi193:> test '!' -e /home/ubuntu/cephtest 2024-07-24T16:14:00.342 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-07-24T16:14:00.350 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-07-24T16:14:00.350 DEBUG:teuthology.orchestra.run.smithi159:> test -z $(ls -A /var/lib/ceph) 2024-07-24T16:14:00.382 DEBUG:teuthology.orchestra.run.smithi193:> test -z $(ls -A /var/lib/ceph) 2024-07-24T16:14:00.407 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-07-24T16:14:00.463 INFO:teuthology.run_tasks:Running task kernel... 2024-07-24T16:14:00.479 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '7bc81acc946e36bfc3ec8313b59200005ddf3f73'} 2024-07-24T16:14:00.479 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-07-24T16:14:00.479 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-07-24T16:14:00.479 DEBUG:teuthology.orchestra.run.smithi159:> test -f /run/.containerenv -o -f /.dockerenv 2024-07-24T16:14:00.480 DEBUG:teuthology.orchestra.run.smithi193:> test -f /run/.containerenv -o -f /.dockerenv 2024-07-24T16:14:00.495 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T16:14:00.496 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-07-24T16:14:00.496 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T16:14:00.497 DEBUG:teuthology.orchestra.run.smithi193:> uname -r 2024-07-24T16:14:00.553 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-437.el9.x86_64 2024-07-24T16:14:00.553 INFO:teuthology.task.kernel:Running kernel on smithi159: 5.14.0-437.el9.x86_64 2024-07-24T16:14:00.554 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum install -y kernel 2024-07-24T16:14:00.555 INFO:teuthology.orchestra.run.smithi193.stdout:5.14.0-437.el9.x86_64 2024-07-24T16:14:00.555 INFO:teuthology.task.kernel:Running kernel on smithi193: 5.14.0-437.el9.x86_64 2024-07-24T16:14:00.555 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum install -y kernel 2024-07-24T16:14:02.953 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.2 MB 00:00 2024-07-24T16:14:02.976 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-07-24T16:14:04.662 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-07-24T16:14:04.902 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - AppStream 24 MB/s | 20 MB 00:00 2024-07-24T16:14:08.880 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-07-24T16:14:09.095 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - CRB 16 MB/s | 6.5 MB 00:00 2024-07-24T16:14:10.445 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 77 kB/s | 18 kB 00:00 2024-07-24T16:14:10.526 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - Extras packages 79 kB/s | 18 kB 00:00 2024-07-24T16:14:11.390 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-07-24T16:14:11.463 INFO:teuthology.orchestra.run.smithi193.stdout:Extra Packages for Enterprise Linux 27 MB/s | 22 MB 00:00 2024-07-24T16:14:16.754 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-07-24T16:14:16.836 INFO:teuthology.orchestra.run.smithi193.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-07-24T16:14:18.769 INFO:teuthology.orchestra.run.smithi159.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-07-24T16:14:18.769 INFO:teuthology.orchestra.run.smithi159.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-07-24T16:14:18.842 INFO:teuthology.orchestra.run.smithi193.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-07-24T16:14:18.842 INFO:teuthology.orchestra.run.smithi193.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-07-24T16:14:18.845 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-07-24T16:14:18.854 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-07-24T16:14:18.854 INFO:teuthology.orchestra.run.smithi159.stdout: Package Architecture Version Repository Size 2024-07-24T16:14:18.854 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-07-24T16:14:18.854 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-07-24T16:14:18.854 INFO:teuthology.orchestra.run.smithi159.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-07-24T16:14:18.854 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-07-24T16:14:18.854 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-core x86_64 5.14.0-480.el9 baseos 17 M 2024-07-24T16:14:18.854 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules x86_64 5.14.0-480.el9 baseos 36 M 2024-07-24T16:14:18.854 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-core x86_64 5.14.0-480.el9 baseos 30 M 2024-07-24T16:14:18.854 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:14:18.854 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-07-24T16:14:18.855 INFO:teuthology.orchestra.run.smithi159.stdout:================================================================================ 2024-07-24T16:14:18.855 INFO:teuthology.orchestra.run.smithi159.stdout:Install 4 Packages 2024-07-24T16:14:18.855 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:14:18.855 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 84 M 2024-07-24T16:14:18.855 INFO:teuthology.orchestra.run.smithi159.stdout:Installed size: 126 M 2024-07-24T16:14:18.855 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-07-24T16:14:18.945 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-07-24T16:14:18.951 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-07-24T16:14:18.951 INFO:teuthology.orchestra.run.smithi193.stdout: Package Architecture Version Repository Size 2024-07-24T16:14:18.951 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-07-24T16:14:18.951 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-07-24T16:14:18.951 INFO:teuthology.orchestra.run.smithi193.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-07-24T16:14:18.951 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-07-24T16:14:18.952 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-core x86_64 5.14.0-480.el9 baseos 17 M 2024-07-24T16:14:18.952 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-modules x86_64 5.14.0-480.el9 baseos 36 M 2024-07-24T16:14:18.952 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-modules-core x86_64 5.14.0-480.el9 baseos 30 M 2024-07-24T16:14:18.952 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:14:18.952 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-07-24T16:14:18.952 INFO:teuthology.orchestra.run.smithi193.stdout:================================================================================ 2024-07-24T16:14:18.952 INFO:teuthology.orchestra.run.smithi193.stdout:Install 4 Packages 2024-07-24T16:14:18.952 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:14:18.953 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 84 M 2024-07-24T16:14:18.953 INFO:teuthology.orchestra.run.smithi193.stdout:Installed size: 126 M 2024-07-24T16:14:18.953 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-07-24T16:14:19.164 INFO:teuthology.orchestra.run.smithi159.stdout:(1/4): kernel-5.14.0-480.el9.x86_64.rpm 8.2 MB/s | 1.5 MB 00:00 2024-07-24T16:14:19.287 INFO:teuthology.orchestra.run.smithi193.stdout:(1/4): kernel-5.14.0-480.el9.x86_64.rpm 7.0 MB/s | 1.5 MB 00:00 2024-07-24T16:14:19.656 INFO:teuthology.orchestra.run.smithi159.stdout:(2/4): kernel-modules-5.14.0-480.el9.x86_64.rpm 53 MB/s | 36 MB 00:00 2024-07-24T16:14:19.687 INFO:teuthology.orchestra.run.smithi193.stdout:(2/4): kernel-core-5.14.0-480.el9.x86_64.rpm 28 MB/s | 17 MB 00:00 2024-07-24T16:14:19.831 INFO:teuthology.orchestra.run.smithi159.stdout:(3/4): kernel-core-5.14.0-480.el9.x86_64.rpm 20 MB/s | 17 MB 00:00 2024-07-24T16:14:19.979 INFO:teuthology.orchestra.run.smithi193.stdout:(3/4): kernel-modules-core-5.14.0-480.el9.x86_6 43 MB/s | 30 MB 00:00 2024-07-24T16:14:20.206 INFO:teuthology.orchestra.run.smithi159.stdout:(4/4): kernel-modules-core-5.14.0-480.el9.x86_6 29 MB/s | 30 MB 00:01 2024-07-24T16:14:20.209 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-07-24T16:14:20.210 INFO:teuthology.orchestra.run.smithi159.stdout:Total 62 MB/s | 84 MB 00:01 2024-07-24T16:14:20.338 INFO:teuthology.orchestra.run.smithi193.stdout:(4/4): kernel-modules-5.14.0-480.el9.x86_64.rpm 28 MB/s | 36 MB 00:01 2024-07-24T16:14:20.341 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-07-24T16:14:20.341 INFO:teuthology.orchestra.run.smithi193.stdout:Total 61 MB/s | 84 MB 00:01 2024-07-24T16:14:20.947 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-07-24T16:14:21.076 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-07-24T16:14:21.299 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-07-24T16:14:21.299 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-07-24T16:14:21.437 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-07-24T16:14:21.437 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-07-24T16:14:22.290 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-07-24T16:14:22.290 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-07-24T16:14:22.453 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-07-24T16:14:22.454 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-07-24T16:14:24.742 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-07-24T16:14:24.890 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-07-24T16:14:25.483 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-modules-core-5.14.0-480.el9.x86_64 1/4 2024-07-24T16:14:25.582 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-24T16:14:25.717 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : kernel-modules-core-5.14.0-480.el9.x86_64 1/4 2024-07-24T16:14:25.812 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-24T16:14:28.252 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-24T16:14:28.395 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-24T16:14:28.443 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-24T16:14:28.588 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-24T16:14:33.250 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-24T16:14:33.362 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : kernel-5.14.0-480.el9.x86_64 4/4 2024-07-24T16:14:33.386 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-24T16:14:33.455 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : kernel-5.14.0-480.el9.x86_64 4/4 2024-07-24T16:14:38.227 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-07-24T16:14:38.314 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-07-24T16:15:07.745 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 4/4 2024-07-24T16:15:07.786 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 4/4 2024-07-24T16:15:08.151 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 4/4 2024-07-24T16:15:08.151 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/4 2024-07-24T16:15:08.151 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-24T16:15:08.151 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-24T16:15:08.282 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 4/4 2024-07-24T16:15:08.322 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 4/4 2024-07-24T16:15:08.736 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 4/4 2024-07-24T16:15:08.736 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/4 2024-07-24T16:15:08.736 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-07-24T16:15:08.736 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-07-24T16:15:08.974 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-07-24T16:15:08.974 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:15:08.974 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-07-24T16:15:08.974 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-5.14.0-480.el9.x86_64 2024-07-24T16:15:08.974 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-core-5.14.0-480.el9.x86_64 2024-07-24T16:15:08.974 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-5.14.0-480.el9.x86_64 2024-07-24T16:15:08.974 INFO:teuthology.orchestra.run.smithi159.stdout: kernel-modules-core-5.14.0-480.el9.x86_64 2024-07-24T16:15:08.974 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:15:08.975 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-07-24T16:15:09.345 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q kernel | sort -rV | head -n 1 2024-07-24T16:15:09.421 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-5.14.0-480.el9.x86_64 2024-07-24T16:15:09.421 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-07-24T16:15:09.421 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-480.el9.x86_64 2024-07-24T16:15:09.421 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-07-24T16:15:09.421 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-07-24T16:15:09.422 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-07-24T16:15:09.422 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi159.front.sepia.ceph.com, path=None, version=distro) 2024-07-24T16:15:09.422 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q kernel | sort -rV | head -n 1 2024-07-24T16:15:09.478 INFO:teuthology.orchestra.run.smithi159.stdout:kernel-5.14.0-480.el9.x86_64 2024-07-24T16:15:09.478 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-07-24T16:15:09.479 DEBUG:teuthology.orchestra.run.smithi159:> sudo rpm -qi grub2-tools 2024-07-24T16:15:09.517 INFO:teuthology.orchestra.run.smithi159.stdout:Name : grub2-tools 2024-07-24T16:15:09.518 INFO:teuthology.orchestra.run.smithi159.stdout:Epoch : 1 2024-07-24T16:15:09.518 INFO:teuthology.orchestra.run.smithi159.stdout:Version : 2.06 2024-07-24T16:15:09.518 INFO:teuthology.orchestra.run.smithi159.stdout:Release : 68.el9 2024-07-24T16:15:09.518 INFO:teuthology.orchestra.run.smithi159.stdout:Architecture: x86_64 2024-07-24T16:15:09.518 INFO:teuthology.orchestra.run.smithi159.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-07-24T16:15:09.518 INFO:teuthology.orchestra.run.smithi159.stdout:Group : Unspecified 2024-07-24T16:15:09.518 INFO:teuthology.orchestra.run.smithi159.stdout:Size : 8264254 2024-07-24T16:15:09.518 INFO:teuthology.orchestra.run.smithi159.stdout:License : GPLv3+ 2024-07-24T16:15:09.518 INFO:teuthology.orchestra.run.smithi159.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-07-24T16:15:09.518 INFO:teuthology.orchestra.run.smithi159.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-07-24T16:15:09.518 INFO:teuthology.orchestra.run.smithi159.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-07-24T16:15:09.519 INFO:teuthology.orchestra.run.smithi159.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-07-24T16:15:09.519 INFO:teuthology.orchestra.run.smithi159.stdout:Packager : builder@centos.org 2024-07-24T16:15:09.519 INFO:teuthology.orchestra.run.smithi159.stdout:Vendor : CentOS 2024-07-24T16:15:09.519 INFO:teuthology.orchestra.run.smithi159.stdout:URL : http://www.gnu.org/software/grub/ 2024-07-24T16:15:09.519 INFO:teuthology.orchestra.run.smithi159.stdout:Summary : Support tools for GRUB. 2024-07-24T16:15:09.519 INFO:teuthology.orchestra.run.smithi159.stdout:Description : 2024-07-24T16:15:09.519 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:15:09.519 INFO:teuthology.orchestra.run.smithi159.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-07-24T16:15:09.519 INFO:teuthology.orchestra.run.smithi159.stdout:customizable bootloader with modular architecture. It supports a rich 2024-07-24T16:15:09.519 INFO:teuthology.orchestra.run.smithi159.stdout:variety of kernel formats, file systems, computer architectures and 2024-07-24T16:15:09.519 INFO:teuthology.orchestra.run.smithi159.stdout:hardware devices. 2024-07-24T16:15:09.519 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:15:09.519 INFO:teuthology.orchestra.run.smithi159.stdout:This subpackage provides tools for support of all platforms. 2024-07-24T16:15:09.520 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-07-24T16:15:09.520 INFO:teuthology.task.kernel:Updating grub on smithi159 to boot 5.14.0-480.el9.x86_64 2024-07-24T16:15:09.521 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-07-24T16:15:09.521 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-07-24T16:15:09.521 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:15:09.521 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-07-24T16:15:09.521 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-5.14.0-480.el9.x86_64 2024-07-24T16:15:09.522 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-core-5.14.0-480.el9.x86_64 2024-07-24T16:15:09.522 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-modules-5.14.0-480.el9.x86_64 2024-07-24T16:15:09.522 INFO:teuthology.orchestra.run.smithi193.stdout: kernel-modules-core-5.14.0-480.el9.x86_64 2024-07-24T16:15:09.522 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:15:09.522 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-07-24T16:15:09.914 DEBUG:teuthology.orchestra.run.smithi193:> rpm -q kernel | sort -rV | head -n 1 2024-07-24T16:15:09.993 INFO:teuthology.orchestra.run.smithi193.stdout:kernel-5.14.0-480.el9.x86_64 2024-07-24T16:15:09.993 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-07-24T16:15:09.993 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-480.el9.x86_64 2024-07-24T16:15:09.993 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-07-24T16:15:09.993 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-07-24T16:15:09.993 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-07-24T16:15:09.994 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi193.front.sepia.ceph.com, path=None, version=distro) 2024-07-24T16:15:09.994 DEBUG:teuthology.orchestra.run.smithi193:> rpm -q kernel | sort -rV | head -n 1 2024-07-24T16:15:10.050 INFO:teuthology.orchestra.run.smithi193.stdout:kernel-5.14.0-480.el9.x86_64 2024-07-24T16:15:10.050 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-07-24T16:15:10.051 DEBUG:teuthology.orchestra.run.smithi193:> sudo rpm -qi grub2-tools 2024-07-24T16:15:10.081 INFO:teuthology.orchestra.run.smithi193.stdout:Name : grub2-tools 2024-07-24T16:15:10.081 INFO:teuthology.orchestra.run.smithi193.stdout:Epoch : 1 2024-07-24T16:15:10.081 INFO:teuthology.orchestra.run.smithi193.stdout:Version : 2.06 2024-07-24T16:15:10.081 INFO:teuthology.orchestra.run.smithi193.stdout:Release : 68.el9 2024-07-24T16:15:10.081 INFO:teuthology.orchestra.run.smithi193.stdout:Architecture: x86_64 2024-07-24T16:15:10.081 INFO:teuthology.orchestra.run.smithi193.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-07-24T16:15:10.081 INFO:teuthology.orchestra.run.smithi193.stdout:Group : Unspecified 2024-07-24T16:15:10.082 INFO:teuthology.orchestra.run.smithi193.stdout:Size : 8264254 2024-07-24T16:15:10.082 INFO:teuthology.orchestra.run.smithi193.stdout:License : GPLv3+ 2024-07-24T16:15:10.082 INFO:teuthology.orchestra.run.smithi193.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-07-24T16:15:10.082 INFO:teuthology.orchestra.run.smithi193.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-07-24T16:15:10.082 INFO:teuthology.orchestra.run.smithi193.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-07-24T16:15:10.082 INFO:teuthology.orchestra.run.smithi193.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-07-24T16:15:10.082 INFO:teuthology.orchestra.run.smithi193.stdout:Packager : builder@centos.org 2024-07-24T16:15:10.082 INFO:teuthology.orchestra.run.smithi193.stdout:Vendor : CentOS 2024-07-24T16:15:10.082 INFO:teuthology.orchestra.run.smithi193.stdout:URL : http://www.gnu.org/software/grub/ 2024-07-24T16:15:10.082 INFO:teuthology.orchestra.run.smithi193.stdout:Summary : Support tools for GRUB. 2024-07-24T16:15:10.082 INFO:teuthology.orchestra.run.smithi193.stdout:Description : 2024-07-24T16:15:10.082 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:15:10.083 INFO:teuthology.orchestra.run.smithi193.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-07-24T16:15:10.083 INFO:teuthology.orchestra.run.smithi193.stdout:customizable bootloader with modular architecture. It supports a rich 2024-07-24T16:15:10.083 INFO:teuthology.orchestra.run.smithi193.stdout:variety of kernel formats, file systems, computer architectures and 2024-07-24T16:15:10.083 INFO:teuthology.orchestra.run.smithi193.stdout:hardware devices. 2024-07-24T16:15:10.083 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:15:10.083 INFO:teuthology.orchestra.run.smithi193.stdout:This subpackage provides tools for support of all platforms. 2024-07-24T16:15:10.085 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-07-24T16:15:10.085 INFO:teuthology.task.kernel:Updating grub on smithi193 to boot 5.14.0-480.el9.x86_64 2024-07-24T16:15:10.085 DEBUG:teuthology.orchestra.run.smithi193:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-07-24T16:15:10.136 INFO:teuthology.orchestra.run.smithi159.stderr:Generating grub configuration file ... 2024-07-24T16:15:10.732 INFO:teuthology.orchestra.run.smithi193.stderr:Generating grub configuration file ... 2024-07-24T16:15:11.484 INFO:teuthology.orchestra.run.smithi159.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-07-24T16:15:11.502 INFO:teuthology.orchestra.run.smithi159.stderr:done 2024-07-24T16:15:11.505 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2024-07-24T16:15:11.520 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.tvnuVOWGmJ 2024-07-24T16:15:11.520 DEBUG:teuthology.orchestra.run.smithi159:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.tvnuVOWGmJ 2024-07-24T16:15:11.586 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.tvnuVOWGmJ 2024-07-24T16:15:11.726 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.tvnuVOWGmJ is 6KB 2024-07-24T16:15:11.775 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.tvnuVOWGmJ 2024-07-24T16:15:11.789 DEBUG:teuthology.orchestra.run.smithi159:> sudo /bin/ls /boot/loader/entries || true 2024-07-24T16:15:11.850 INFO:teuthology.orchestra.run.smithi159.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-07-24T16:15:11.850 INFO:teuthology.orchestra.run.smithi159.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-07-24T16:15:11.850 INFO:teuthology.orchestra.run.smithi159.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-07-24T16:15:11.850 INFO:teuthology.orchestra.run.smithi159.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64.conf 2024-07-24T16:15:11.852 DEBUG:teuthology.orchestra.run.smithi159:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64 2024-07-24T16:15:12.001 DEBUG:teuthology.orchestra.run.smithi159:> sudo shutdown -r now 2024-07-24T16:15:12.188 INFO:teuthology.orchestra.run.smithi193.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-07-24T16:15:12.205 INFO:teuthology.orchestra.run.smithi193.stderr:done 2024-07-24T16:15:12.207 DEBUG:teuthology.orchestra.run.smithi193:> mktemp 2024-07-24T16:15:12.228 INFO:teuthology.orchestra.run.smithi193.stdout:/tmp/tmp.Ewop3BXe0J 2024-07-24T16:15:12.228 DEBUG:teuthology.orchestra.run.smithi193:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Ewop3BXe0J 2024-07-24T16:15:12.294 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0666 /tmp/tmp.Ewop3BXe0J 2024-07-24T16:15:12.430 DEBUG:teuthology.orchestra.remote:smithi193:/tmp/tmp.Ewop3BXe0J is 6KB 2024-07-24T16:15:12.481 DEBUG:teuthology.orchestra.run.smithi193:> rm -fr /tmp/tmp.Ewop3BXe0J 2024-07-24T16:15:12.495 DEBUG:teuthology.orchestra.run.smithi193:> sudo /bin/ls /boot/loader/entries || true 2024-07-24T16:15:12.557 INFO:teuthology.orchestra.run.smithi193.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-07-24T16:15:12.557 INFO:teuthology.orchestra.run.smithi193.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-07-24T16:15:12.557 INFO:teuthology.orchestra.run.smithi193.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-07-24T16:15:12.557 INFO:teuthology.orchestra.run.smithi193.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64.conf 2024-07-24T16:15:12.558 DEBUG:teuthology.orchestra.run.smithi193:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64 2024-07-24T16:15:12.709 DEBUG:teuthology.orchestra.run.smithi193:> sudo shutdown -r now 2024-07-24T16:15:42.030 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-07-24T16:15:42.031 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-07-24T16:15:42.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T16:15:42.713 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-07-24T16:15:42.713 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-07-24T16:15:42.714 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T16:16:42.081 DEBUG:teuthology.orchestra.remote:timed out 2024-07-24T16:16:42.716 DEBUG:teuthology.orchestra.remote:timed out 2024-07-24T16:16:51.091 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-07-24T16:16:51.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T16:16:51.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-07-24T16:16:51.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T16:16:52.072 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-07-24T16:16:52.498 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-07-24T16:16:52.499 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-480.el9.x86_64"... 2024-07-24T16:16:52.499 DEBUG:teuthology.orchestra.run.smithi193:> uname -r 2024-07-24T16:16:52.513 INFO:teuthology.orchestra.run.smithi193.stdout:5.14.0-480.el9.x86_64 2024-07-24T16:16:52.513 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-480.el9.x86_64 vs 5.14.0-480.el9.x86_64 2024-07-24T16:16:52.513 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-07-24T16:16:52.513 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-07-24T16:16:53.514 DEBUG:teuthology.parallel:result is None 2024-07-24T16:17:06.969 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-07-24T16:17:07.502 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-07-24T16:17:07.502 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-480.el9.x86_64"... 2024-07-24T16:17:07.503 DEBUG:teuthology.orchestra.run.smithi159:> uname -r 2024-07-24T16:17:07.541 INFO:teuthology.orchestra.run.smithi159.stdout:5.14.0-480.el9.x86_64 2024-07-24T16:17:07.541 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-480.el9.x86_64 vs 5.14.0-480.el9.x86_64 2024-07-24T16:17:07.542 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-07-24T16:17:07.542 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-07-24T16:17:08.542 DEBUG:teuthology.parallel:result is None 2024-07-24T16:17:08.543 INFO:teuthology.run_tasks:Running task internal.base... 2024-07-24T16:17:08.549 INFO:teuthology.task.internal:Creating test directory... 2024-07-24T16:17:08.550 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-07-24T16:17:08.552 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-07-24T16:17:08.573 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-07-24T16:17:08.579 INFO:teuthology.run_tasks:Running task internal.archive... 2024-07-24T16:17:08.589 INFO:teuthology.task.internal:Creating archive directory... 2024-07-24T16:17:08.590 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-07-24T16:17:08.610 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-07-24T16:17:08.759 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-07-24T16:17:08.766 INFO:teuthology.task.internal:Enabling coredump saving... 2024-07-24T16:17:08.766 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-07-24T16:17:08.769 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-07-24T16:17:08.834 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-24T16:17:08.839 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-24T16:17:08.879 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-24T16:17:08.886 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-07-24T16:17:08.888 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-07-24T16:17:08.895 INFO:teuthology.task.internal:Configuring sudo... 2024-07-24T16:17:08.895 DEBUG:teuthology.orchestra.run.smithi159:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-07-24T16:17:08.898 DEBUG:teuthology.orchestra.run.smithi193:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-07-24T16:17:08.926 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-07-24T16:17:08.935 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-07-24T16:17:08.935 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-07-24T16:17:08.964 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-07-24T16:17:08.983 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-24T16:17:09.059 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-24T16:17:09.102 DEBUG:teuthology.orchestra.run.smithi159:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-24T16:17:09.184 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-24T16:17:09.223 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:17:09.223 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-07-24T16:17:09.288 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-24T16:17:09.331 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-07-24T16:17:09.395 DEBUG:teuthology.orchestra.run.smithi193:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-24T16:17:09.439 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-07-24T16:17:09.480 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:17:09.480 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-07-24T16:17:09.546 DEBUG:teuthology.orchestra.run.smithi159:> sudo service rsyslog restart 2024-07-24T16:17:09.548 DEBUG:teuthology.orchestra.run.smithi193:> sudo service rsyslog restart 2024-07-24T16:17:09.582 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-24T16:17:09.637 INFO:teuthology.orchestra.run.smithi193.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-24T16:17:09.972 INFO:teuthology.run_tasks:Running task internal.timer... 2024-07-24T16:17:09.979 INFO:teuthology.task.internal:Starting timer... 2024-07-24T16:17:09.979 INFO:teuthology.run_tasks:Running task pcp... 2024-07-24T16:17:09.998 INFO:teuthology.run_tasks:Running task selinux... 2024-07-24T16:17:10.006 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-07-24T16:17:10.006 DEBUG:teuthology.orchestra.run.smithi159:> sudo service auditd rotate 2024-07-24T16:17:10.089 INFO:teuthology.orchestra.run.smithi159.stdout:Rotating logs: 2024-07-24T16:17:10.091 DEBUG:teuthology.orchestra.run.smithi193:> sudo service auditd rotate 2024-07-24T16:17:10.147 INFO:teuthology.orchestra.run.smithi193.stdout:Rotating logs: 2024-07-24T16:17:10.149 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-07-24T16:17:10.149 DEBUG:teuthology.orchestra.run.smithi159:> /usr/sbin/getenforce 2024-07-24T16:17:10.167 INFO:teuthology.orchestra.run.smithi159.stdout:Permissive 2024-07-24T16:17:10.167 DEBUG:teuthology.orchestra.run.smithi193:> /usr/sbin/getenforce 2024-07-24T16:17:10.186 INFO:teuthology.orchestra.run.smithi193.stdout:Permissive 2024-07-24T16:17:10.186 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi159.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi193.front.sepia.ceph.com': 'permissive'} 2024-07-24T16:17:10.186 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-24T16:17:10.233 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T16:17:10.233 DEBUG:teuthology.orchestra.run.smithi193:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-24T16:17:10.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T16:17:10.262 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-07-24T16:17:10.263 DEBUG:teuthology.orchestra.run.smithi159:> sudo /usr/sbin/setenforce permissive 2024-07-24T16:17:10.298 DEBUG:teuthology.orchestra.run.smithi193:> sudo /usr/sbin/setenforce permissive 2024-07-24T16:17:10.330 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-07-24T16:17:10.339 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-07-24T16:17:10.342 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-07-24T16:17:10.465 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-07-24T16:17:10.476 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-07-24T16:17:10.477 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi159.front.sepia.ceph.com,smithi193.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-07-24T16:21:32.813 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi159.front.sepia.ceph.com'), Remote(name='ubuntu@smithi193.front.sepia.ceph.com')] 2024-07-24T16:21:32.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-07-24T16:21:32.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi159.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T16:21:32.894 DEBUG:teuthology.orchestra.run.smithi159:> true 2024-07-24T16:21:32.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi159.front.sepia.ceph.com' 2024-07-24T16:21:32.982 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-07-24T16:21:32.983 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi193.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-07-24T16:21:33.059 DEBUG:teuthology.orchestra.run.smithi193:> true 2024-07-24T16:21:33.146 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi193.front.sepia.ceph.com' 2024-07-24T16:21:33.146 INFO:teuthology.run_tasks:Running task clock... 2024-07-24T16:21:33.161 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-07-24T16:21:33.161 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-07-24T16:21:33.162 DEBUG:teuthology.orchestra.run.smithi159:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-24T16:21:33.164 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-07-24T16:21:33.164 DEBUG:teuthology.orchestra.run.smithi193:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-24T16:21:33.190 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-07-24T16:21:33.205 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-07-24T16:21:33.215 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-07-24T16:21:33.229 INFO:teuthology.orchestra.run.smithi159.stderr:sudo: ntpd: command not found 2024-07-24T16:21:33.230 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-07-24T16:21:33.240 INFO:teuthology.orchestra.run.smithi159.stdout:506 Cannot talk to daemon 2024-07-24T16:21:33.254 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-07-24T16:21:33.254 INFO:teuthology.orchestra.run.smithi193.stderr:sudo: ntpd: command not found 2024-07-24T16:21:33.264 INFO:teuthology.orchestra.run.smithi193.stdout:506 Cannot talk to daemon 2024-07-24T16:21:33.268 INFO:teuthology.orchestra.run.smithi159.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-07-24T16:21:33.278 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-07-24T16:21:33.292 INFO:teuthology.orchestra.run.smithi193.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-07-24T16:21:33.326 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-07-24T16:21:33.329 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-24T16:21:33.329 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-07-24T16:21:33.330 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T16:21:33.330 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T16:21:33.330 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T16:21:33.330 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T16:21:33.356 INFO:teuthology.orchestra.run.smithi193.stderr:bash: line 1: ntpq: command not found 2024-07-24T16:21:33.358 INFO:teuthology.orchestra.run.smithi193.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-24T16:21:33.358 INFO:teuthology.orchestra.run.smithi193.stdout:=============================================================================== 2024-07-24T16:21:33.359 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T16:21:33.359 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T16:21:33.359 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T16:21:33.359 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T16:21:33.360 INFO:teuthology.run_tasks:Running task install... 2024-07-24T16:21:33.368 DEBUG:teuthology.task.install:project ceph 2024-07-24T16:21:33.368 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2'}} 2024-07-24T16:21:33.368 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2'} 2024-07-24T16:21:33.368 INFO:teuthology.task.install:Using flavor: default 2024-07-24T16:21:33.373 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-07-24T16:21:33.374 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-07-24T16:21:33.374 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2', 'tag': None, 'wait_for_package': False} 2024-07-24T16:21:33.374 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T16:21:33.376 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2', 'tag': None, 'wait_for_package': False} 2024-07-24T16:21:33.376 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T16:21:33.516 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/ 2024-07-24T16:21:33.517 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5197.g86385b1d 2024-07-24T16:21:33.529 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/ 2024-07-24T16:21:33.529 INFO:teuthology.task.install.rpm:Package version is 19.0.0-5197.g86385b1d 2024-07-24T16:21:33.632 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-07-24T16:21:33.632 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:21:33.632 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-07-24T16:21:33.638 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/86385b1daf5235400bbcd34a02515d168bde88e2/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-07-24T16:21:33.638 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:21:33.638 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-07-24T16:21:33.659 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-07-24T16:21:33.659 DEBUG:teuthology.orchestra.run.smithi159:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/86385b1daf5235400bbcd34a02515d168bde88e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-07-24T16:21:33.663 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-07-24T16:21:33.663 DEBUG:teuthology.orchestra.run.smithi193:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/86385b1daf5235400bbcd34a02515d168bde88e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-07-24T16:21:33.725 DEBUG:teuthology.orchestra.run.smithi159:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-07-24T16:21:33.728 DEBUG:teuthology.orchestra.run.smithi193:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-07-24T16:21:33.800 DEBUG:teuthology.orchestra.run.smithi159:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-07-24T16:21:33.803 DEBUG:teuthology.orchestra.run.smithi193:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-07-24T16:21:33.865 INFO:teuthology.orchestra.run.smithi159.stdout:check_obsoletes = 1 2024-07-24T16:21:33.866 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum clean all 2024-07-24T16:21:33.868 INFO:teuthology.orchestra.run.smithi193.stdout:check_obsoletes = 1 2024-07-24T16:21:33.870 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum clean all 2024-07-24T16:21:34.092 INFO:teuthology.orchestra.run.smithi193.stdout:45 files removed 2024-07-24T16:21:34.095 INFO:teuthology.orchestra.run.smithi159.stdout:45 files removed 2024-07-24T16:21:34.119 DEBUG:teuthology.orchestra.run.smithi193:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-07-24T16:21:34.122 DEBUG:teuthology.orchestra.run.smithi159:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-07-24T16:21:34.727 INFO:teuthology.orchestra.run.smithi159.stdout:ceph packages for x86_64 258 kB/s | 83 kB 00:00 2024-07-24T16:21:34.728 INFO:teuthology.orchestra.run.smithi193.stdout:ceph packages for x86_64 252 kB/s | 83 kB 00:00 2024-07-24T16:21:35.077 INFO:teuthology.orchestra.run.smithi159.stdout:ceph noarch packages 80 kB/s | 24 kB 00:00 2024-07-24T16:21:35.103 INFO:teuthology.orchestra.run.smithi193.stdout:ceph noarch packages 74 kB/s | 24 kB 00:00 2024-07-24T16:21:35.403 INFO:teuthology.orchestra.run.smithi159.stdout:ceph source packages 6.8 kB/s | 1.9 kB 00:00 2024-07-24T16:21:35.479 INFO:teuthology.orchestra.run.smithi193.stdout:ceph source packages 5.9 kB/s | 1.9 kB 00:00 2024-07-24T16:21:36.005 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - BaseOS 15 MB/s | 8.2 MB 00:00 2024-07-24T16:21:36.253 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-07-24T16:21:37.898 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-07-24T16:21:38.124 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-07-24T16:21:42.141 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.5 MB 00:00 2024-07-24T16:21:42.383 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.5 MB 00:00 2024-07-24T16:21:43.973 INFO:teuthology.orchestra.run.smithi193.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 18 kB 00:00 2024-07-24T16:21:44.739 INFO:teuthology.orchestra.run.smithi159.stdout:CentOS Stream 9 - Extras packages 17 kB/s | 18 kB 00:01 2024-07-24T16:21:44.844 INFO:teuthology.orchestra.run.smithi193.stdout:Extra Packages for Enterprise Linux 30 MB/s | 22 MB 00:00 2024-07-24T16:21:45.718 INFO:teuthology.orchestra.run.smithi159.stdout:Extra Packages for Enterprise Linux 26 MB/s | 22 MB 00:00 2024-07-24T16:21:50.166 INFO:teuthology.orchestra.run.smithi193.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-07-24T16:21:51.099 INFO:teuthology.orchestra.run.smithi159.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-07-24T16:21:52.476 INFO:teuthology.orchestra.run.smithi193.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-24T16:21:52.477 INFO:teuthology.orchestra.run.smithi193.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-24T16:21:52.488 INFO:teuthology.orchestra.run.smithi193.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-07-24T16:21:52.489 INFO:teuthology.orchestra.run.smithi193.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-07-24T16:21:52.490 INFO:teuthology.orchestra.run.smithi193.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-07-24T16:21:52.490 INFO:teuthology.orchestra.run.smithi193.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-07-24T16:21:52.492 INFO:teuthology.orchestra.run.smithi193.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-07-24T16:21:52.494 INFO:teuthology.orchestra.run.smithi193.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-07-24T16:21:52.495 INFO:teuthology.orchestra.run.smithi193.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-07-24T16:21:52.559 INFO:teuthology.orchestra.run.smithi193.stdout:Dependencies resolved. 2024-07-24T16:21:52.578 INFO:teuthology.orchestra.run.smithi193.stdout:======================================================================================= 2024-07-24T16:21:52.578 INFO:teuthology.orchestra.run.smithi193.stdout: Package Arch Version Repository Size 2024-07-24T16:21:52.578 INFO:teuthology.orchestra.run.smithi193.stdout:======================================================================================= 2024-07-24T16:21:52.578 INFO:teuthology.orchestra.run.smithi193.stdout:Installing: 2024-07-24T16:21:52.578 INFO:teuthology.orchestra.run.smithi193.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-07-24T16:21:52.578 INFO:teuthology.orchestra.run.smithi193.stdout: ceph x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 6.6 k 2024-07-24T16:21:52.579 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 5.4 M 2024-07-24T16:21:52.579 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 903 k 2024-07-24T16:21:52.579 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 145 k 2024-07-24T16:21:52.579 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 1.5 M 2024-07-24T16:21:52.579 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 149 k 2024-07-24T16:21:52.579 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 14 M 2024-07-24T16:21:52.579 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 7.4 M 2024-07-24T16:21:52.579 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 49 k 2024-07-24T16:21:52.579 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 11 M 2024-07-24T16:21:52.579 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 50 M 2024-07-24T16:21:52.579 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-volume noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 274 k 2024-07-24T16:21:52.579 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 771 k 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-mirror x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 228 k 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-shell x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 27 k 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-top noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 18 k 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 32 k 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 758 k 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 127 k 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-07-24T16:21:52.580 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-07-24T16:21:52.581 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-07-24T16:21:52.581 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 161 k 2024-07-24T16:21:52.581 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 321 k 2024-07-24T16:21:52.581 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 303 k 2024-07-24T16:21:52.581 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 99 k 2024-07-24T16:21:52.581 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 85 k 2024-07-24T16:21:52.581 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.2 M 2024-07-24T16:21:52.581 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 170 k 2024-07-24T16:21:52.581 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-07-24T16:21:52.581 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrading: 2024-07-24T16:21:52.582 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-07-24T16:21:52.582 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-07-24T16:21:52.582 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-07-24T16:21:52.582 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-07-24T16:21:52.582 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-07-24T16:21:52.582 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-07-24T16:21:52.582 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-07-24T16:21:52.582 INFO:teuthology.orchestra.run.smithi193.stdout: librados2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.4 M 2024-07-24T16:21:52.582 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.2 M 2024-07-24T16:21:52.582 INFO:teuthology.orchestra.run.smithi193.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-07-24T16:21:52.582 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-07-24T16:21:52.583 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-07-24T16:21:52.583 INFO:teuthology.orchestra.run.smithi193.stdout:Installing dependencies: 2024-07-24T16:21:52.583 INFO:teuthology.orchestra.run.smithi193.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-07-24T16:21:52.583 INFO:teuthology.orchestra.run.smithi193.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-07-24T16:21:52.583 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-07-24T16:21:52.583 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 21 M 2024-07-24T16:21:52.583 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 34 k 2024-07-24T16:21:52.583 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 2.4 M 2024-07-24T16:21:52.583 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 284 k 2024-07-24T16:21:52.583 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 4.7 M 2024-07-24T16:21:52.583 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 17 M 2024-07-24T16:21:52.583 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 16 k 2024-07-24T16:21:52.583 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 25 k 2024-07-24T16:21:52.584 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-07-24T16:21:52.584 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-07-24T16:21:52.584 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-07-24T16:21:52.584 INFO:teuthology.orchestra.run.smithi193.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-07-24T16:21:52.584 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-07-24T16:21:52.584 INFO:teuthology.orchestra.run.smithi193.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-07-24T16:21:52.584 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-07-24T16:21:52.584 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-07-24T16:21:52.584 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 163 k 2024-07-24T16:21:52.584 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-07-24T16:21:52.584 INFO:teuthology.orchestra.run.smithi193.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-07-24T16:21:52.584 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-07-24T16:21:52.584 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-07-24T16:21:52.585 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-07-24T16:21:52.585 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 510 k 2024-07-24T16:21:52.585 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-07-24T16:21:52.585 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 5.5 M 2024-07-24T16:21:52.585 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-07-24T16:21:52.585 INFO:teuthology.orchestra.run.smithi193.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-07-24T16:21:52.585 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-07-24T16:21:52.585 INFO:teuthology.orchestra.run.smithi193.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-07-24T16:21:52.585 INFO:teuthology.orchestra.run.smithi193.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-07-24T16:21:52.585 INFO:teuthology.orchestra.run.smithi193.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-07-24T16:21:52.585 INFO:teuthology.orchestra.run.smithi193.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-07-24T16:21:52.585 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-07-24T16:21:52.585 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-07-24T16:21:52.586 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-07-24T16:21:52.586 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-07-24T16:21:52.586 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-07-24T16:21:52.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-07-24T16:21:52.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-07-24T16:21:52.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-07-24T16:21:52.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-07-24T16:21:52.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-07-24T16:21:52.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 45 k 2024-07-24T16:21:52.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 138 k 2024-07-24T16:21:52.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-07-24T16:21:52.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-07-24T16:21:52.586 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-07-24T16:21:52.587 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-07-24T16:21:52.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-07-24T16:21:52.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-07-24T16:21:52.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-07-24T16:21:52.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-07-24T16:21:52.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-07-24T16:21:52.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-07-24T16:21:52.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-07-24T16:21:52.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-07-24T16:21:52.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-07-24T16:21:52.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-07-24T16:21:52.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-07-24T16:21:52.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-07-24T16:21:52.588 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-07-24T16:21:52.589 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-07-24T16:21:52.590 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-07-24T16:21:52.590 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-07-24T16:21:52.590 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-07-24T16:21:52.590 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-07-24T16:21:52.590 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-07-24T16:21:52.590 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-07-24T16:21:52.590 INFO:teuthology.orchestra.run.smithi193.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-07-24T16:21:52.590 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-07-24T16:21:52.590 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-07-24T16:21:52.590 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-07-24T16:21:52.590 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-07-24T16:21:52.590 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-07-24T16:21:52.590 INFO:teuthology.orchestra.run.smithi193.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-07-24T16:21:52.591 INFO:teuthology.orchestra.run.smithi193.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-07-24T16:21:52.591 INFO:teuthology.orchestra.run.smithi193.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-07-24T16:21:52.591 INFO:teuthology.orchestra.run.smithi193.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-07-24T16:21:52.591 INFO:teuthology.orchestra.run.smithi193.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-07-24T16:21:52.591 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-07-24T16:21:52.591 INFO:teuthology.orchestra.run.smithi193.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-07-24T16:21:52.591 INFO:teuthology.orchestra.run.smithi193.stdout:Installing weak dependencies: 2024-07-24T16:21:52.591 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-07-24T16:21:52.591 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:21:52.591 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction Summary 2024-07-24T16:21:52.591 INFO:teuthology.orchestra.run.smithi193.stdout:======================================================================================= 2024-07-24T16:21:52.591 INFO:teuthology.orchestra.run.smithi193.stdout:Install 148 Packages 2024-07-24T16:21:52.591 INFO:teuthology.orchestra.run.smithi193.stdout:Upgrade 12 Packages 2024-07-24T16:21:52.592 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:21:52.592 INFO:teuthology.orchestra.run.smithi193.stdout:Total download size: 240 M 2024-07-24T16:21:52.592 INFO:teuthology.orchestra.run.smithi193.stdout:Downloading Packages: 2024-07-24T16:21:53.200 INFO:teuthology.orchestra.run.smithi193.stdout:(1/160): ceph-19.0.0-5197.g86385b1d.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-07-24T16:21:53.409 INFO:teuthology.orchestra.run.smithi159.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-24T16:21:53.410 INFO:teuthology.orchestra.run.smithi159.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-07-24T16:21:53.420 INFO:teuthology.orchestra.run.smithi159.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-07-24T16:21:53.421 INFO:teuthology.orchestra.run.smithi159.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-07-24T16:21:53.422 INFO:teuthology.orchestra.run.smithi159.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-07-24T16:21:53.423 INFO:teuthology.orchestra.run.smithi159.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-07-24T16:21:53.424 INFO:teuthology.orchestra.run.smithi159.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-07-24T16:21:53.426 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-07-24T16:21:53.427 INFO:teuthology.orchestra.run.smithi159.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-07-24T16:21:53.442 INFO:teuthology.orchestra.run.smithi193.stdout:(2/160): ceph-fuse-19.0.0-5197.g86385b1d.el9.x8 3.7 MB/s | 903 kB 00:00 2024-07-24T16:21:53.491 INFO:teuthology.orchestra.run.smithi159.stdout:Dependencies resolved. 2024-07-24T16:21:53.513 INFO:teuthology.orchestra.run.smithi159.stdout:======================================================================================= 2024-07-24T16:21:53.513 INFO:teuthology.orchestra.run.smithi159.stdout: Package Arch Version Repository Size 2024-07-24T16:21:53.513 INFO:teuthology.orchestra.run.smithi159.stdout:======================================================================================= 2024-07-24T16:21:53.513 INFO:teuthology.orchestra.run.smithi159.stdout:Installing: 2024-07-24T16:21:53.513 INFO:teuthology.orchestra.run.smithi159.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-07-24T16:21:53.513 INFO:teuthology.orchestra.run.smithi159.stdout: ceph x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 6.6 k 2024-07-24T16:21:53.513 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 5.4 M 2024-07-24T16:21:53.513 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 903 k 2024-07-24T16:21:53.513 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 145 k 2024-07-24T16:21:53.513 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 1.5 M 2024-07-24T16:21:53.513 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 149 k 2024-07-24T16:21:53.514 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 14 M 2024-07-24T16:21:53.514 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 7.4 M 2024-07-24T16:21:53.514 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 49 k 2024-07-24T16:21:53.514 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 11 M 2024-07-24T16:21:53.514 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 50 M 2024-07-24T16:21:53.514 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 274 k 2024-07-24T16:21:53.514 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 771 k 2024-07-24T16:21:53.514 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 228 k 2024-07-24T16:21:53.514 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-shell x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 27 k 2024-07-24T16:21:53.514 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 18 k 2024-07-24T16:21:53.514 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-07-24T16:21:53.514 INFO:teuthology.orchestra.run.smithi159.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 32 k 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 758 k 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 127 k 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 161 k 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 321 k 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 303 k 2024-07-24T16:21:53.515 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 99 k 2024-07-24T16:21:53.516 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 85 k 2024-07-24T16:21:53.516 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.2 M 2024-07-24T16:21:53.516 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 170 k 2024-07-24T16:21:53.516 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-07-24T16:21:53.516 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrading: 2024-07-24T16:21:53.516 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-07-24T16:21:53.516 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-07-24T16:21:53.516 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-07-24T16:21:53.516 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-07-24T16:21:53.516 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-07-24T16:21:53.516 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-07-24T16:21:53.516 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-07-24T16:21:53.517 INFO:teuthology.orchestra.run.smithi159.stdout: librados2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.4 M 2024-07-24T16:21:53.517 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 3.2 M 2024-07-24T16:21:53.517 INFO:teuthology.orchestra.run.smithi159.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-07-24T16:21:53.517 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-07-24T16:21:53.517 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-07-24T16:21:53.517 INFO:teuthology.orchestra.run.smithi159.stdout:Installing dependencies: 2024-07-24T16:21:53.517 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-07-24T16:21:53.517 INFO:teuthology.orchestra.run.smithi159.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-07-24T16:21:53.517 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-07-24T16:21:53.517 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 21 M 2024-07-24T16:21:53.517 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 34 k 2024-07-24T16:21:53.517 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 2.4 M 2024-07-24T16:21:53.517 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 284 k 2024-07-24T16:21:53.518 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 4.7 M 2024-07-24T16:21:53.518 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 17 M 2024-07-24T16:21:53.518 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts noarch 2:19.0.0-5197.g86385b1d.el9 ceph-noarch 16 k 2024-07-24T16:21:53.518 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 25 k 2024-07-24T16:21:53.518 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-07-24T16:21:53.518 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-07-24T16:21:53.518 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-07-24T16:21:53.518 INFO:teuthology.orchestra.run.smithi159.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-07-24T16:21:53.518 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-07-24T16:21:53.518 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-07-24T16:21:53.518 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-07-24T16:21:53.518 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-07-24T16:21:53.519 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 163 k 2024-07-24T16:21:53.519 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-07-24T16:21:53.519 INFO:teuthology.orchestra.run.smithi159.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-07-24T16:21:53.519 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-07-24T16:21:53.519 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-07-24T16:21:53.519 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-07-24T16:21:53.519 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 510 k 2024-07-24T16:21:53.519 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-07-24T16:21:53.519 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2 x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 5.5 M 2024-07-24T16:21:53.519 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-07-24T16:21:53.519 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-07-24T16:21:53.519 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-07-24T16:21:53.519 INFO:teuthology.orchestra.run.smithi159.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-07-24T16:21:53.520 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-07-24T16:21:53.520 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-07-24T16:21:53.520 INFO:teuthology.orchestra.run.smithi159.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-07-24T16:21:53.520 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-07-24T16:21:53.520 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-07-24T16:21:53.520 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-07-24T16:21:53.520 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-07-24T16:21:53.520 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-07-24T16:21:53.520 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-07-24T16:21:53.520 INFO:teuthology.orchestra.run.smithi159.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-07-24T16:21:53.520 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-07-24T16:21:53.520 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-07-24T16:21:53.520 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-07-24T16:21:53.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 45 k 2024-07-24T16:21:53.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common x86_64 2:19.0.0-5197.g86385b1d.el9 ceph 138 k 2024-07-24T16:21:53.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-07-24T16:21:53.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-07-24T16:21:53.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-07-24T16:21:53.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-07-24T16:21:53.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-07-24T16:21:53.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-07-24T16:21:53.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-07-24T16:21:53.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-07-24T16:21:53.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-07-24T16:21:53.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-07-24T16:21:53.521 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-07-24T16:21:53.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-07-24T16:21:53.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-07-24T16:21:53.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-07-24T16:21:53.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-07-24T16:21:53.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-07-24T16:21:53.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-07-24T16:21:53.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-07-24T16:21:53.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-07-24T16:21:53.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-07-24T16:21:53.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-07-24T16:21:53.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-07-24T16:21:53.522 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-07-24T16:21:53.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-07-24T16:21:53.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-07-24T16:21:53.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-07-24T16:21:53.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-07-24T16:21:53.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-07-24T16:21:53.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-07-24T16:21:53.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-07-24T16:21:53.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-07-24T16:21:53.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-07-24T16:21:53.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-07-24T16:21:53.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-07-24T16:21:53.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-07-24T16:21:53.523 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-07-24T16:21:53.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-07-24T16:21:53.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-07-24T16:21:53.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-07-24T16:21:53.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-07-24T16:21:53.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-07-24T16:21:53.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-07-24T16:21:53.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-07-24T16:21:53.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-07-24T16:21:53.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-07-24T16:21:53.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-07-24T16:21:53.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-07-24T16:21:53.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-07-24T16:21:53.524 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-07-24T16:21:53.525 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-07-24T16:21:53.526 INFO:teuthology.orchestra.run.smithi159.stdout:Installing weak dependencies: 2024-07-24T16:21:53.526 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-07-24T16:21:53.526 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:21:53.526 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction Summary 2024-07-24T16:21:53.526 INFO:teuthology.orchestra.run.smithi159.stdout:======================================================================================= 2024-07-24T16:21:53.526 INFO:teuthology.orchestra.run.smithi159.stdout:Install 148 Packages 2024-07-24T16:21:53.526 INFO:teuthology.orchestra.run.smithi159.stdout:Upgrade 12 Packages 2024-07-24T16:21:53.526 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:21:53.527 INFO:teuthology.orchestra.run.smithi193.stdout:(3/160): ceph-base-19.0.0-5197.g86385b1d.el9.x8 11 MB/s | 5.4 MB 00:00 2024-07-24T16:21:53.527 INFO:teuthology.orchestra.run.smithi159.stdout:Total download size: 240 M 2024-07-24T16:21:53.527 INFO:teuthology.orchestra.run.smithi159.stdout:Downloading Packages: 2024-07-24T16:21:53.543 INFO:teuthology.orchestra.run.smithi193.stdout:(4/160): ceph-immutable-object-cache-19.0.0-519 1.4 MB/s | 145 kB 00:00 2024-07-24T16:21:53.635 INFO:teuthology.orchestra.run.smithi193.stdout:(5/160): ceph-mds-19.0.0-5197.g86385b1d.el9.x86 20 MB/s | 2.4 MB 00:00 2024-07-24T16:21:53.827 INFO:teuthology.orchestra.run.smithi193.stdout:(6/160): ceph-mon-19.0.0-5197.g86385b1d.el9.x86 25 MB/s | 4.7 MB 00:00 2024-07-24T16:21:53.869 INFO:teuthology.orchestra.run.smithi193.stdout:(7/160): ceph-mgr-19.0.0-5197.g86385b1d.el9.x86 4.7 MB/s | 1.5 MB 00:00 2024-07-24T16:21:54.300 INFO:teuthology.orchestra.run.smithi159.stdout:(1/160): ceph-19.0.0-5197.g86385b1d.el9.x86_64. 18 kB/s | 6.6 kB 00:00 2024-07-24T16:21:54.461 INFO:teuthology.orchestra.run.smithi193.stdout:(8/160): ceph-osd-19.0.0-5197.g86385b1d.el9.x86 27 MB/s | 17 MB 00:00 2024-07-24T16:21:54.519 INFO:teuthology.orchestra.run.smithi193.stdout:(9/160): ceph-selinux-19.0.0-5197.g86385b1d.el9 432 kB/s | 25 kB 00:00 2024-07-24T16:21:54.551 INFO:teuthology.orchestra.run.smithi159.stdout:(2/160): ceph-fuse-19.0.0-5197.g86385b1d.el9.x8 3.5 MB/s | 903 kB 00:00 2024-07-24T16:21:54.642 INFO:teuthology.orchestra.run.smithi159.stdout:(3/160): ceph-immutable-object-cache-19.0.0-519 1.5 MB/s | 145 kB 00:00 2024-07-24T16:21:54.770 INFO:teuthology.orchestra.run.smithi193.stdout:(10/160): ceph-common-19.0.0-5197.g86385b1d.el9 12 MB/s | 21 MB 00:01 2024-07-24T16:21:54.820 INFO:teuthology.orchestra.run.smithi193.stdout:(11/160): cephfs-mirror-19.0.0-5197.g86385b1d.e 4.5 MB/s | 228 kB 00:00 2024-07-24T16:21:54.878 INFO:teuthology.orchestra.run.smithi193.stdout:(12/160): cephfs-shell-19.0.0-5197.g86385b1d.el 464 kB/s | 27 kB 00:00 2024-07-24T16:21:54.943 INFO:teuthology.orchestra.run.smithi159.stdout:(4/160): ceph-mds-19.0.0-5197.g86385b1d.el9.x86 7.9 MB/s | 2.4 MB 00:00 2024-07-24T16:21:54.995 INFO:teuthology.orchestra.run.smithi193.stdout:(13/160): ceph-radosgw-19.0.0-5197.g86385b1d.el 9.7 MB/s | 11 MB 00:01 2024-07-24T16:21:55.021 INFO:teuthology.orchestra.run.smithi193.stdout:(14/160): libcephfs-devel-19.0.0-5197.g86385b1d 223 kB/s | 32 kB 00:00 2024-07-24T16:21:55.088 INFO:teuthology.orchestra.run.smithi193.stdout:(15/160): libcephsqlite-19.0.0-5197.g86385b1d.e 2.4 MB/s | 163 kB 00:00 2024-07-24T16:21:55.113 INFO:teuthology.orchestra.run.smithi193.stdout:(16/160): libcephfs2-19.0.0-5197.g86385b1d.el9. 6.3 MB/s | 758 kB 00:00 2024-07-24T16:21:55.126 INFO:teuthology.orchestra.run.smithi159.stdout:(5/160): ceph-mgr-19.0.0-5197.g86385b1d.el9.x86 8.3 MB/s | 1.5 MB 00:00 2024-07-24T16:21:55.138 INFO:teuthology.orchestra.run.smithi193.stdout:(17/160): librados-devel-19.0.0-5197.g86385b1d. 2.5 MB/s | 127 kB 00:00 2024-07-24T16:21:55.172 INFO:teuthology.orchestra.run.smithi193.stdout:(18/160): libradosstriper1-19.0.0-5197.g86385b1 8.5 MB/s | 510 kB 00:00 2024-07-24T16:21:55.202 INFO:teuthology.orchestra.run.smithi159.stdout:(6/160): ceph-base-19.0.0-5197.g86385b1d.el9.x8 4.3 MB/s | 5.4 MB 00:01 2024-07-24T16:21:55.222 INFO:teuthology.orchestra.run.smithi193.stdout:(19/160): python3-ceph-argparse-19.0.0-5197.g86 905 kB/s | 45 kB 00:00 2024-07-24T16:21:55.314 INFO:teuthology.orchestra.run.smithi193.stdout:(20/160): python3-ceph-common-19.0.0-5197.g8638 1.5 MB/s | 138 kB 00:00 2024-07-24T16:21:55.406 INFO:teuthology.orchestra.run.smithi193.stdout:(21/160): python3-cephfs-19.0.0-5197.g86385b1d. 1.7 MB/s | 161 kB 00:00 2024-07-24T16:21:55.531 INFO:teuthology.orchestra.run.smithi193.stdout:(22/160): librgw2-19.0.0-5197.g86385b1d.el9.x86 14 MB/s | 5.5 MB 00:00 2024-07-24T16:21:55.556 INFO:teuthology.orchestra.run.smithi193.stdout:(23/160): python3-rados-19.0.0-5197.g86385b1d.e 2.1 MB/s | 321 kB 00:00 2024-07-24T16:21:55.615 INFO:teuthology.orchestra.run.smithi193.stdout:(24/160): python3-rbd-19.0.0-5197.g86385b1d.el9 3.6 MB/s | 303 kB 00:00 2024-07-24T16:21:55.640 INFO:teuthology.orchestra.run.smithi193.stdout:(25/160): python3-rgw-19.0.0-5197.g86385b1d.el9 1.2 MB/s | 99 kB 00:00 2024-07-24T16:21:55.682 INFO:teuthology.orchestra.run.smithi193.stdout:(26/160): rbd-fuse-19.0.0-5197.g86385b1d.el9.x8 1.2 MB/s | 85 kB 00:00 2024-07-24T16:21:55.749 INFO:teuthology.orchestra.run.smithi193.stdout:(27/160): rbd-nbd-19.0.0-5197.g86385b1d.el9.x86 2.5 MB/s | 170 kB 00:00 2024-07-24T16:21:55.810 INFO:teuthology.orchestra.run.smithi159.stdout:(7/160): ceph-common-19.0.0-5197.g86385b1d.el9. 11 MB/s | 21 MB 00:01 2024-07-24T16:21:55.816 INFO:teuthology.orchestra.run.smithi193.stdout:(28/160): ceph-grafana-dashboards-19.0.0-5197.g 514 kB/s | 34 kB 00:00 2024-07-24T16:21:55.885 INFO:teuthology.orchestra.run.smithi159.stdout:(8/160): ceph-mon-19.0.0-5197.g86385b1d.el9.x86 6.2 MB/s | 4.7 MB 00:00 2024-07-24T16:21:55.908 INFO:teuthology.orchestra.run.smithi193.stdout:(29/160): ceph-mgr-cephadm-19.0.0-5197.g86385b1 1.6 MB/s | 149 kB 00:00 2024-07-24T16:21:55.967 INFO:teuthology.orchestra.run.smithi193.stdout:(30/160): rbd-mirror-19.0.0-5197.g86385b1d.el9. 9.7 MB/s | 3.2 MB 00:00 2024-07-24T16:21:55.969 INFO:teuthology.orchestra.run.smithi159.stdout:(9/160): ceph-selinux-19.0.0-5197.g86385b1d.el9 302 kB/s | 25 kB 00:00 2024-07-24T16:21:56.611 INFO:teuthology.orchestra.run.smithi159.stdout:(10/160): ceph-radosgw-19.0.0-5197.g86385b1d.el 14 MB/s | 11 MB 00:00 2024-07-24T16:21:56.703 INFO:teuthology.orchestra.run.smithi159.stdout:(11/160): cephfs-mirror-19.0.0-5197.g86385b1d.e 2.4 MB/s | 228 kB 00:00 2024-07-24T16:21:56.787 INFO:teuthology.orchestra.run.smithi159.stdout:(12/160): cephfs-shell-19.0.0-5197.g86385b1d.el 324 kB/s | 27 kB 00:00 2024-07-24T16:21:56.854 INFO:teuthology.orchestra.run.smithi159.stdout:(13/160): libcephfs-devel-19.0.0-5197.g86385b1d 476 kB/s | 32 kB 00:00 2024-07-24T16:21:56.934 INFO:teuthology.orchestra.run.smithi193.stdout:(31/160): ceph-mgr-dashboard-19.0.0-5197.g86385 14 MB/s | 14 MB 00:01 2024-07-24T16:21:56.937 INFO:teuthology.orchestra.run.smithi159.stdout:(14/160): libcephfs2-19.0.0-5197.g86385b1d.el9. 8.9 MB/s | 758 kB 00:00 2024-07-24T16:21:57.012 INFO:teuthology.orchestra.run.smithi159.stdout:(15/160): libcephsqlite-19.0.0-5197.g86385b1d.e 2.1 MB/s | 163 kB 00:00 2024-07-24T16:21:57.017 INFO:teuthology.orchestra.run.smithi193.stdout:(32/160): ceph-mgr-diskprediction-local-19.0.0- 7.0 MB/s | 7.4 MB 00:01 2024-07-24T16:21:57.042 INFO:teuthology.orchestra.run.smithi193.stdout:(33/160): ceph-mgr-modules-core-19.0.0-5197.g86 2.6 MB/s | 284 kB 00:00 2024-07-24T16:21:57.076 INFO:teuthology.orchestra.run.smithi193.stdout:(34/160): ceph-mgr-rook-19.0.0-5197.g86385b1d.e 841 kB/s | 49 kB 00:00 2024-07-24T16:21:57.093 INFO:teuthology.orchestra.run.smithi193.stdout:(35/160): ceph-prometheus-alerts-19.0.0-5197.g8 326 kB/s | 16 kB 00:00 2024-07-24T16:21:57.144 INFO:teuthology.orchestra.run.smithi193.stdout:(36/160): ceph-volume-19.0.0-5197.g86385b1d.el9 4.0 MB/s | 274 kB 00:00 2024-07-24T16:21:57.180 INFO:teuthology.orchestra.run.smithi159.stdout:(16/160): ceph-osd-19.0.0-5197.g86385b1d.el9.x8 8.5 MB/s | 17 MB 00:01 2024-07-24T16:21:57.185 INFO:teuthology.orchestra.run.smithi193.stdout:(37/160): cephadm-19.0.0-5197.g86385b1d.el9.noa 8.2 MB/s | 771 kB 00:00 2024-07-24T16:21:57.202 INFO:teuthology.orchestra.run.smithi193.stdout:(38/160): cephfs-top-19.0.0-5197.g86385b1d.el9. 312 kB/s | 18 kB 00:00 2024-07-24T16:21:57.226 INFO:teuthology.orchestra.run.smithi159.stdout:(17/160): librados-devel-19.0.0-5197.g86385b1d. 593 kB/s | 127 kB 00:00 2024-07-24T16:21:57.363 INFO:teuthology.orchestra.run.smithi159.stdout:(18/160): libradosstriper1-19.0.0-5197.g86385b1 2.7 MB/s | 510 kB 00:00 2024-07-24T16:21:57.386 INFO:teuthology.orchestra.run.smithi193.stdout:(39/160): fuse-2.9.9-16.el9.x86_64.rpm 398 kB/s | 80 kB 00:00 2024-07-24T16:21:57.447 INFO:teuthology.orchestra.run.smithi159.stdout:(19/160): python3-ceph-argparse-19.0.0-5197.g86 541 kB/s | 45 kB 00:00 2024-07-24T16:21:57.486 INFO:teuthology.orchestra.run.smithi193.stdout:(40/160): libquadmath-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2024-07-24T16:21:57.514 INFO:teuthology.orchestra.run.smithi159.stdout:(20/160): python3-ceph-common-19.0.0-5197.g8638 2.0 MB/s | 138 kB 00:00 2024-07-24T16:21:57.520 INFO:teuthology.orchestra.run.smithi193.stdout:(41/160): libgfortran-11.4.1-3.el9.x86_64.rpm 2.5 MB/s | 803 kB 00:00 2024-07-24T16:21:57.545 INFO:teuthology.orchestra.run.smithi193.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-07-24T16:21:57.589 INFO:teuthology.orchestra.run.smithi159.stdout:(21/160): librgw2-19.0.0-5197.g86385b1d.el9.x86 15 MB/s | 5.5 MB 00:00 2024-07-24T16:21:57.614 INFO:teuthology.orchestra.run.smithi159.stdout:(22/160): python3-cephfs-19.0.0-5197.g86385b1d. 1.6 MB/s | 161 kB 00:00 2024-07-24T16:21:57.629 INFO:teuthology.orchestra.run.smithi193.stdout:(43/160): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.2 MB 00:00 2024-07-24T16:21:57.656 INFO:teuthology.orchestra.run.smithi159.stdout:(23/160): python3-rados-19.0.0-5197.g86385b1d.e 4.7 MB/s | 321 kB 00:00 2024-07-24T16:21:57.679 INFO:teuthology.orchestra.run.smithi193.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 800 kB/s | 106 kB 00:00 2024-07-24T16:21:57.682 INFO:teuthology.orchestra.run.smithi159.stdout:(24/160): python3-rbd-19.0.0-5197.g86385b1d.el9 4.4 MB/s | 303 kB 00:00 2024-07-24T16:21:57.704 INFO:teuthology.orchestra.run.smithi193.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 1.8 MB/s | 135 kB 00:00 2024-07-24T16:21:57.715 INFO:teuthology.orchestra.run.smithi159.stdout:(25/160): python3-rgw-19.0.0-5197.g86385b1d.el9 1.7 MB/s | 99 kB 00:00 2024-07-24T16:21:57.721 INFO:teuthology.orchestra.run.smithi193.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-07-24T16:21:57.749 INFO:teuthology.orchestra.run.smithi159.stdout:(26/160): rbd-fuse-19.0.0-5197.g86385b1d.el9.x8 1.2 MB/s | 85 kB 00:00 2024-07-24T16:21:57.755 INFO:teuthology.orchestra.run.smithi193.stdout:(47/160): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-07-24T16:21:57.780 INFO:teuthology.orchestra.run.smithi193.stdout:(48/160): automake-1.16.2-8.el9.noarch.rpm 12 MB/s | 689 kB 00:00 2024-07-24T16:21:57.822 INFO:teuthology.orchestra.run.smithi193.stdout:(49/160): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-07-24T16:21:57.824 INFO:teuthology.orchestra.run.smithi159.stdout:(27/160): rbd-nbd-19.0.0-5197.g86385b1d.el9.x86 2.2 MB/s | 170 kB 00:00 2024-07-24T16:21:57.839 INFO:teuthology.orchestra.run.smithi193.stdout:(50/160): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-07-24T16:21:57.873 INFO:teuthology.orchestra.run.smithi193.stdout:(51/160): elfutils-libelf-devel-0.191-4.el9.x86 433 kB/s | 22 kB 00:00 2024-07-24T16:21:57.898 INFO:teuthology.orchestra.run.smithi193.stdout:(52/160): flex-2.6.4-9.el9.x86_64.rpm 5.2 MB/s | 313 kB 00:00 2024-07-24T16:21:57.916 INFO:teuthology.orchestra.run.smithi159.stdout:(28/160): rbd-mirror-19.0.0-5197.g86385b1d.el9. 16 MB/s | 3.2 MB 00:00 2024-07-24T16:21:57.931 INFO:teuthology.orchestra.run.smithi193.stdout:(53/160): flexiblas-3.0.4-8.el9.x86_64.rpm 563 kB/s | 33 kB 00:00 2024-07-24T16:21:57.942 INFO:teuthology.orchestra.run.smithi159.stdout:(29/160): ceph-grafana-dashboards-19.0.0-5197.g 293 kB/s | 34 kB 00:00 2024-07-24T16:21:57.975 INFO:teuthology.orchestra.run.smithi159.stdout:(30/160): ceph-mgr-cephadm-19.0.0-5197.g86385b1 2.5 MB/s | 149 kB 00:00 2024-07-24T16:21:57.982 INFO:teuthology.orchestra.run.smithi193.stdout:(54/160): flexiblas-openblas-openmp-3.0.4-8.el9 369 kB/s | 18 kB 00:00 2024-07-24T16:21:58.041 INFO:teuthology.orchestra.run.smithi193.stdout:(55/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-07-24T16:21:58.066 INFO:teuthology.orchestra.run.smithi193.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 11 kB 00:00 2024-07-24T16:21:58.100 INFO:teuthology.orchestra.run.smithi193.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-07-24T16:21:58.125 INFO:teuthology.orchestra.run.smithi193.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 775 kB/s | 45 kB 00:00 2024-07-24T16:21:58.159 INFO:teuthology.orchestra.run.smithi193.stdout:(59/160): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-07-24T16:21:58.201 INFO:teuthology.orchestra.run.smithi193.stdout:(60/160): libtool-2.4.6-46.el9.x86_64.rpm 7.5 MB/s | 581 kB 00:00 2024-07-24T16:21:58.226 INFO:teuthology.orchestra.run.smithi193.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-07-24T16:21:58.251 INFO:teuthology.orchestra.run.smithi193.stdout:(62/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-07-24T16:21:58.276 INFO:teuthology.orchestra.run.smithi193.stdout:(63/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-07-24T16:21:58.302 INFO:teuthology.orchestra.run.smithi193.stdout:(64/160): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-07-24T16:21:58.327 INFO:teuthology.orchestra.run.smithi193.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 699 kB/s | 35 kB 00:00 2024-07-24T16:21:58.401 INFO:teuthology.orchestra.run.smithi159.stdout:(31/160): ceph-mgr-diskprediction-local-19.0.0- 17 MB/s | 7.4 MB 00:00 2024-07-24T16:21:58.476 INFO:teuthology.orchestra.run.smithi159.stdout:(32/160): ceph-mgr-modules-core-19.0.0-5197.g86 3.7 MB/s | 284 kB 00:00 2024-07-24T16:21:58.486 INFO:teuthology.orchestra.run.smithi193.stdout:(66/160): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-07-24T16:21:58.526 INFO:teuthology.orchestra.run.smithi159.stdout:(33/160): ceph-mgr-rook-19.0.0-5197.g86385b1d.e 987 kB/s | 49 kB 00:00 2024-07-24T16:21:58.553 INFO:teuthology.orchestra.run.smithi193.stdout:(67/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 20 MB/s | 4.4 MB 00:00 2024-07-24T16:21:58.568 INFO:teuthology.orchestra.run.smithi159.stdout:(34/160): ceph-prometheus-alerts-19.0.0-5197.g8 393 kB/s | 16 kB 00:00 2024-07-24T16:21:58.586 INFO:teuthology.orchestra.run.smithi193.stdout:(68/160): postgresql-13.14-1.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-07-24T16:21:58.620 INFO:teuthology.orchestra.run.smithi193.stdout:(69/160): postgresql-contrib-13.14-1.el9.x86_64 14 MB/s | 911 kB 00:00 2024-07-24T16:21:58.626 INFO:teuthology.orchestra.run.smithi159.stdout:(35/160): ceph-volume-19.0.0-5197.g86385b1d.el9 4.6 MB/s | 274 kB 00:00 2024-07-24T16:21:58.645 INFO:teuthology.orchestra.run.smithi193.stdout:(70/160): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 133 kB 00:00 2024-07-24T16:21:58.702 INFO:teuthology.orchestra.run.smithi159.stdout:(36/160): cephadm-19.0.0-5197.g86385b1d.el9.noa 10 MB/s | 771 kB 00:00 2024-07-24T16:21:58.720 INFO:teuthology.orchestra.run.smithi193.stdout:(71/160): protobuf-3.14.0-13.el9.x86_64.rpm 14 MB/s | 1.0 MB 00:00 2024-07-24T16:21:58.761 INFO:teuthology.orchestra.run.smithi159.stdout:(37/160): cephfs-top-19.0.0-5197.g86385b1d.el9. 312 kB/s | 18 kB 00:00 2024-07-24T16:21:58.762 INFO:teuthology.orchestra.run.smithi193.stdout:(72/160): python3-attrs-20.3.0-7.el9.noarch.rpm 2.2 MB/s | 87 kB 00:00 2024-07-24T16:21:58.837 INFO:teuthology.orchestra.run.smithi193.stdout:(73/160): postgresql-server-13.14-1.el9.x86_64. 27 MB/s | 5.8 MB 00:00 2024-07-24T16:21:58.852 INFO:teuthology.orchestra.run.smithi159.stdout:(38/160): fuse-2.9.9-16.el9.x86_64.rpm 872 kB/s | 80 kB 00:00 2024-07-24T16:21:58.930 INFO:teuthology.orchestra.run.smithi193.stdout:(74/160): python3-babel-2.9.1-2.el9.noarch.rpm 36 MB/s | 6.0 MB 00:00 2024-07-24T16:21:58.955 INFO:teuthology.orchestra.run.smithi193.stdout:(75/160): python3-colorama-0.4.6-3.el9.noarch.r 535 kB/s | 61 kB 00:00 2024-07-24T16:21:58.995 INFO:teuthology.orchestra.run.smithi159.stdout:(39/160): ceph-mgr-dashboard-19.0.0-5197.g86385 13 MB/s | 14 MB 00:01 2024-07-24T16:21:58.997 INFO:teuthology.orchestra.run.smithi193.stdout:(76/160): python3-devel-3.9.18-3.el9.x86_64.rpm 5.8 MB/s | 244 kB 00:00 2024-07-24T16:21:59.022 INFO:teuthology.orchestra.run.smithi193.stdout:(77/160): python3-jinja2-2.11.3-6.el9.noarch.rp 3.6 MB/s | 248 kB 00:00 2024-07-24T16:21:59.047 INFO:teuthology.orchestra.run.smithi193.stdout:(78/160): python3-jsonpatch-1.21-16.el9.noarch. 516 kB/s | 26 kB 00:00 2024-07-24T16:21:59.053 INFO:teuthology.orchestra.run.smithi159.stdout:(40/160): libgfortran-11.4.1-3.el9.x86_64.rpm 3.9 MB/s | 803 kB 00:00 2024-07-24T16:21:59.073 INFO:teuthology.orchestra.run.smithi193.stdout:(79/160): python3-jsonpointer-2.0-4.el9.noarch. 382 kB/s | 19 kB 00:00 2024-07-24T16:21:59.079 INFO:teuthology.orchestra.run.smithi159.stdout:(41/160): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-07-24T16:21:59.098 INFO:teuthology.orchestra.run.smithi193.stdout:(80/160): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-07-24T16:21:59.104 INFO:teuthology.orchestra.run.smithi159.stdout:(42/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-07-24T16:21:59.123 INFO:teuthology.orchestra.run.smithi193.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 698 kB/s | 35 kB 00:00 2024-07-24T16:21:59.146 INFO:teuthology.orchestra.run.smithi159.stdout:(43/160): python3-cryptography-36.0.1-4.el9.x86 18 MB/s | 1.2 MB 00:00 2024-07-24T16:21:59.171 INFO:teuthology.orchestra.run.smithi159.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-07-24T16:21:59.196 INFO:teuthology.orchestra.run.smithi159.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-07-24T16:21:59.222 INFO:teuthology.orchestra.run.smithi159.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-07-24T16:21:59.247 INFO:teuthology.orchestra.run.smithi159.stdout:(47/160): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-07-24T16:21:59.272 INFO:teuthology.orchestra.run.smithi159.stdout:(48/160): automake-1.16.2-8.el9.noarch.rpm 13 MB/s | 689 kB 00:00 2024-07-24T16:21:59.306 INFO:teuthology.orchestra.run.smithi159.stdout:(49/160): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-07-24T16:21:59.333 INFO:teuthology.orchestra.run.smithi159.stdout:(50/160): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-07-24T16:21:59.356 INFO:teuthology.orchestra.run.smithi159.stdout:(51/160): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-07-24T16:21:59.382 INFO:teuthology.orchestra.run.smithi159.stdout:(52/160): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-07-24T16:21:59.407 INFO:teuthology.orchestra.run.smithi159.stdout:(53/160): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-07-24T16:21:59.449 INFO:teuthology.orchestra.run.smithi159.stdout:(54/160): flexiblas-openblas-openmp-3.0.4-8.el9 454 kB/s | 18 kB 00:00 2024-07-24T16:21:59.499 INFO:teuthology.orchestra.run.smithi159.stdout:(55/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-07-24T16:21:59.525 INFO:teuthology.orchestra.run.smithi159.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 152 kB/s | 11 kB 00:00 2024-07-24T16:21:59.550 INFO:teuthology.orchestra.run.smithi159.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-07-24T16:21:59.575 INFO:teuthology.orchestra.run.smithi159.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 904 kB/s | 45 kB 00:00 2024-07-24T16:21:59.582 INFO:teuthology.orchestra.run.smithi193.stdout:(82/160): ceph-test-19.0.0-5197.g86385b1d.el9.x 9.9 MB/s | 50 MB 00:05 2024-07-24T16:21:59.600 INFO:teuthology.orchestra.run.smithi159.stdout:(59/160): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2024-07-24T16:21:59.607 INFO:teuthology.orchestra.run.smithi193.stdout:(83/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 520 kB/s | 250 kB 00:00 2024-07-24T16:21:59.626 INFO:teuthology.orchestra.run.smithi159.stdout:(60/160): libtool-2.4.6-46.el9.x86_64.rpm 12 MB/s | 581 kB 00:00 2024-07-24T16:21:59.643 INFO:teuthology.orchestra.run.smithi159.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 616 kB/s | 25 kB 00:00 2024-07-24T16:21:59.660 INFO:teuthology.orchestra.run.smithi159.stdout:(62/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-07-24T16:21:59.682 INFO:teuthology.orchestra.run.smithi193.stdout:(84/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.7 MB/s | 5.1 MB 00:00 2024-07-24T16:21:59.685 INFO:teuthology.orchestra.run.smithi159.stdout:(63/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2024-07-24T16:21:59.710 INFO:teuthology.orchestra.run.smithi159.stdout:(64/160): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-07-24T16:21:59.716 INFO:teuthology.orchestra.run.smithi193.stdout:(85/160): python3-oauthlib-3.1.1-5.el9.noarch.r 1.6 MB/s | 222 kB 00:00 2024-07-24T16:21:59.727 INFO:teuthology.orchestra.run.smithi159.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 847 kB/s | 35 kB 00:00 2024-07-24T16:21:59.741 INFO:teuthology.orchestra.run.smithi193.stdout:(86/160): python3-packaging-20.9-5.el9.noarch.r 588 kB/s | 77 kB 00:00 2024-07-24T16:21:59.766 INFO:teuthology.orchestra.run.smithi193.stdout:(87/160): python3-prettytable-0.7.2-27.el9.noar 507 kB/s | 42 kB 00:00 2024-07-24T16:21:59.793 INFO:teuthology.orchestra.run.smithi193.stdout:(88/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-07-24T16:21:59.817 INFO:teuthology.orchestra.run.smithi193.stdout:(89/160): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-07-24T16:21:59.819 INFO:teuthology.orchestra.run.smithi159.stdout:(66/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 49 MB/s | 4.4 MB 00:00 2024-07-24T16:21:59.842 INFO:teuthology.orchestra.run.smithi193.stdout:(90/160): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-07-24T16:21:59.867 INFO:teuthology.orchestra.run.smithi193.stdout:(91/160): python3-pytz-2021.1-5.el9.noarch.rpm 686 kB/s | 51 kB 00:00 2024-07-24T16:21:59.892 INFO:teuthology.orchestra.run.smithi193.stdout:(92/160): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-07-24T16:21:59.895 INFO:teuthology.orchestra.run.smithi159.stdout:(67/160): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-07-24T16:21:59.934 INFO:teuthology.orchestra.run.smithi193.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 622 kB/s | 42 kB 00:00 2024-07-24T16:21:59.937 INFO:teuthology.orchestra.run.smithi159.stdout:(68/160): postgresql-13.14-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-07-24T16:21:59.979 INFO:teuthology.orchestra.run.smithi159.stdout:(69/160): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-07-24T16:21:59.985 INFO:teuthology.orchestra.run.smithi193.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 487 kB/s | 44 kB 00:00 2024-07-24T16:22:00.005 INFO:teuthology.orchestra.run.smithi159.stdout:(70/160): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-07-24T16:22:00.085 INFO:teuthology.orchestra.run.smithi193.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-07-24T16:22:00.105 INFO:teuthology.orchestra.run.smithi159.stdout:(71/160): postgresql-server-13.14-1.el9.x86_64. 46 MB/s | 5.8 MB 00:00 2024-07-24T16:22:00.138 INFO:teuthology.orchestra.run.smithi159.stdout:(72/160): protobuf-3.14.0-13.el9.x86_64.rpm 7.7 MB/s | 1.0 MB 00:00 2024-07-24T16:22:00.144 INFO:teuthology.orchestra.run.smithi193.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 228 kB/s | 36 kB 00:00 2024-07-24T16:22:00.163 INFO:teuthology.orchestra.run.smithi159.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-07-24T16:22:00.219 INFO:teuthology.orchestra.run.smithi193.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 362 kB/s | 47 kB 00:00 2024-07-24T16:22:00.256 INFO:teuthology.orchestra.run.smithi159.stdout:(74/160): python3-babel-2.9.1-2.el9.noarch.rpm 51 MB/s | 6.0 MB 00:00 2024-07-24T16:22:00.281 INFO:teuthology.orchestra.run.smithi159.stdout:(75/160): python3-colorama-0.4.6-3.el9.noarch.r 534 kB/s | 61 kB 00:00 2024-07-24T16:22:00.394 INFO:teuthology.orchestra.run.smithi193.stdout:(98/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-07-24T16:22:00.419 INFO:teuthology.orchestra.run.smithi193.stdout:(99/160): socat-1.7.4.1-6.el9.x86_64.rpm 1.1 MB/s | 304 kB 00:00 2024-07-24T16:22:00.445 INFO:teuthology.orchestra.run.smithi193.stdout:(100/160): uuid-1.6.2-55.el9.x86_64.rpm 260 kB/s | 58 kB 00:00 2024-07-24T16:22:00.470 INFO:teuthology.orchestra.run.smithi193.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-07-24T16:22:00.495 INFO:teuthology.orchestra.run.smithi193.stdout:(102/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.2 MB/s | 96 kB 00:00 2024-07-24T16:22:00.520 INFO:teuthology.orchestra.run.smithi193.stdout:(103/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 597 kB/s | 45 kB 00:00 2024-07-24T16:22:00.546 INFO:teuthology.orchestra.run.smithi193.stdout:(104/160): lua-devel-5.4.4-4.el9.x86_64.rpm 298 kB/s | 22 kB 00:00 2024-07-24T16:22:00.588 INFO:teuthology.orchestra.run.smithi193.stdout:(105/160): protobuf-compiler-3.14.0-13.el9.x86_ 13 MB/s | 863 kB 00:00 2024-07-24T16:22:00.713 INFO:teuthology.orchestra.run.smithi193.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 270 kB/s | 19 kB 00:00 2024-07-24T16:22:00.738 INFO:teuthology.orchestra.run.smithi193.stdout:(107/160): abseil-cpp-20211102.0-3.el9.x86_64.r 2.5 MB/s | 548 kB 00:00 2024-07-24T16:22:00.739 INFO:teuthology.orchestra.run.smithi159.stdout:(76/160): ceph-test-19.0.0-5197.g86385b1d.el9.x 10 MB/s | 50 MB 00:04 2024-07-24T16:22:00.763 INFO:teuthology.orchestra.run.smithi193.stdout:(108/160): gperftools-libs-2.9.1-2.el9.x86_64.r 1.4 MB/s | 309 kB 00:00 2024-07-24T16:22:00.764 INFO:teuthology.orchestra.run.smithi159.stdout:(77/160): python3-jinja2-2.11.3-6.el9.noarch.rp 514 kB/s | 248 kB 00:00 2024-07-24T16:22:00.789 INFO:teuthology.orchestra.run.smithi193.stdout:(109/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 516 kB/s | 26 kB 00:00 2024-07-24T16:22:00.789 INFO:teuthology.orchestra.run.smithi159.stdout:(78/160): python3-devel-3.9.18-3.el9.x86_64.rpm 480 kB/s | 244 kB 00:00 2024-07-24T16:22:00.814 INFO:teuthology.orchestra.run.smithi193.stdout:(110/160): liboath-2.6.7-2.el9.x86_64.rpm 967 kB/s | 49 kB 00:00 2024-07-24T16:22:00.815 INFO:teuthology.orchestra.run.smithi159.stdout:(79/160): python3-jsonpatch-1.21-16.el9.noarch. 344 kB/s | 26 kB 00:00 2024-07-24T16:22:00.839 INFO:teuthology.orchestra.run.smithi193.stdout:(111/160): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-07-24T16:22:00.840 INFO:teuthology.orchestra.run.smithi159.stdout:(80/160): python3-jsonpointer-2.0-4.el9.noarch. 256 kB/s | 19 kB 00:00 2024-07-24T16:22:00.865 INFO:teuthology.orchestra.run.smithi193.stdout:(112/160): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-07-24T16:22:00.865 INFO:teuthology.orchestra.run.smithi159.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 696 kB/s | 35 kB 00:00 2024-07-24T16:22:00.891 INFO:teuthology.orchestra.run.smithi159.stdout:(82/160): python3-mako-1.1.4-6.el9.noarch.rpm 2.2 MB/s | 172 kB 00:00 2024-07-24T16:22:00.915 INFO:teuthology.orchestra.run.smithi193.stdout:(113/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-07-24T16:22:00.916 INFO:teuthology.orchestra.run.smithi159.stdout:(83/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 5.0 MB/s | 250 kB 00:00 2024-07-24T16:22:00.940 INFO:teuthology.orchestra.run.smithi193.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-07-24T16:22:00.941 INFO:teuthology.orchestra.run.smithi159.stdout:(84/160): python3-oauthlib-3.1.1-5.el9.noarch.r 4.4 MB/s | 222 kB 00:00 2024-07-24T16:22:00.965 INFO:teuthology.orchestra.run.smithi193.stdout:(115/160): python3-asyncssh-2.13.2-5.el9.noarch 5.3 MB/s | 548 kB 00:00 2024-07-24T16:22:00.966 INFO:teuthology.orchestra.run.smithi159.stdout:(85/160): python3-packaging-20.9-5.el9.noarch.r 1.6 MB/s | 77 kB 00:00 2024-07-24T16:22:00.982 INFO:teuthology.orchestra.run.smithi193.stdout:(116/160): python3-cachetools-4.2.4-1.el9.noarc 769 kB/s | 32 kB 00:00 2024-07-24T16:22:01.007 INFO:teuthology.orchestra.run.smithi193.stdout:(117/160): python3-certifi-2023.05.07-4.el9.noa 335 kB/s | 14 kB 00:00 2024-07-24T16:22:01.034 INFO:teuthology.orchestra.run.smithi159.stdout:(86/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 5.1 MB 00:00 2024-07-24T16:22:01.041 INFO:teuthology.orchestra.run.smithi193.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 2.8 MB/s | 172 kB 00:00 2024-07-24T16:22:01.059 INFO:teuthology.orchestra.run.smithi159.stdout:(87/160): python3-prettytable-0.7.2-27.el9.noar 369 kB/s | 42 kB 00:00 2024-07-24T16:22:01.083 INFO:teuthology.orchestra.run.smithi193.stdout:(119/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.1 MB/s | 303 kB 00:00 2024-07-24T16:22:01.084 INFO:teuthology.orchestra.run.smithi159.stdout:(88/160): python3-protobuf-3.14.0-13.el9.noarch 2.3 MB/s | 269 kB 00:00 2024-07-24T16:22:01.109 INFO:teuthology.orchestra.run.smithi193.stdout:(120/160): python3-cherrypy-18.6.1-2.el9.noarch 3.5 MB/s | 358 kB 00:00 2024-07-24T16:22:01.109 INFO:teuthology.orchestra.run.smithi159.stdout:(89/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-07-24T16:22:01.135 INFO:teuthology.orchestra.run.smithi159.stdout:(90/160): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-07-24T16:22:01.142 INFO:teuthology.orchestra.run.smithi193.stdout:(121/160): python3-google-auth-2.32.0-1.el9.noa 3.6 MB/s | 216 kB 00:00 2024-07-24T16:22:01.160 INFO:teuthology.orchestra.run.smithi159.stdout:(91/160): python3-pytz-2021.1-5.el9.noarch.rpm 677 kB/s | 51 kB 00:00 2024-07-24T16:22:01.185 INFO:teuthology.orchestra.run.smithi159.stdout:(92/160): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-07-24T16:22:01.209 INFO:teuthology.orchestra.run.smithi193.stdout:(122/160): libarrow-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 4.4 MB 00:00 2024-07-24T16:22:01.210 INFO:teuthology.orchestra.run.smithi159.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 832 kB/s | 42 kB 00:00 2024-07-24T16:22:01.235 INFO:teuthology.orchestra.run.smithi193.stdout:(123/160): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-07-24T16:22:01.235 INFO:teuthology.orchestra.run.smithi159.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 908 kB/s | 44 kB 00:00 2024-07-24T16:22:01.260 INFO:teuthology.orchestra.run.smithi193.stdout:(124/160): python3-jaraco-8.2.1-3.el9.noarch.rp 212 kB/s | 11 kB 00:00 2024-07-24T16:22:01.261 INFO:teuthology.orchestra.run.smithi159.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 4.5 MB/s | 221 kB 00:00 2024-07-24T16:22:01.285 INFO:teuthology.orchestra.run.smithi193.stdout:(125/160): python3-jaraco-classes-3.2.1-5.el9.n 353 kB/s | 18 kB 00:00 2024-07-24T16:22:01.286 INFO:teuthology.orchestra.run.smithi159.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 749 kB/s | 36 kB 00:00 2024-07-24T16:22:01.310 INFO:teuthology.orchestra.run.smithi193.stdout:(126/160): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-07-24T16:22:01.312 INFO:teuthology.orchestra.run.smithi159.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 991 kB/s | 47 kB 00:00 2024-07-24T16:22:01.335 INFO:teuthology.orchestra.run.smithi193.stdout:(127/160): python3-jaraco-functools-3.5.0-2.el9 388 kB/s | 19 kB 00:00 2024-07-24T16:22:01.346 INFO:teuthology.orchestra.run.smithi159.stdout:(98/160): socat-1.7.4.1-6.el9.x86_64.rpm 5.3 MB/s | 304 kB 00:00 2024-07-24T16:22:01.361 INFO:teuthology.orchestra.run.smithi193.stdout:(128/160): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-07-24T16:22:01.370 INFO:teuthology.orchestra.run.smithi159.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-07-24T16:22:01.403 INFO:teuthology.orchestra.run.smithi193.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-07-24T16:22:01.404 INFO:teuthology.orchestra.run.smithi159.stdout:(100/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.6 MB/s | 96 kB 00:00 2024-07-24T16:22:01.421 INFO:teuthology.orchestra.run.smithi159.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-07-24T16:22:01.445 INFO:teuthology.orchestra.run.smithi193.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 1.9 MB/s | 79 kB 00:00 2024-07-24T16:22:01.478 INFO:teuthology.orchestra.run.smithi193.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 1.7 MB/s | 58 kB 00:00 2024-07-24T16:22:01.520 INFO:teuthology.orchestra.run.smithi193.stdout:(132/160): python3-kubernetes-26.1.0-2.el9.noar 5.5 MB/s | 1.0 MB 00:00 2024-07-24T16:22:01.562 INFO:teuthology.orchestra.run.smithi193.stdout:(133/160): python3-grpcio-1.46.7-10.el9.x86_64. 4.5 MB/s | 2.0 MB 00:00 2024-07-24T16:22:01.588 INFO:teuthology.orchestra.run.smithi193.stdout:(134/160): python3-portend-3.1.0-2.el9.noarch.r 245 kB/s | 16 kB 00:00 2024-07-24T16:22:01.588 INFO:teuthology.orchestra.run.smithi159.stdout:(102/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-07-24T16:22:01.613 INFO:teuthology.orchestra.run.smithi193.stdout:(135/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.7 MB/s | 90 kB 00:00 2024-07-24T16:22:01.613 INFO:teuthology.orchestra.run.smithi159.stdout:(103/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 217 kB/s | 45 kB 00:00 2024-07-24T16:22:01.638 INFO:teuthology.orchestra.run.smithi193.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 563 kB/s | 28 kB 00:00 2024-07-24T16:22:01.639 INFO:teuthology.orchestra.run.smithi159.stdout:(104/160): lua-devel-5.4.4-4.el9.x86_64.rpm 104 kB/s | 22 kB 00:00 2024-07-24T16:22:01.663 INFO:teuthology.orchestra.run.smithi193.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-07-24T16:22:01.672 INFO:teuthology.orchestra.run.smithi159.stdout:(105/160): protobuf-compiler-3.14.0-13.el9.x86_ 10 MB/s | 863 kB 00:00 2024-07-24T16:22:01.688 INFO:teuthology.orchestra.run.smithi193.stdout:(138/160): python3-pecan-1.4.2-3.el9.noarch.rpm 1.3 MB/s | 272 kB 00:00 2024-07-24T16:22:01.714 INFO:teuthology.orchestra.run.smithi193.stdout:(139/160): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-07-24T16:22:01.767 INFO:teuthology.orchestra.run.smithi193.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 456 kB/s | 36 kB 00:00 2024-07-24T16:22:01.789 INFO:teuthology.orchestra.run.smithi193.stdout:(141/160): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-07-24T16:22:01.797 INFO:teuthology.orchestra.run.smithi159.stdout:(106/160): abseil-cpp-20211102.0-3.el9.x86_64.r 3.4 MB/s | 548 kB 00:00 2024-07-24T16:22:01.814 INFO:teuthology.orchestra.run.smithi193.stdout:(142/160): python3-typing-extensions-4.4.0-2.el 507 kB/s | 51 kB 00:00 2024-07-24T16:22:01.823 INFO:teuthology.orchestra.run.smithi159.stdout:(107/160): grpc-data-1.46.7-10.el9.noarch.rpm 129 kB/s | 19 kB 00:00 2024-07-24T16:22:01.840 INFO:teuthology.orchestra.run.smithi193.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-07-24T16:22:01.848 INFO:teuthology.orchestra.run.smithi159.stdout:(108/160): gperftools-libs-2.9.1-2.el9.x86_64.r 1.5 MB/s | 309 kB 00:00 2024-07-24T16:22:01.865 INFO:teuthology.orchestra.run.smithi193.stdout:(144/160): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-07-24T16:22:01.873 INFO:teuthology.orchestra.run.smithi159.stdout:(109/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-07-24T16:22:01.890 INFO:teuthology.orchestra.run.smithi193.stdout:(145/160): python3-webob-1.8.7-6.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-07-24T16:22:01.899 INFO:teuthology.orchestra.run.smithi159.stdout:(110/160): liboath-2.6.7-2.el9.x86_64.rpm 965 kB/s | 49 kB 00:00 2024-07-24T16:22:01.916 INFO:teuthology.orchestra.run.smithi193.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-07-24T16:22:01.924 INFO:teuthology.orchestra.run.smithi159.stdout:(111/160): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-07-24T16:22:01.949 INFO:teuthology.orchestra.run.smithi159.stdout:(112/160): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-07-24T16:22:01.950 INFO:teuthology.orchestra.run.smithi193.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-07-24T16:22:02.000 INFO:teuthology.orchestra.run.smithi159.stdout:(113/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 11 MB/s | 839 kB 00:00 2024-07-24T16:22:02.008 INFO:teuthology.orchestra.run.smithi193.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-07-24T16:22:02.016 INFO:teuthology.orchestra.run.smithi159.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-07-24T16:22:02.042 INFO:teuthology.orchestra.run.smithi159.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-07-24T16:22:02.083 INFO:teuthology.orchestra.run.smithi193.stdout:(149/160): NetworkManager-1.48.2-2.el9.x86_64.r 31 MB/s | 2.3 MB 00:00 2024-07-24T16:22:02.084 INFO:teuthology.orchestra.run.smithi159.stdout:(116/160): python3-asyncssh-2.13.2-5.el9.noarch 4.0 MB/s | 548 kB 00:00 2024-07-24T16:22:02.101 INFO:teuthology.orchestra.run.smithi159.stdout:(117/160): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-07-24T16:22:02.126 INFO:teuthology.orchestra.run.smithi159.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 4.0 MB/s | 172 kB 00:00 2024-07-24T16:22:02.150 INFO:teuthology.orchestra.run.smithi193.stdout:(150/160): NetworkManager-libnm-1.48.2-2.el9.x8 27 MB/s | 1.8 MB 00:00 2024-07-24T16:22:02.159 INFO:teuthology.orchestra.run.smithi159.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-07-24T16:22:02.184 INFO:teuthology.orchestra.run.smithi193.stdout:(151/160): NetworkManager-team-1.48.2-2.el9.x86 1.2 MB/s | 41 kB 00:00 2024-07-24T16:22:02.193 INFO:teuthology.orchestra.run.smithi159.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.4 MB/s | 303 kB 00:00 2024-07-24T16:22:02.218 INFO:teuthology.orchestra.run.smithi159.stdout:(121/160): python3-google-auth-2.32.0-1.el9.noa 3.6 MB/s | 216 kB 00:00 2024-07-24T16:22:02.243 INFO:teuthology.orchestra.run.smithi193.stdout:(152/160): NetworkManager-tui-1.48.2-2.el9.x86_ 4.1 MB/s | 247 kB 00:00 2024-07-24T16:22:02.244 INFO:teuthology.orchestra.run.smithi159.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-07-24T16:22:02.269 INFO:teuthology.orchestra.run.smithi159.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-07-24T16:22:02.294 INFO:teuthology.orchestra.run.smithi159.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-07-24T16:22:02.309 INFO:teuthology.orchestra.run.smithi193.stdout:(153/160): elfutils-debuginfod-client-0.191-4.e 551 kB/s | 37 kB 00:00 2024-07-24T16:22:02.320 INFO:teuthology.orchestra.run.smithi159.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 926 kB/s | 23 kB 00:00 2024-07-24T16:22:02.345 INFO:teuthology.orchestra.run.smithi159.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 765 kB/s | 19 kB 00:00 2024-07-24T16:22:02.368 INFO:teuthology.orchestra.run.smithi193.stdout:(154/160): librbd1-19.0.0-5197.g86385b1d.el9.x8 7.7 MB/s | 3.2 MB 00:00 2024-07-24T16:22:02.370 INFO:teuthology.orchestra.run.smithi159.stdout:(127/160): python3-jaraco-text-3.2.0-6.el9.noar 793 kB/s | 20 kB 00:00 2024-07-24T16:22:02.393 INFO:teuthology.orchestra.run.smithi193.stdout:(155/160): elfutils-libelf-0.191-4.el9.x86_64.r 2.4 MB/s | 207 kB 00:00 2024-07-24T16:22:02.419 INFO:teuthology.orchestra.run.smithi193.stdout:(156/160): elfutils-libs-0.191-4.el9.x86_64.rpm 5.1 MB/s | 260 kB 00:00 2024-07-24T16:22:02.446 INFO:teuthology.orchestra.run.smithi159.stdout:(128/160): libarrow-9.0.0-11.el9.x86_64.rpm 6.8 MB/s | 4.4 MB 00:00 2024-07-24T16:22:02.452 INFO:teuthology.orchestra.run.smithi193.stdout:(157/160): openssl-3.2.2-2.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-07-24T16:22:02.471 INFO:teuthology.orchestra.run.smithi159.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-07-24T16:22:02.511 INFO:teuthology.orchestra.run.smithi193.stdout:(158/160): librados2-19.0.0-5197.g86385b1d.el9. 5.7 MB/s | 3.4 MB 00:00 2024-07-24T16:22:02.513 INFO:teuthology.orchestra.run.smithi159.stdout:(130/160): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-07-24T16:22:02.555 INFO:teuthology.orchestra.run.smithi159.stdout:(131/160): python3-grpcio-1.46.7-10.el9.x86_64. 5.6 MB/s | 2.0 MB 00:00 2024-07-24T16:22:02.561 INFO:teuthology.orchestra.run.smithi193.stdout:(159/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 17 MB/s | 2.4 MB 00:00 2024-07-24T16:22:02.580 INFO:teuthology.orchestra.run.smithi159.stdout:(132/160): python3-more-itertools-8.12.0-2.el9. 724 kB/s | 79 kB 00:00 2024-07-24T16:22:02.586 INFO:teuthology.orchestra.run.smithi193.stdout:(160/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 8.2 MB/s | 1.1 MB 00:00 2024-07-24T16:22:02.596 INFO:teuthology.orchestra.run.smithi193.stdout:-------------------------------------------------------------------------------- 2024-07-24T16:22:02.596 INFO:teuthology.orchestra.run.smithi193.stdout:Total 24 MB/s | 240 MB 00:10 2024-07-24T16:22:02.606 INFO:teuthology.orchestra.run.smithi159.stdout:(133/160): python3-natsort-7.1.1-5.el9.noarch.r 625 kB/s | 58 kB 00:00 2024-07-24T16:22:02.631 INFO:teuthology.orchestra.run.smithi159.stdout:(134/160): python3-portend-3.1.0-2.el9.noarch.r 327 kB/s | 16 kB 00:00 2024-07-24T16:22:02.656 INFO:teuthology.orchestra.run.smithi159.stdout:(135/160): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-07-24T16:22:02.681 INFO:teuthology.orchestra.run.smithi159.stdout:(136/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-07-24T16:22:02.707 INFO:teuthology.orchestra.run.smithi159.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-07-24T16:22:02.732 INFO:teuthology.orchestra.run.smithi159.stdout:(138/160): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-07-24T16:22:02.757 INFO:teuthology.orchestra.run.smithi159.stdout:(139/160): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-07-24T16:22:02.783 INFO:teuthology.orchestra.run.smithi159.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-07-24T16:22:02.808 INFO:teuthology.orchestra.run.smithi159.stdout:(141/160): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-07-24T16:22:02.833 INFO:teuthology.orchestra.run.smithi159.stdout:(142/160): python3-typing-extensions-4.4.0-2.el 674 kB/s | 51 kB 00:00 2024-07-24T16:22:02.859 INFO:teuthology.orchestra.run.smithi159.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-07-24T16:22:02.884 INFO:teuthology.orchestra.run.smithi159.stdout:(144/160): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-07-24T16:22:02.901 INFO:teuthology.orchestra.run.smithi159.stdout:(145/160): python3-zc-lockfile-2.0-10.el9.noarc 476 kB/s | 20 kB 00:00 2024-07-24T16:22:02.926 INFO:teuthology.orchestra.run.smithi159.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 4.5 MB/s | 192 kB 00:00 2024-07-24T16:22:02.951 INFO:teuthology.orchestra.run.smithi159.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-07-24T16:22:03.001 INFO:teuthology.orchestra.run.smithi159.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-07-24T16:22:03.094 INFO:teuthology.orchestra.run.smithi159.stdout:(149/160): NetworkManager-1.48.2-2.el9.x86_64.r 25 MB/s | 2.3 MB 00:00 2024-07-24T16:22:03.169 INFO:teuthology.orchestra.run.smithi159.stdout:(150/160): NetworkManager-libnm-1.48.2-2.el9.x8 24 MB/s | 1.8 MB 00:00 2024-07-24T16:22:03.194 INFO:teuthology.orchestra.run.smithi159.stdout:(151/160): NetworkManager-team-1.48.2-2.el9.x86 1.6 MB/s | 41 kB 00:00 2024-07-24T16:22:03.236 INFO:teuthology.orchestra.run.smithi159.stdout:(152/160): NetworkManager-tui-1.48.2-2.el9.x86_ 5.8 MB/s | 247 kB 00:00 2024-07-24T16:22:03.286 INFO:teuthology.orchestra.run.smithi159.stdout:(153/160): librados2-19.0.0-5197.g86385b1d.el9. 9.5 MB/s | 3.4 MB 00:00 2024-07-24T16:22:03.304 INFO:teuthology.orchestra.run.smithi159.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 545 kB/s | 37 kB 00:00 2024-07-24T16:22:03.329 INFO:teuthology.orchestra.run.smithi159.stdout:(155/160): elfutils-libelf-0.191-4.el9.x86_64.r 4.8 MB/s | 207 kB 00:00 2024-07-24T16:22:03.354 INFO:teuthology.orchestra.run.smithi159.stdout:(156/160): elfutils-libs-0.191-4.el9.x86_64.rpm 5.1 MB/s | 260 kB 00:00 2024-07-24T16:22:03.388 INFO:teuthology.orchestra.run.smithi159.stdout:(157/160): openssl-3.2.2-2.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-07-24T16:22:03.438 INFO:teuthology.orchestra.run.smithi159.stdout:(158/160): librbd1-19.0.0-5197.g86385b1d.el9.x8 6.6 MB/s | 3.2 MB 00:00 2024-07-24T16:22:03.471 INFO:teuthology.orchestra.run.smithi159.stdout:(159/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-07-24T16:22:03.522 INFO:teuthology.orchestra.run.smithi159.stdout:(160/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 14 MB/s | 2.4 MB 00:00 2024-07-24T16:22:03.528 INFO:teuthology.orchestra.run.smithi159.stdout:-------------------------------------------------------------------------------- 2024-07-24T16:22:03.528 INFO:teuthology.orchestra.run.smithi159.stdout:Total 24 MB/s | 240 MB 00:10 2024-07-24T16:22:03.851 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction check 2024-07-24T16:22:04.060 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction check succeeded. 2024-07-24T16:22:04.060 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction test 2024-07-24T16:22:04.747 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction check 2024-07-24T16:22:04.953 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction check succeeded. 2024-07-24T16:22:04.953 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction test 2024-07-24T16:22:06.281 INFO:teuthology.orchestra.run.smithi193.stdout:Transaction test succeeded. 2024-07-24T16:22:06.282 INFO:teuthology.orchestra.run.smithi193.stdout:Running transaction 2024-07-24T16:22:07.209 INFO:teuthology.orchestra.run.smithi159.stdout:Transaction test succeeded. 2024-07-24T16:22:07.210 INFO:teuthology.orchestra.run.smithi159.stdout:Running transaction 2024-07-24T16:22:12.866 INFO:teuthology.orchestra.run.smithi193.stdout: Preparing : 1/1 2024-07-24T16:22:12.957 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-07-24T16:22:13.003 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-07-24T16:22:13.067 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-07-24T16:22:13.388 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-07-24T16:22:13.498 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 5/172 2024-07-24T16:22:13.629 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 5/172 2024-07-24T16:22:13.658 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T16:22:13.711 INFO:teuthology.orchestra.run.smithi159.stdout: Preparing : 1/1 2024-07-24T16:22:13.749 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T16:22:13.786 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 7/172 2024-07-24T16:22:13.801 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-07-24T16:22:13.811 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/172 2024-07-24T16:22:13.838 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/172 2024-07-24T16:22:13.849 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-07-24T16:22:13.882 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/172 2024-07-24T16:22:13.910 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-07-24T16:22:13.965 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 11/172 2024-07-24T16:22:14.129 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 12/172 2024-07-24T16:22:14.188 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-07-24T16:22:14.216 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T16:22:14.224 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-07-24T16:22:14.311 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T16:22:14.333 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 15/172 2024-07-24T16:22:14.334 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 5/172 2024-07-24T16:22:14.396 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 15/172 2024-07-24T16:22:14.417 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-24T16:22:14.443 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-24T16:22:14.456 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 5/172 2024-07-24T16:22:14.493 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T16:22:14.585 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T16:22:14.600 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-24T16:22:14.621 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 7/172 2024-07-24T16:22:14.694 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-24T16:22:14.772 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 8/172 2024-07-24T16:22:14.841 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 9/172 2024-07-24T16:22:14.887 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 10/172 2024-07-24T16:22:14.924 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-07-24T16:22:14.971 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 11/172 2024-07-24T16:22:15.101 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-24T16:22:15.136 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 12/172 2024-07-24T16:22:15.153 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-24T16:22:15.191 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-07-24T16:22:15.218 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T16:22:15.262 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T16:22:15.322 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T16:22:15.345 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T16:22:15.361 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 15/172 2024-07-24T16:22:15.424 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 15/172 2024-07-24T16:22:15.446 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-24T16:22:15.466 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-07-24T16:22:15.548 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T16:22:15.662 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-24T16:22:15.663 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-07-24T16:22:15.700 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-07-24T16:22:15.735 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-07-24T16:22:15.752 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-07-24T16:22:15.808 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-07-24T16:22:15.853 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-07-24T16:22:15.893 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-07-24T16:22:15.936 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-07-24T16:22:15.969 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-07-24T16:22:15.997 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-07-24T16:22:16.005 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-07-24T16:22:16.074 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-07-24T16:22:16.129 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-24T16:22:16.153 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-07-24T16:22:16.183 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-07-24T16:22:16.190 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-07-24T16:22:16.227 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-07-24T16:22:16.298 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T16:22:16.303 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-07-24T16:22:16.337 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-common-2:19.0.0-5197.g86385b1d.el9. 35/172 2024-07-24T16:22:16.366 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T16:22:16.381 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el 36/172 2024-07-24T16:22:16.412 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_6 37/172 2024-07-24T16:22:16.483 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-07-24T16:22:16.527 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-07-24T16:22:16.570 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-07-24T16:22:16.601 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-07-24T16:22:16.683 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-07-24T16:22:16.712 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-07-24T16:22:16.737 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-07-24T16:22:16.746 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : liboath-2.6.7-2.el9.x86_64 23/172 2024-07-24T16:22:16.788 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-07-24T16:22:16.831 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 24/172 2024-07-24T16:22:16.882 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 25/172 2024-07-24T16:22:16.922 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-packaging-20.9-5.el9.noarch 26/172 2024-07-24T16:22:16.966 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/172 2024-07-24T16:22:16.998 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 28/172 2024-07-24T16:22:17.026 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-5.4.4-4.el9.x86_64 29/172 2024-07-24T16:22:17.096 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 30/172 2024-07-24T16:22:17.149 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 31/172 2024-07-24T16:22:17.180 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/172 2024-07-24T16:22:17.223 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 33/172 2024-07-24T16:22:17.299 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 34/172 2024-07-24T16:22:17.327 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-07-24T16:22:17.341 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-common-2:19.0.0-5197.g86385b1d.el9. 35/172 2024-07-24T16:22:17.376 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el 36/172 2024-07-24T16:22:17.405 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_6 37/172 2024-07-24T16:22:17.408 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-07-24T16:22:17.437 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-07-24T16:22:17.474 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-07-24T16:22:17.475 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 38/172 2024-07-24T16:22:17.518 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-07-24T16:22:17.537 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : luarocks-3.9.2-5.el9.noarch 39/172 2024-07-24T16:22:17.561 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/172 2024-07-24T16:22:17.603 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_6 49/172 2024-07-24T16:22:17.610 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 40/172 2024-07-24T16:22:17.744 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 41/172 2024-07-24T16:22:17.755 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-07-24T16:22:17.789 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 42/172 2024-07-24T16:22:17.805 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 51/172 2024-07-24T16:22:17.897 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-07-24T16:22:17.961 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 53/172 2024-07-24T16:22:18.034 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-07-24T16:22:18.073 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-07-24T16:22:18.110 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/172 2024-07-24T16:22:18.199 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-07-24T16:22:18.307 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rsa-4.9-2.el9.noarch 43/172 2024-07-24T16:22:18.393 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 44/172 2024-07-24T16:22:18.402 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-07-24T16:22:18.422 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 45/172 2024-07-24T16:22:18.459 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 46/172 2024-07-24T16:22:18.503 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 47/172 2024-07-24T16:22:18.542 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 48/172 2024-07-24T16:22:18.555 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-07-24T16:22:18.588 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_6 49/172 2024-07-24T16:22:18.606 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-07-24T16:22:18.738 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 50/172 2024-07-24T16:22:18.746 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-07-24T16:22:18.780 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-07-24T16:22:18.807 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 51/172 2024-07-24T16:22:18.821 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-07-24T16:22:18.898 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 52/172 2024-07-24T16:22:18.920 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-07-24T16:22:18.963 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 53/172 2024-07-24T16:22:18.963 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-07-24T16:22:19.004 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-07-24T16:22:19.037 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-07-24T16:22:19.051 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-07-24T16:22:19.062 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-07-24T16:22:19.083 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-07-24T16:22:19.120 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 56/172 2024-07-24T16:22:19.152 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-07-24T16:22:19.168 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-07-24T16:22:19.205 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-07-24T16:22:19.247 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-07-24T16:22:19.281 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-07-24T16:22:19.290 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-07-24T16:22:19.311 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-07-24T16:22:19.339 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-07-24T16:22:19.373 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-07-24T16:22:19.412 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-07-24T16:22:19.427 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-07-24T16:22:19.444 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-07-24T16:22:19.473 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-07-24T16:22:19.475 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-07-24T16:22:19.508 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-07-24T16:22:19.517 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-07-24T16:22:19.541 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-07-24T16:22:19.583 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-07-24T16:22:19.614 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-07-24T16:22:19.617 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-07-24T16:22:19.650 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-07-24T16:22:19.690 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-07-24T16:22:19.704 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-07-24T16:22:19.715 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-07-24T16:22:19.748 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-07-24T16:22:19.779 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-07-24T16:22:19.785 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-07-24T16:22:19.882 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-07-24T16:22:19.938 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-24T16:22:19.997 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-07-24T16:22:20.135 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-07-24T16:22:20.173 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-07-24T16:22:20.200 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-07-24T16:22:20.235 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-07-24T16:22:20.274 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-07-24T16:22:20.313 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-07-24T16:22:20.344 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-07-24T16:22:20.378 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-07-24T16:22:20.411 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-07-24T16:22:20.453 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-07-24T16:22:20.487 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-07-24T16:22:20.574 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-07-24T16:22:20.619 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-07-24T16:22:20.649 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-07-24T16:22:20.666 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-07-24T16:22:20.734 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-07-24T16:22:20.754 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-07-24T16:22:20.778 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-07-24T16:22:20.816 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-24T16:22:20.880 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-07-24T16:22:20.933 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-07-24T16:22:20.978 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-07-24T16:22:21.066 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-07-24T16:22:21.114 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-07-24T16:22:21.290 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-07-24T16:22:21.311 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-07-24T16:22:21.390 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-07-24T16:22:21.538 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-07-24T16:22:21.581 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-07-24T16:22:21.614 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-07-24T16:22:21.711 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-07-24T16:22:21.769 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-07-24T16:22:21.815 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-07-24T16:22:21.903 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-07-24T16:22:21.942 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-07-24T16:22:22.048 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-07-24T16:22:22.126 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-07-24T16:22:22.156 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-07-24T16:22:22.159 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-07-24T16:22:22.236 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-07-24T16:22:22.881 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-07-24T16:22:22.995 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-07-24T16:22:23.404 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-07-24T16:22:23.674 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-07-24T16:22:23.701 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-07-24T16:22:23.735 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-07-24T16:22:24.139 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-07-24T16:22:24.189 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 104/172 2024-07-24T16:22:24.238 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-07-24T16:22:24.280 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 104/172 2024-07-24T16:22:24.311 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 105/172 2024-07-24T16:22:24.327 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-07-24T16:22:24.347 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-07-24T16:22:24.355 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-07-24T16:22:24.388 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-07-24T16:22:24.705 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-07-24T16:22:24.752 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 104/172 2024-07-24T16:22:24.836 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-07-24T16:22:24.851 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 104/172 2024-07-24T16:22:24.867 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 108/172 2024-07-24T16:22:24.881 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 105/172 2024-07-24T16:22:24.917 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-07-24T16:22:24.939 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 108/172 2024-07-24T16:22:24.969 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 109/172 2024-07-24T16:22:25.406 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-07-24T16:22:25.488 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 108/172 2024-07-24T16:22:25.560 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 108/172 2024-07-24T16:22:25.589 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 109/172 2024-07-24T16:22:27.310 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T16:22:27.340 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T16:22:27.892 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T16:22:27.895 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T16:22:27.927 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 111/172 2024-07-24T16:22:27.961 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T16:22:28.018 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 111/172 2024-07-24T16:22:28.018 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-07-24T16:22:28.018 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-07-24T16:22:28.018 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:22:28.045 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 112/172 2024-07-24T16:22:28.535 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 110/172 2024-07-24T16:22:28.573 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 111/172 2024-07-24T16:22:28.664 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 111/172 2024-07-24T16:22:28.664 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-07-24T16:22:28.664 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-07-24T16:22:28.664 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:22:28.691 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 112/172 2024-07-24T16:22:39.795 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 112/172 2024-07-24T16:22:39.795 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /sys 2024-07-24T16:22:39.795 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /proc 2024-07-24T16:22:39.795 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /mnt 2024-07-24T16:22:39.795 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /var/tmp 2024-07-24T16:22:39.795 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /home 2024-07-24T16:22:39.795 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /root 2024-07-24T16:22:39.796 INFO:teuthology.orchestra.run.smithi193.stdout:skipping the directory /tmp 2024-07-24T16:22:39.796 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:22:39.967 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 113/172 2024-07-24T16:22:39.983 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 113/172 2024-07-24T16:22:39.983 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:39.983 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-07-24T16:22:39.983 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:22:40.560 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 112/172 2024-07-24T16:22:40.560 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /sys 2024-07-24T16:22:40.560 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /proc 2024-07-24T16:22:40.561 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /mnt 2024-07-24T16:22:40.561 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /var/tmp 2024-07-24T16:22:40.561 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /home 2024-07-24T16:22:40.561 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /root 2024-07-24T16:22:40.561 INFO:teuthology.orchestra.run.smithi159.stdout:skipping the directory /tmp 2024-07-24T16:22:40.561 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:22:40.744 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 113/172 2024-07-24T16:22:40.760 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 113/172 2024-07-24T16:22:40.760 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:40.760 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-07-24T16:22:40.760 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:22:41.470 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 114/172 2024-07-24T16:22:41.497 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 114/172 2024-07-24T16:22:41.497 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:41.497 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-07-24T16:22:41.497 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-24T16:22:41.497 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-24T16:22:41.497 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:22:41.738 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 115/172 2024-07-24T16:22:41.761 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 115/172 2024-07-24T16:22:41.761 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:41.761 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-07-24T16:22:41.762 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-24T16:22:41.762 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-24T16:22:41.762 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:22:42.205 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 116/172 2024-07-24T16:22:42.228 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 116/172 2024-07-24T16:22:42.228 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:42.228 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-07-24T16:22:42.228 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-24T16:22:42.228 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-24T16:22:42.228 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:22:42.297 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 114/172 2024-07-24T16:22:42.323 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 114/172 2024-07-24T16:22:42.324 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:42.324 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-07-24T16:22:42.324 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-24T16:22:42.324 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-07-24T16:22:42.324 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:22:42.343 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-07-24T16:22:42.401 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-07-24T16:22:42.456 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-07-24T16:22:42.548 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 115/172 2024-07-24T16:22:42.571 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 115/172 2024-07-24T16:22:42.571 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:42.571 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-07-24T16:22:42.571 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-24T16:22:42.571 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-07-24T16:22:42.572 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:22:42.652 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-07-24T16:22:42.697 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-07-24T16:22:42.776 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-07-24T16:22:42.873 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-07-24T16:22:43.007 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 116/172 2024-07-24T16:22:43.013 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-07-24T16:22:43.030 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 116/172 2024-07-24T16:22:43.030 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:43.030 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-07-24T16:22:43.030 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-24T16:22:43.030 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-07-24T16:22:43.030 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:22:43.056 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-07-24T16:22:43.088 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-07-24T16:22:43.115 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-07-24T16:22:43.137 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-07-24T16:22:43.194 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-07-24T16:22:43.249 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-07-24T16:22:43.435 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-07-24T16:22:43.482 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-07-24T16:22:43.561 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-07-24T16:22:43.574 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 128/172 2024-07-24T16:22:43.607 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 128/172 2024-07-24T16:22:43.638 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.e 129/172 2024-07-24T16:22:43.658 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-07-24T16:22:43.703 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d. 130/172 2024-07-24T16:22:43.729 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 131/172 2024-07-24T16:22:43.795 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-07-24T16:22:43.832 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-07-24T16:22:43.865 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-07-24T16:22:43.892 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-07-24T16:22:44.316 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 128/172 2024-07-24T16:22:44.349 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 128/172 2024-07-24T16:22:44.381 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.e 129/172 2024-07-24T16:22:44.446 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d. 130/172 2024-07-24T16:22:44.472 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 131/172 2024-07-24T16:22:46.880 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 131/172 2024-07-24T16:22:46.936 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 132/172 2024-07-24T16:22:47.617 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 131/172 2024-07-24T16:22:47.662 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 132/172 2024-07-24T16:22:47.895 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 132/172 2024-07-24T16:22:47.920 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 133/172 2024-07-24T16:22:48.035 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 133/172 2024-07-24T16:22:48.199 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el 134/172 2024-07-24T16:22:48.230 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 135/172 2024-07-24T16:22:48.254 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 135/172 2024-07-24T16:22:48.254 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:48.254 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-07-24T16:22:48.254 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-24T16:22:48.254 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-24T16:22:48.254 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:22:48.297 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 136/172 2024-07-24T16:22:48.309 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 136/172 2024-07-24T16:22:48.407 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 137/172 2024-07-24T16:22:48.467 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 138/172 2024-07-24T16:22:48.624 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 132/172 2024-07-24T16:22:48.662 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 133/172 2024-07-24T16:22:48.775 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 133/172 2024-07-24T16:22:48.942 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el 134/172 2024-07-24T16:22:48.972 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 135/172 2024-07-24T16:22:48.996 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 135/172 2024-07-24T16:22:48.996 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:48.996 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-07-24T16:22:48.996 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-24T16:22:48.996 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-07-24T16:22:48.996 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:22:49.048 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 136/172 2024-07-24T16:22:49.060 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 136/172 2024-07-24T16:22:49.158 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 137/172 2024-07-24T16:22:49.209 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 138/172 2024-07-24T16:22:49.410 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-07-24T16:22:49.442 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 140/172 2024-07-24T16:22:49.466 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 140/172 2024-07-24T16:22:49.466 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:49.466 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-07-24T16:22:49.466 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-24T16:22:49.466 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-24T16:22:49.466 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:22:49.510 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5197.g86385 141/172 2024-07-24T16:22:49.533 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5197.g86385 141/172 2024-07-24T16:22:49.533 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:49.533 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-07-24T16:22:49.533 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:22:49.577 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 142/172 2024-07-24T16:22:49.600 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 142/172 2024-07-24T16:22:49.600 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:49.600 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-07-24T16:22:49.600 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-24T16:22:49.600 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-24T16:22:49.601 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:22:49.922 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 143/172 2024-07-24T16:22:49.942 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 143/172 2024-07-24T16:22:49.943 INFO:teuthology.orchestra.run.smithi193.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:49.943 INFO:teuthology.orchestra.run.smithi193.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-07-24T16:22:49.943 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-24T16:22:49.943 INFO:teuthology.orchestra.run.smithi193.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-24T16:22:49.943 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:22:50.155 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-07-24T16:22:50.192 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 140/172 2024-07-24T16:22:50.215 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 140/172 2024-07-24T16:22:50.215 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:50.215 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-07-24T16:22:50.215 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-24T16:22:50.215 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-07-24T16:22:50.215 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:22:50.259 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-5197.g86385 141/172 2024-07-24T16:22:50.282 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-5197.g86385 141/172 2024-07-24T16:22:50.282 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:50.282 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-07-24T16:22:50.282 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:22:50.327 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 142/172 2024-07-24T16:22:50.350 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 142/172 2024-07-24T16:22:50.350 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:50.350 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-07-24T16:22:50.350 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-24T16:22:50.350 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-07-24T16:22:50.350 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:22:50.660 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 143/172 2024-07-24T16:22:50.683 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 143/172 2024-07-24T16:22:50.684 INFO:teuthology.orchestra.run.smithi159.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-07-24T16:22:50.684 INFO:teuthology.orchestra.run.smithi159.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-07-24T16:22:50.684 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-24T16:22:50.684 INFO:teuthology.orchestra.run.smithi159.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-07-24T16:22:50.684 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:22:54.640 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 144/172 2024-07-24T16:22:54.681 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 145/172 2024-07-24T16:22:54.722 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 146/172 2024-07-24T16:22:54.755 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-07-24T16:22:54.782 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-07-24T16:22:54.975 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 149/172 2024-07-24T16:22:55.020 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-07-24T16:22:55.052 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_ 151/172 2024-07-24T16:22:55.093 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-07-24T16:22:55.122 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-07-24T16:22:55.161 INFO:teuthology.orchestra.run.smithi193.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-07-24T16:22:55.389 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 144/172 2024-07-24T16:22:55.430 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 145/172 2024-07-24T16:22:55.497 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 146/172 2024-07-24T16:22:55.528 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-07-24T16:22:55.556 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-07-24T16:22:55.741 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 149/172 2024-07-24T16:22:55.771 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T16:22:55.785 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-07-24T16:22:55.817 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T16:22:55.818 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_ 151/172 2024-07-24T16:22:55.837 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T16:22:55.850 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-07-24T16:22:55.879 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-07-24T16:22:55.925 INFO:teuthology.orchestra.run.smithi159.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-07-24T16:22:56.572 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T16:22:56.659 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T16:22:56.681 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 156/172 2024-07-24T16:22:56.682 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-07-24T16:22:56.773 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-07-24T16:22:56.814 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-07-24T16:22:56.901 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-07-24T16:22:56.934 INFO:teuthology.orchestra.run.smithi193.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-07-24T16:22:56.959 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-07-24T16:22:56.985 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-24T16:22:57.011 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-07-24T16:22:57.011 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-24T16:22:57.096 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-24T16:22:57.129 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-07-24T16:22:57.129 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-24T16:22:57.214 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-24T16:22:57.238 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-07-24T16:22:57.245 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T16:22:57.245 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T16:22:57.424 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T16:22:57.424 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-24T16:22:57.509 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-24T16:22:57.533 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-24T16:22:57.581 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-07-24T16:22:57.649 INFO:teuthology.orchestra.run.smithi193.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T16:22:57.738 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 156/172 2024-07-24T16:22:57.837 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-07-24T16:22:57.878 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-07-24T16:22:57.969 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-07-24T16:22:57.998 INFO:teuthology.orchestra.run.smithi159.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-07-24T16:22:58.023 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-07-24T16:22:58.057 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-24T16:22:58.083 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-07-24T16:22:58.083 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-24T16:22:58.160 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-07-24T16:22:58.193 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-07-24T16:22:58.193 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-24T16:22:58.260 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-07-24T16:22:58.327 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-07-24T16:22:58.332 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T16:22:58.332 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T16:22:58.512 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-07-24T16:22:58.512 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-24T16:22:58.596 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-07-24T16:22:58.621 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-24T16:22:58.647 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-07-24T16:22:58.713 INFO:teuthology.orchestra.run.smithi159.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T16:23:03.990 INFO:teuthology.orchestra.run.smithi193.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T16:23:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 1/172 2024-07-24T16:23:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 2/172 2024-07-24T16:23:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 3/172 2024-07-24T16:23:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 4/172 2024-07-24T16:23:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5197.g86385 5/172 2024-07-24T16:23:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T16:23:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 7/172 2024-07-24T16:23:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 8/172 2024-07-24T16:23:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 9/172 2024-07-24T16:23:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 10/172 2024-07-24T16:23:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 11/172 2024-07-24T16:23:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 12/172 2024-07-24T16:23:03.991 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 13/172 2024-07-24T16:23:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T16:23:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_ 15/172 2024-07-24T16:23:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 16/172 2024-07-24T16:23:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 17/172 2024-07-24T16:23:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_6 18/172 2024-07-24T16:23:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 19/172 2024-07-24T16:23:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 20/172 2024-07-24T16:23:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el 21/172 2024-07-24T16:23:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ceph-common-2:19.0.0-5197.g86385b1d.el9. 22/172 2024-07-24T16:23:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_6 23/172 2024-07-24T16:23:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 24/172 2024-07-24T16:23:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 25/172 2024-07-24T16:23:03.992 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 26/172 2024-07-24T16:23:03.993 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 27/172 2024-07-24T16:23:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 28/172 2024-07-24T16:23:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 29/172 2024-07-24T16:23:04.005 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d. 30/172 2024-07-24T16:23:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 31/172 2024-07-24T16:23:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 32/172 2024-07-24T16:23:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 33/172 2024-07-24T16:23:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el 34/172 2024-07-24T16:23:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 35/172 2024-07-24T16:23:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.e 36/172 2024-07-24T16:23:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 37/172 2024-07-24T16:23:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 38/172 2024-07-24T16:23:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 39/172 2024-07-24T16:23:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-07-24T16:23:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-07-24T16:23:04.006 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-07-24T16:23:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-07-24T16:23:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-07-24T16:23:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-07-24T16:23:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-07-24T16:23:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-07-24T16:23:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-07-24T16:23:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-07-24T16:23:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-07-24T16:23:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-07-24T16:23:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-07-24T16:23:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-07-24T16:23:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-07-24T16:23:04.007 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-07-24T16:23:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-07-24T16:23:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-07-24T16:23:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-07-24T16:23:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-07-24T16:23:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-07-24T16:23:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-07-24T16:23:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-07-24T16:23:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-07-24T16:23:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-07-24T16:23:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-07-24T16:23:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-07-24T16:23:04.008 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-07-24T16:23:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-07-24T16:23:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-07-24T16:23:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-07-24T16:23:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-07-24T16:23:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-07-24T16:23:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-07-24T16:23:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-07-24T16:23:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-07-24T16:23:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-07-24T16:23:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-07-24T16:23:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-07-24T16:23:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-07-24T16:23:04.009 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-07-24T16:23:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-07-24T16:23:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-07-24T16:23:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-07-24T16:23:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-07-24T16:23:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-24T16:23:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-07-24T16:23:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-07-24T16:23:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-07-24T16:23:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-07-24T16:23:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-07-24T16:23:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-07-24T16:23:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-07-24T16:23:04.010 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-07-24T16:23:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-07-24T16:23:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-07-24T16:23:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-07-24T16:23:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-07-24T16:23:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-07-24T16:23:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-07-24T16:23:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-07-24T16:23:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-07-24T16:23:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-07-24T16:23:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-07-24T16:23:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-07-24T16:23:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-07-24T16:23:04.011 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-07-24T16:23:04.012 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-07-24T16:23:04.013 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-07-24T16:23:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-07-24T16:23:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-07-24T16:23:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-07-24T16:23:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-07-24T16:23:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-07-24T16:23:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-07-24T16:23:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-07-24T16:23:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-07-24T16:23:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-07-24T16:23:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-07-24T16:23:04.014 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-07-24T16:23:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-07-24T16:23:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-07-24T16:23:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-07-24T16:23:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 149/172 2024-07-24T16:23:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-07-24T16:23:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 151/172 2024-07-24T16:23:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-07-24T16:23:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-07-24T16:23:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-07-24T16:23:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-07-24T16:23:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-07-24T16:23:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-07-24T16:23:04.015 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-07-24T16:23:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-07-24T16:23:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-07-24T16:23:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-07-24T16:23:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-24T16:23:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-07-24T16:23:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-07-24T16:23:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-07-24T16:23:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-07-24T16:23:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-07-24T16:23:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-07-24T16:23:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-07-24T16:23:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-24T16:23:04.016 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-07-24T16:23:04.881 INFO:teuthology.orchestra.run.smithi159.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T16:23:04.881 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 1/172 2024-07-24T16:23:04.881 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 2/172 2024-07-24T16:23:04.881 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 3/172 2024-07-24T16:23:04.881 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 4/172 2024-07-24T16:23:04.881 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-5197.g86385 5/172 2024-07-24T16:23:04.881 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 6/172 2024-07-24T16:23:04.881 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 7/172 2024-07-24T16:23:04.882 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 8/172 2024-07-24T16:23:04.882 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 9/172 2024-07-24T16:23:04.882 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 10/172 2024-07-24T16:23:04.882 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 11/172 2024-07-24T16:23:04.882 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 12/172 2024-07-24T16:23:04.882 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 13/172 2024-07-24T16:23:04.882 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 14/172 2024-07-24T16:23:04.882 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_ 15/172 2024-07-24T16:23:04.882 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 16/172 2024-07-24T16:23:04.882 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 17/172 2024-07-24T16:23:04.882 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_6 18/172 2024-07-24T16:23:04.882 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86 19/172 2024-07-24T16:23:04.883 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 20/172 2024-07-24T16:23:04.883 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el 21/172 2024-07-24T16:23:04.883 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ceph-common-2:19.0.0-5197.g86385b1d.el9. 22/172 2024-07-24T16:23:04.883 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_6 23/172 2024-07-24T16:23:04.883 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 24/172 2024-07-24T16:23:04.883 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 25/172 2024-07-24T16:23:04.883 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 26/172 2024-07-24T16:23:04.883 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 27/172 2024-07-24T16:23:04.883 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 28/172 2024-07-24T16:23:04.883 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 29/172 2024-07-24T16:23:04.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d. 30/172 2024-07-24T16:23:04.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noa 31/172 2024-07-24T16:23:04.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.n 32/172 2024-07-24T16:23:04.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-5197.g863 33/172 2024-07-24T16:23:04.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el 34/172 2024-07-24T16:23:04.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 35/172 2024-07-24T16:23:04.896 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.e 36/172 2024-07-24T16:23:04.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 37/172 2024-07-24T16:23:04.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 38/172 2024-07-24T16:23:04.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 39/172 2024-07-24T16:23:04.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-07-24T16:23:04.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-07-24T16:23:04.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-07-24T16:23:04.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-07-24T16:23:04.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-07-24T16:23:04.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-07-24T16:23:04.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-07-24T16:23:04.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-07-24T16:23:04.897 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-07-24T16:23:04.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-07-24T16:23:04.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-07-24T16:23:04.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-07-24T16:23:04.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-07-24T16:23:04.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-07-24T16:23:04.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-07-24T16:23:04.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-07-24T16:23:04.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-07-24T16:23:04.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-07-24T16:23:04.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-07-24T16:23:04.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-07-24T16:23:04.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-07-24T16:23:04.898 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-07-24T16:23:04.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-07-24T16:23:04.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-07-24T16:23:04.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-07-24T16:23:04.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-07-24T16:23:04.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-07-24T16:23:04.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-07-24T16:23:04.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-07-24T16:23:04.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-07-24T16:23:04.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-07-24T16:23:04.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-07-24T16:23:04.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-07-24T16:23:04.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-07-24T16:23:04.899 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-07-24T16:23:04.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-07-24T16:23:04.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-07-24T16:23:04.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-07-24T16:23:04.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-07-24T16:23:04.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-07-24T16:23:04.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-07-24T16:23:04.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-07-24T16:23:04.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-07-24T16:23:04.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-07-24T16:23:04.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-07-24T16:23:04.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-07-24T16:23:04.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-07-24T16:23:04.900 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-07-24T16:23:04.901 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-07-24T16:23:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-07-24T16:23:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-07-24T16:23:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-07-24T16:23:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-07-24T16:23:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-07-24T16:23:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-07-24T16:23:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-07-24T16:23:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-07-24T16:23:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-07-24T16:23:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-07-24T16:23:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-07-24T16:23:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-07-24T16:23:04.902 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-07-24T16:23:04.903 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-07-24T16:23:04.904 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/172 2024-07-24T16:23:04.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-07-24T16:23:04.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-07-24T16:23:04.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-07-24T16:23:04.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-07-24T16:23:04.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-07-24T16:23:04.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-07-24T16:23:04.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 149/172 2024-07-24T16:23:04.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-07-24T16:23:04.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 151/172 2024-07-24T16:23:04.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-07-24T16:23:04.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-07-24T16:23:04.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-07-24T16:23:04.905 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-07-24T16:23:04.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-07-24T16:23:04.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-07-24T16:23:04.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-07-24T16:23:04.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-07-24T16:23:04.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-07-24T16:23:04.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-07-24T16:23:04.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-07-24T16:23:04.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-07-24T16:23:04.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-07-24T16:23:04.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-07-24T16:23:04.906 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-07-24T16:23:04.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-07-24T16:23:04.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-07-24T16:23:04.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-07-24T16:23:04.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-07-24T16:23:04.907 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-07-24T16:23:06.673 INFO:teuthology.orchestra.run.smithi193.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T16:23:06.673 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:06.674 INFO:teuthology.orchestra.run.smithi193.stdout:Upgraded: 2024-07-24T16:23:06.674 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-07-24T16:23:06.674 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-07-24T16:23:06.674 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-07-24T16:23:06.674 INFO:teuthology.orchestra.run.smithi193.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-07-24T16:23:06.674 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-07-24T16:23:06.674 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-07-24T16:23:06.674 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-07-24T16:23:06.674 INFO:teuthology.orchestra.run.smithi193.stdout: librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.674 INFO:teuthology.orchestra.run.smithi193.stdout: librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.674 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-07-24T16:23:06.674 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-07-24T16:23:06.675 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-07-24T16:23:06.675 INFO:teuthology.orchestra.run.smithi193.stdout:Installed: 2024-07-24T16:23:06.675 INFO:teuthology.orchestra.run.smithi193.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-07-24T16:23:06.675 INFO:teuthology.orchestra.run.smithi193.stdout: automake-1.16.2-8.el9.noarch 2024-07-24T16:23:06.675 INFO:teuthology.orchestra.run.smithi193.stdout: bison-3.7.4-5.el9.x86_64 2024-07-24T16:23:06.675 INFO:teuthology.orchestra.run.smithi193.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-07-24T16:23:06.675 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.675 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.675 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.675 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.675 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:06.675 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-immutable-object-cache-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.675 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.676 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.676 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:06.676 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:06.676 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:06.676 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:06.676 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:06.676 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.676 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.676 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:06.676 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.676 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.676 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.676 INFO:teuthology.orchestra.run.smithi193.stdout: ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:06.677 INFO:teuthology.orchestra.run.smithi193.stdout: cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:06.677 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.677 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.677 INFO:teuthology.orchestra.run.smithi193.stdout: cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:06.677 INFO:teuthology.orchestra.run.smithi193.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-07-24T16:23:06.677 INFO:teuthology.orchestra.run.smithi193.stdout: flex-2.6.4-9.el9.x86_64 2024-07-24T16:23:06.677 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-07-24T16:23:06.677 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-07-24T16:23:06.677 INFO:teuthology.orchestra.run.smithi193.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-07-24T16:23:06.677 INFO:teuthology.orchestra.run.smithi193.stdout: fuse-2.9.9-16.el9.x86_64 2024-07-24T16:23:06.677 INFO:teuthology.orchestra.run.smithi193.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-07-24T16:23:06.678 INFO:teuthology.orchestra.run.smithi193.stdout: grpc-data-1.46.7-10.el9.noarch 2024-07-24T16:23:06.678 INFO:teuthology.orchestra.run.smithi193.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-07-24T16:23:06.678 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-9.0.0-11.el9.x86_64 2024-07-24T16:23:06.678 INFO:teuthology.orchestra.run.smithi193.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-07-24T16:23:06.678 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.678 INFO:teuthology.orchestra.run.smithi193.stdout: libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.678 INFO:teuthology.orchestra.run.smithi193.stdout: libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.678 INFO:teuthology.orchestra.run.smithi193.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-07-24T16:23:06.678 INFO:teuthology.orchestra.run.smithi193.stdout: liboath-2.6.7-2.el9.x86_64 2024-07-24T16:23:06.678 INFO:teuthology.orchestra.run.smithi193.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-07-24T16:23:06.678 INFO:teuthology.orchestra.run.smithi193.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-07-24T16:23:06.678 INFO:teuthology.orchestra.run.smithi193.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-07-24T16:23:06.679 INFO:teuthology.orchestra.run.smithi193.stdout: librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.679 INFO:teuthology.orchestra.run.smithi193.stdout: libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.679 INFO:teuthology.orchestra.run.smithi193.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-07-24T16:23:06.679 INFO:teuthology.orchestra.run.smithi193.stdout: librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.679 INFO:teuthology.orchestra.run.smithi193.stdout: libtool-2.4.6-46.el9.x86_64 2024-07-24T16:23:06.679 INFO:teuthology.orchestra.run.smithi193.stdout: libunwind-1.6.2-1.el9.x86_64 2024-07-24T16:23:06.679 INFO:teuthology.orchestra.run.smithi193.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-07-24T16:23:06.679 INFO:teuthology.orchestra.run.smithi193.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-07-24T16:23:06.679 INFO:teuthology.orchestra.run.smithi193.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-07-24T16:23:06.679 INFO:teuthology.orchestra.run.smithi193.stdout: lua-5.4.4-4.el9.x86_64 2024-07-24T16:23:06.679 INFO:teuthology.orchestra.run.smithi193.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-07-24T16:23:06.679 INFO:teuthology.orchestra.run.smithi193.stdout: luarocks-3.9.2-5.el9.noarch 2024-07-24T16:23:06.679 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-0.3.21-2.el9.x86_64 2024-07-24T16:23:06.680 INFO:teuthology.orchestra.run.smithi193.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-07-24T16:23:06.680 INFO:teuthology.orchestra.run.smithi193.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-07-24T16:23:06.680 INFO:teuthology.orchestra.run.smithi193.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-07-24T16:23:06.680 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-13.14-1.el9.x86_64 2024-07-24T16:23:06.680 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-07-24T16:23:06.680 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-07-24T16:23:06.680 INFO:teuthology.orchestra.run.smithi193.stdout: postgresql-server-13.14-1.el9.x86_64 2024-07-24T16:23:06.680 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-3.14.0-13.el9.x86_64 2024-07-24T16:23:06.681 INFO:teuthology.orchestra.run.smithi193.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-07-24T16:23:06.681 INFO:teuthology.orchestra.run.smithi193.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-07-24T16:23:06.681 INFO:teuthology.orchestra.run.smithi193.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-07-24T16:23:06.681 INFO:teuthology.orchestra.run.smithi193.stdout: python3-babel-2.9.1-2.el9.noarch 2024-07-24T16:23:06.681 INFO:teuthology.orchestra.run.smithi193.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-07-24T16:23:06.681 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-07-24T16:23:06.681 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.681 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.681 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.681 INFO:teuthology.orchestra.run.smithi193.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-07-24T16:23:06.681 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-07-24T16:23:06.681 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-07-24T16:23:06.681 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-07-24T16:23:06.682 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-07-24T16:23:06.682 INFO:teuthology.orchestra.run.smithi193.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-07-24T16:23:06.682 INFO:teuthology.orchestra.run.smithi193.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-07-24T16:23:06.682 INFO:teuthology.orchestra.run.smithi193.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-07-24T16:23:06.682 INFO:teuthology.orchestra.run.smithi193.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-07-24T16:23:06.682 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-07-24T16:23:06.682 INFO:teuthology.orchestra.run.smithi193.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-07-24T16:23:06.682 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-07-24T16:23:06.682 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-07-24T16:23:06.682 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-07-24T16:23:06.682 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-07-24T16:23:06.682 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-07-24T16:23:06.682 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-07-24T16:23:06.683 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-07-24T16:23:06.683 INFO:teuthology.orchestra.run.smithi193.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-07-24T16:23:06.683 INFO:teuthology.orchestra.run.smithi193.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-07-24T16:23:06.683 INFO:teuthology.orchestra.run.smithi193.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-07-24T16:23:06.683 INFO:teuthology.orchestra.run.smithi193.stdout: python3-mako-1.1.4-6.el9.noarch 2024-07-24T16:23:06.683 INFO:teuthology.orchestra.run.smithi193.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-07-24T16:23:06.683 INFO:teuthology.orchestra.run.smithi193.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-07-24T16:23:06.683 INFO:teuthology.orchestra.run.smithi193.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-07-24T16:23:06.683 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-07-24T16:23:06.683 INFO:teuthology.orchestra.run.smithi193.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-07-24T16:23:06.683 INFO:teuthology.orchestra.run.smithi193.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-07-24T16:23:06.683 INFO:teuthology.orchestra.run.smithi193.stdout: python3-packaging-20.9-5.el9.noarch 2024-07-24T16:23:06.684 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-07-24T16:23:06.684 INFO:teuthology.orchestra.run.smithi193.stdout: python3-ply-3.11-14.el9.noarch 2024-07-24T16:23:06.684 INFO:teuthology.orchestra.run.smithi193.stdout: python3-portend-3.1.0-2.el9.noarch 2024-07-24T16:23:06.684 INFO:teuthology.orchestra.run.smithi193.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-07-24T16:23:06.684 INFO:teuthology.orchestra.run.smithi193.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-07-24T16:23:06.684 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-07-24T16:23:06.684 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-07-24T16:23:06.684 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-07-24T16:23:06.684 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pycparser-2.20-6.el9.noarch 2024-07-24T16:23:06.684 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-07-24T16:23:06.684 INFO:teuthology.orchestra.run.smithi193.stdout: python3-pytz-2021.1-5.el9.noarch 2024-07-24T16:23:06.684 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.684 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.685 INFO:teuthology.orchestra.run.smithi193.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-07-24T16:23:06.685 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-2.25.1-8.el9.noarch 2024-07-24T16:23:06.685 INFO:teuthology.orchestra.run.smithi193.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-07-24T16:23:06.685 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.685 INFO:teuthology.orchestra.run.smithi193.stdout: python3-routes-2.5.1-5.el9.noarch 2024-07-24T16:23:06.685 INFO:teuthology.orchestra.run.smithi193.stdout: python3-rsa-4.9-2.el9.noarch 2024-07-24T16:23:06.685 INFO:teuthology.orchestra.run.smithi193.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-07-24T16:23:06.685 INFO:teuthology.orchestra.run.smithi193.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-07-24T16:23:06.685 INFO:teuthology.orchestra.run.smithi193.stdout: python3-toml-0.10.2-6.el9.noarch 2024-07-24T16:23:06.685 INFO:teuthology.orchestra.run.smithi193.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-07-24T16:23:06.685 INFO:teuthology.orchestra.run.smithi193.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-07-24T16:23:06.685 INFO:teuthology.orchestra.run.smithi193.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-07-24T16:23:06.685 INFO:teuthology.orchestra.run.smithi193.stdout: python3-webob-1.8.7-6.el9.noarch 2024-07-24T16:23:06.686 INFO:teuthology.orchestra.run.smithi193.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-07-24T16:23:06.686 INFO:teuthology.orchestra.run.smithi193.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-07-24T16:23:06.686 INFO:teuthology.orchestra.run.smithi193.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-07-24T16:23:06.686 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-24.02.0-1.el9.x86_64 2024-07-24T16:23:06.686 INFO:teuthology.orchestra.run.smithi193.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-07-24T16:23:06.686 INFO:teuthology.orchestra.run.smithi193.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-07-24T16:23:06.686 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.686 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.686 INFO:teuthology.orchestra.run.smithi193.stdout: rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:06.686 INFO:teuthology.orchestra.run.smithi193.stdout: re2-1:20211101-3.el9.x86_64 2024-07-24T16:23:06.686 INFO:teuthology.orchestra.run.smithi193.stdout: socat-1.7.4.1-6.el9.x86_64 2024-07-24T16:23:06.686 INFO:teuthology.orchestra.run.smithi193.stdout: thrift-0.15.0-2.el9.x86_64 2024-07-24T16:23:06.687 INFO:teuthology.orchestra.run.smithi193.stdout: uuid-1.6.2-55.el9.x86_64 2024-07-24T16:23:06.687 INFO:teuthology.orchestra.run.smithi193.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-07-24T16:23:06.687 INFO:teuthology.orchestra.run.smithi193.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-07-24T16:23:06.687 INFO:teuthology.orchestra.run.smithi193.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-07-24T16:23:06.687 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:06.687 INFO:teuthology.orchestra.run.smithi193.stdout:Complete! 2024-07-24T16:23:07.139 DEBUG:teuthology.parallel:result is None 2024-07-24T16:23:07.869 INFO:teuthology.orchestra.run.smithi159.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-07-24T16:23:07.869 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:07.869 INFO:teuthology.orchestra.run.smithi159.stdout:Upgraded: 2024-07-24T16:23:07.869 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-07-24T16:23:07.869 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-07-24T16:23:07.869 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-07-24T16:23:07.869 INFO:teuthology.orchestra.run.smithi159.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-07-24T16:23:07.869 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-07-24T16:23:07.869 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-07-24T16:23:07.869 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-07-24T16:23:07.870 INFO:teuthology.orchestra.run.smithi159.stdout: librados2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.870 INFO:teuthology.orchestra.run.smithi159.stdout: librbd1-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.870 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-07-24T16:23:07.870 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-07-24T16:23:07.870 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-07-24T16:23:07.870 INFO:teuthology.orchestra.run.smithi159.stdout:Installed: 2024-07-24T16:23:07.870 INFO:teuthology.orchestra.run.smithi159.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-07-24T16:23:07.870 INFO:teuthology.orchestra.run.smithi159.stdout: automake-1.16.2-8.el9.noarch 2024-07-24T16:23:07.870 INFO:teuthology.orchestra.run.smithi159.stdout: bison-3.7.4-5.el9.x86_64 2024-07-24T16:23:07.870 INFO:teuthology.orchestra.run.smithi159.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-07-24T16:23:07.870 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.870 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-base-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.871 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.871 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.871 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-grafana-dashboards-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:07.871 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-immutable-object-cache-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.871 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mds-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.871 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.871 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:07.871 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-dashboard-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:07.871 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-diskprediction-local-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:07.871 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-modules-core-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:07.871 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mgr-rook-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:07.872 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-mon-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.872 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-osd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.872 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-prometheus-alerts-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:07.873 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-radosgw-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.873 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-selinux-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.873 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-test-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.873 INFO:teuthology.orchestra.run.smithi159.stdout: ceph-volume-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:07.874 INFO:teuthology.orchestra.run.smithi159.stdout: cephadm-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:07.874 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.874 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-shell-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.874 INFO:teuthology.orchestra.run.smithi159.stdout: cephfs-top-2:19.0.0-5197.g86385b1d.el9.noarch 2024-07-24T16:23:07.874 INFO:teuthology.orchestra.run.smithi159.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-07-24T16:23:07.874 INFO:teuthology.orchestra.run.smithi159.stdout: flex-2.6.4-9.el9.x86_64 2024-07-24T16:23:07.874 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-07-24T16:23:07.874 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-07-24T16:23:07.874 INFO:teuthology.orchestra.run.smithi159.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-07-24T16:23:07.874 INFO:teuthology.orchestra.run.smithi159.stdout: fuse-2.9.9-16.el9.x86_64 2024-07-24T16:23:07.874 INFO:teuthology.orchestra.run.smithi159.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-07-24T16:23:07.875 INFO:teuthology.orchestra.run.smithi159.stdout: grpc-data-1.46.7-10.el9.noarch 2024-07-24T16:23:07.875 INFO:teuthology.orchestra.run.smithi159.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-07-24T16:23:07.875 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-9.0.0-11.el9.x86_64 2024-07-24T16:23:07.875 INFO:teuthology.orchestra.run.smithi159.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-07-24T16:23:07.875 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs-devel-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.875 INFO:teuthology.orchestra.run.smithi159.stdout: libcephfs2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.875 INFO:teuthology.orchestra.run.smithi159.stdout: libcephsqlite-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.875 INFO:teuthology.orchestra.run.smithi159.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-07-24T16:23:07.875 INFO:teuthology.orchestra.run.smithi159.stdout: liboath-2.6.7-2.el9.x86_64 2024-07-24T16:23:07.875 INFO:teuthology.orchestra.run.smithi159.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-07-24T16:23:07.875 INFO:teuthology.orchestra.run.smithi159.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-07-24T16:23:07.875 INFO:teuthology.orchestra.run.smithi159.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: librados-devel-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: libradosstriper1-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: librgw2-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: libtool-2.4.6-46.el9.x86_64 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: libunwind-1.6.2-1.el9.x86_64 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: lua-5.4.4-4.el9.x86_64 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: luarocks-3.9.2-5.el9.noarch 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-0.3.21-2.el9.x86_64 2024-07-24T16:23:07.876 INFO:teuthology.orchestra.run.smithi159.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-13.14-1.el9.x86_64 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: postgresql-server-13.14-1.el9.x86_64 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-3.14.0-13.el9.x86_64 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: python3-babel-2.9.1-2.el9.noarch 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-07-24T16:23:07.877 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-argparse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.878 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ceph-common-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.878 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cephfs-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.878 INFO:teuthology.orchestra.run.smithi159.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-07-24T16:23:07.878 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-07-24T16:23:07.878 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-07-24T16:23:07.878 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-07-24T16:23:07.878 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-07-24T16:23:07.878 INFO:teuthology.orchestra.run.smithi159.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-07-24T16:23:07.878 INFO:teuthology.orchestra.run.smithi159.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-07-24T16:23:07.878 INFO:teuthology.orchestra.run.smithi159.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-07-24T16:23:07.878 INFO:teuthology.orchestra.run.smithi159.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-07-24T16:23:07.878 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-07-24T16:23:07.878 INFO:teuthology.orchestra.run.smithi159.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-mako-1.1.4-6.el9.noarch 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-07-24T16:23:07.879 INFO:teuthology.orchestra.run.smithi159.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-packaging-20.9-5.el9.noarch 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-ply-3.11-14.el9.noarch 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-portend-3.1.0-2.el9.noarch 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pycparser-2.20-6.el9.noarch 2024-07-24T16:23:07.880 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-07-24T16:23:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: python3-pytz-2021.1-5.el9.noarch 2024-07-24T16:23:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rados-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rbd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-07-24T16:23:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-2.25.1-8.el9.noarch 2024-07-24T16:23:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-07-24T16:23:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rgw-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: python3-routes-2.5.1-5.el9.noarch 2024-07-24T16:23:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: python3-rsa-4.9-2.el9.noarch 2024-07-24T16:23:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-07-24T16:23:07.881 INFO:teuthology.orchestra.run.smithi159.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-07-24T16:23:07.882 INFO:teuthology.orchestra.run.smithi159.stdout: python3-toml-0.10.2-6.el9.noarch 2024-07-24T16:23:07.882 INFO:teuthology.orchestra.run.smithi159.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-07-24T16:23:07.882 INFO:teuthology.orchestra.run.smithi159.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-07-24T16:23:07.882 INFO:teuthology.orchestra.run.smithi159.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-07-24T16:23:07.882 INFO:teuthology.orchestra.run.smithi159.stdout: python3-webob-1.8.7-6.el9.noarch 2024-07-24T16:23:07.882 INFO:teuthology.orchestra.run.smithi159.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-07-24T16:23:07.882 INFO:teuthology.orchestra.run.smithi159.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-07-24T16:23:07.882 INFO:teuthology.orchestra.run.smithi159.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-07-24T16:23:07.882 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-24.02.0-1.el9.x86_64 2024-07-24T16:23:07.882 INFO:teuthology.orchestra.run.smithi159.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-07-24T16:23:07.882 INFO:teuthology.orchestra.run.smithi159.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-07-24T16:23:07.882 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-fuse-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.883 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-mirror-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.883 INFO:teuthology.orchestra.run.smithi159.stdout: rbd-nbd-2:19.0.0-5197.g86385b1d.el9.x86_64 2024-07-24T16:23:07.883 INFO:teuthology.orchestra.run.smithi159.stdout: re2-1:20211101-3.el9.x86_64 2024-07-24T16:23:07.883 INFO:teuthology.orchestra.run.smithi159.stdout: socat-1.7.4.1-6.el9.x86_64 2024-07-24T16:23:07.883 INFO:teuthology.orchestra.run.smithi159.stdout: thrift-0.15.0-2.el9.x86_64 2024-07-24T16:23:07.883 INFO:teuthology.orchestra.run.smithi159.stdout: uuid-1.6.2-55.el9.x86_64 2024-07-24T16:23:07.883 INFO:teuthology.orchestra.run.smithi159.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-07-24T16:23:07.883 INFO:teuthology.orchestra.run.smithi159.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-07-24T16:23:07.883 INFO:teuthology.orchestra.run.smithi159.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-07-24T16:23:07.883 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:07.884 INFO:teuthology.orchestra.run.smithi159.stdout:Complete! 2024-07-24T16:23:08.294 DEBUG:teuthology.parallel:result is None 2024-07-24T16:23:08.295 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T16:23:08.451 DEBUG:teuthology.orchestra.run.smithi159:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-07-24T16:23:08.473 INFO:teuthology.orchestra.run.smithi159.stdout:19.0.0-5197.g86385b1d.el9 2024-07-24T16:23:08.473 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5197.g86385b1d.el9 2024-07-24T16:23:08.474 INFO:teuthology.task.install:The correct ceph version 19.0.0-5197.g86385b1d is installed. 2024-07-24T16:23:08.476 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=86385b1daf5235400bbcd34a02515d168bde88e2 2024-07-24T16:23:08.615 DEBUG:teuthology.orchestra.run.smithi193:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-07-24T16:23:08.642 INFO:teuthology.orchestra.run.smithi193.stdout:19.0.0-5197.g86385b1d.el9 2024-07-24T16:23:08.642 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-5197.g86385b1d.el9 2024-07-24T16:23:08.642 INFO:teuthology.task.install:The correct ceph version 19.0.0-5197.g86385b1d is installed. 2024-07-24T16:23:08.644 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-07-24T16:23:08.644 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:08.644 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-07-24T16:23:08.671 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:08.671 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-07-24T16:23:08.715 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-07-24T16:23:08.715 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:08.715 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/daemon-helper 2024-07-24T16:23:08.740 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-07-24T16:23:08.805 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:08.805 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/daemon-helper 2024-07-24T16:23:08.834 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-07-24T16:23:08.902 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-07-24T16:23:08.902 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:08.902 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/adjust-ulimits 2024-07-24T16:23:08.927 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-07-24T16:23:08.991 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:08.991 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/adjust-ulimits 2024-07-24T16:23:09.019 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-07-24T16:23:09.086 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-07-24T16:23:09.086 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:09.087 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/usr/bin/stdin-killer 2024-07-24T16:23:09.111 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-07-24T16:23:09.176 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:09.176 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/usr/bin/stdin-killer 2024-07-24T16:23:09.204 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-07-24T16:23:09.271 INFO:teuthology.run_tasks:Running task ceph... 2024-07-24T16:23:09.347 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-07-24T16:23:09.348 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 777 /var/log/ceph 2024-07-24T16:23:09.350 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 777 /var/log/ceph 2024-07-24T16:23:09.376 INFO:tasks.ceph:Disabling ceph logrotate... 2024-07-24T16:23:09.377 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/logrotate.d/ceph 2024-07-24T16:23:09.415 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/logrotate.d/ceph 2024-07-24T16:23:09.444 INFO:tasks.ceph:Creating extra log directories... 2024-07-24T16:23:09.444 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-07-24T16:23:09.479 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-07-24T16:23:09.516 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-07-24T16:23:09.516 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-07-24T16:23:09.517 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-07-24T16:23:09.517 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:09.517 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-07-24T16:23:09.557 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-07-24T16:23:09.668 DEBUG:teuthology.orchestra.run.smithi159:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-07-24T16:23:09.693 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:09.693 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-07-24T16:23:09.709 DEBUG:teuthology.orchestra.run.smithi193:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-07-24T16:23:09.822 DEBUG:teuthology.orchestra.run.smithi193:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-07-24T16:23:09.851 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-07-24T16:23:09.852 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-07-24T16:23:09.852 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816776', 'branch': 'main', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/snap-schedule}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7816776', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '7bc81acc946e36bfc3ec8313b59200005ddf3f73'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1368, 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2', 'sleep_before_teardown': 0, 'subset': '738/1024', 'suite': 'fs', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '0325fd3c11a225c0fd9eb38fab88aad1370ad779', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi159.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCgkzFX8jGLsrMC+OAKerU7xXv2gm7bHRJgzHZSIqMC3kYfhZJ19xvZcv12AeNbUbJ90zpI/4s0wBr/BD1ScSfU=', 'smithi193.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLlhuR9IfBQ7brL0YImfXElZeBGrVoi/HWckvb7v7Lt+eFrYLqQ/5lw2h0Gsm/+nNRL6Xyoa7fYDmBKbdOQ9CZk='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': 1, 'sha1': '7bc81acc946e36bfc3ec8313b59200005ddf3f73'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'global': {'ms die on skipped message': False}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '86385b1daf5235400bbcd34a02515d168bde88e2', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_snap_schedules']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'a8aed60fc62d4ff39d2216b360f018eba7518cfe', 'timestamp': '2024-07-24_14:14:53', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.4074525'} 2024-07-24T16:23:09.852 DEBUG:teuthology.orchestra.run.smithi159:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-07-24T16:23:09.855 DEBUG:teuthology.orchestra.run.smithi193:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-07-24T16:23:09.902 DEBUG:teuthology.orchestra.run.smithi159:> sudo install -d -m0777 -- /var/run/ceph 2024-07-24T16:23:09.911 DEBUG:teuthology.orchestra.run.smithi193:> sudo install -d -m0777 -- /var/run/ceph 2024-07-24T16:23:09.968 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:09.969 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/scratch_devs of=/dev/stdout 2024-07-24T16:23:09.989 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-07-24T16:23:09.989 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_1 2024-07-24T16:23:10.044 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-07-24T16:23:10.044 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T16:23:10.044 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-07-24T16:23:10.044 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T16:23:10.044 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T16:23:10.045 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-07-24 16:22:59.079152879 +0000 2024-07-24T16:23:10.045 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-07-24 16:20:53.504960848 +0000 2024-07-24T16:23:10.045 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-07-24 16:20:53.504960848 +0000 2024-07-24T16:23:10.045 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-07-24 16:20:53.504960848 +0000 2024-07-24T16:23:10.045 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-07-24T16:23:10.107 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-07-24T16:23:10.107 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-07-24T16:23:10.107 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000180943 s, 2.8 MB/s 2024-07-24T16:23:10.108 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-07-24T16:23:10.164 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_2 2024-07-24T16:23:10.219 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-07-24T16:23:10.219 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T16:23:10.219 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-07-24T16:23:10.219 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T16:23:10.219 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T16:23:10.220 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-07-24 16:22:59.080152860 +0000 2024-07-24T16:23:10.220 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-07-24 16:20:53.854954193 +0000 2024-07-24T16:23:10.220 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-07-24 16:20:53.854954193 +0000 2024-07-24T16:23:10.220 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-07-24 16:20:53.854954193 +0000 2024-07-24T16:23:10.220 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-07-24T16:23:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-07-24T16:23:10.282 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-07-24T16:23:10.283 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.00023164 s, 2.2 MB/s 2024-07-24T16:23:10.284 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-07-24T16:23:10.340 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_3 2024-07-24T16:23:10.395 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-07-24T16:23:10.395 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T16:23:10.395 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-07-24T16:23:10.396 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T16:23:10.396 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T16:23:10.396 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-07-24 16:22:59.080152860 +0000 2024-07-24T16:23:10.396 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-07-24 16:20:54.200947618 +0000 2024-07-24T16:23:10.396 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-07-24 16:20:54.200947618 +0000 2024-07-24T16:23:10.396 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-07-24 16:20:54.200947618 +0000 2024-07-24T16:23:10.396 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-07-24T16:23:10.458 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-07-24T16:23:10.458 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-07-24T16:23:10.458 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000179357 s, 2.9 MB/s 2024-07-24T16:23:10.459 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-07-24T16:23:10.515 DEBUG:teuthology.orchestra.run.smithi159:> stat /dev/vg_nvme/lv_4 2024-07-24T16:23:10.570 INFO:teuthology.orchestra.run.smithi159.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-07-24T16:23:10.570 INFO:teuthology.orchestra.run.smithi159.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T16:23:10.570 INFO:teuthology.orchestra.run.smithi159.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-07-24T16:23:10.571 INFO:teuthology.orchestra.run.smithi159.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T16:23:10.571 INFO:teuthology.orchestra.run.smithi159.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T16:23:10.571 INFO:teuthology.orchestra.run.smithi159.stdout:Access: 2024-07-24 16:22:59.081152841 +0000 2024-07-24T16:23:10.571 INFO:teuthology.orchestra.run.smithi159.stdout:Modify: 2024-07-24 16:20:54.535941252 +0000 2024-07-24T16:23:10.571 INFO:teuthology.orchestra.run.smithi159.stdout:Change: 2024-07-24 16:20:54.535941252 +0000 2024-07-24T16:23:10.571 INFO:teuthology.orchestra.run.smithi159.stdout: Birth: 2024-07-24 16:20:54.535941252 +0000 2024-07-24T16:23:10.571 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-07-24T16:23:10.633 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records in 2024-07-24T16:23:10.633 INFO:teuthology.orchestra.run.smithi159.stderr:1+0 records out 2024-07-24T16:23:10.633 INFO:teuthology.orchestra.run.smithi159.stderr:512 bytes copied, 0.000190169 s, 2.7 MB/s 2024-07-24T16:23:10.635 DEBUG:teuthology.orchestra.run.smithi159:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-07-24T16:23:10.691 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-07-24T16:23:10.691 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:10.691 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/scratch_devs of=/dev/stdout 2024-07-24T16:23:10.708 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-07-24T16:23:10.709 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_1 2024-07-24T16:23:10.766 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-07-24T16:23:10.766 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T16:23:10.766 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-07-24T16:23:10.766 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T16:23:10.766 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T16:23:10.766 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-07-24 16:22:58.001327915 +0000 2024-07-24T16:23:10.766 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-07-24 16:20:53.508777777 +0000 2024-07-24T16:23:10.766 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-07-24 16:20:53.508777777 +0000 2024-07-24T16:23:10.766 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-07-24 16:20:53.508777777 +0000 2024-07-24T16:23:10.767 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-07-24T16:23:10.831 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-07-24T16:23:10.831 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-07-24T16:23:10.831 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.00021725 s, 2.4 MB/s 2024-07-24T16:23:10.833 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-07-24T16:23:10.890 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_2 2024-07-24T16:23:10.946 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-07-24T16:23:10.946 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T16:23:10.946 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-07-24T16:23:10.946 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T16:23:10.946 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T16:23:10.946 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-07-24 16:22:58.001327915 +0000 2024-07-24T16:23:10.947 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-07-24 16:20:53.837772981 +0000 2024-07-24T16:23:10.947 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-07-24 16:20:53.837772981 +0000 2024-07-24T16:23:10.947 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-07-24 16:20:53.837772981 +0000 2024-07-24T16:23:10.947 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-07-24T16:23:11.010 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-07-24T16:23:11.011 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-07-24T16:23:11.011 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000208784 s, 2.5 MB/s 2024-07-24T16:23:11.012 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-07-24T16:23:11.069 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_3 2024-07-24T16:23:11.125 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-07-24T16:23:11.125 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T16:23:11.125 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-07-24T16:23:11.125 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T16:23:11.125 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T16:23:11.125 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-07-24 16:22:58.002327901 +0000 2024-07-24T16:23:11.125 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-07-24 16:20:54.162768242 +0000 2024-07-24T16:23:11.125 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-07-24 16:20:54.162768242 +0000 2024-07-24T16:23:11.125 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-07-24 16:20:54.162768242 +0000 2024-07-24T16:23:11.125 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-07-24T16:23:11.188 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-07-24T16:23:11.188 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-07-24T16:23:11.189 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000225767 s, 2.3 MB/s 2024-07-24T16:23:11.190 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-07-24T16:23:11.246 DEBUG:teuthology.orchestra.run.smithi193:> stat /dev/vg_nvme/lv_4 2024-07-24T16:23:11.302 INFO:teuthology.orchestra.run.smithi193.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-07-24T16:23:11.302 INFO:teuthology.orchestra.run.smithi193.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-07-24T16:23:11.303 INFO:teuthology.orchestra.run.smithi193.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-07-24T16:23:11.303 INFO:teuthology.orchestra.run.smithi193.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-07-24T16:23:11.303 INFO:teuthology.orchestra.run.smithi193.stdout:Context: system_u:object_r:device_t:s0 2024-07-24T16:23:11.303 INFO:teuthology.orchestra.run.smithi193.stdout:Access: 2024-07-24 16:22:58.002327901 +0000 2024-07-24T16:23:11.303 INFO:teuthology.orchestra.run.smithi193.stdout:Modify: 2024-07-24 16:20:54.491763445 +0000 2024-07-24T16:23:11.303 INFO:teuthology.orchestra.run.smithi193.stdout:Change: 2024-07-24 16:20:54.491763445 +0000 2024-07-24T16:23:11.303 INFO:teuthology.orchestra.run.smithi193.stdout: Birth: 2024-07-24 16:20:54.491763445 +0000 2024-07-24T16:23:11.303 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-07-24T16:23:11.366 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records in 2024-07-24T16:23:11.366 INFO:teuthology.orchestra.run.smithi193.stderr:1+0 records out 2024-07-24T16:23:11.366 INFO:teuthology.orchestra.run.smithi193.stderr:512 bytes copied, 0.000225763 s, 2.3 MB/s 2024-07-24T16:23:11.368 DEBUG:teuthology.orchestra.run.smithi193:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-07-24T16:23:11.424 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-07-24T16:23:11.424 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi193.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-07-24T16:23:11.424 INFO:tasks.ceph:Generating config... 2024-07-24T16:23:11.425 INFO:tasks.ceph:[client] pid file = 2024-07-24T16:23:11.425 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-07-24T16:23:11.425 INFO:tasks.ceph:[mgr] debug client = 20 2024-07-24T16:23:11.426 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-07-24T16:23:11.426 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-07-24T16:23:11.426 INFO:tasks.ceph:[mgr] debug ms = 1 2024-07-24T16:23:11.426 INFO:tasks.ceph:[mon] debug mon = 20 2024-07-24T16:23:11.426 INFO:tasks.ceph:[mon] debug ms = 1 2024-07-24T16:23:11.426 INFO:tasks.ceph:[mon] debug paxos = 20 2024-07-24T16:23:11.426 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-07-24T16:23:11.426 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-07-24T16:23:11.426 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-07-24T16:23:11.426 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-07-24T16:23:11.426 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-07-24T16:23:11.426 INFO:tasks.ceph:[osd] debug ms = 1 2024-07-24T16:23:11.426 INFO:tasks.ceph:[osd] debug osd = 20 2024-07-24T16:23:11.426 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-07-24T16:23:11.427 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-07-24T16:23:11.427 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-07-24T16:23:11.427 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-07-24T16:23:11.427 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-07-24T16:23:11.427 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-07-24T16:23:11.427 INFO:tasks.ceph:Setting up mon.a... 2024-07-24T16:23:11.427 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-07-24T16:23:11.483 INFO:teuthology.orchestra.run.smithi159.stdout:creating /etc/ceph/ceph.keyring 2024-07-24T16:23:11.486 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-07-24T16:23:11.529 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-07-24T16:23:11.553 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.159'), ('mon.b', '172.21.15.193'), ('mon.c', '[v2:172.21.15.193:3301,v1:172.21.15.193:6790]')] 2024-07-24T16:23:11.554 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.159,172.21.15.193,[v2:172.21.15.193:3301,v1:172.21.15.193:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-07-24T16:23:11.555 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:11.555 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-07-24T16:23:11.608 DEBUG:teuthology.orchestra.run.smithi159:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.159 --add b 172.21.15.193 --addv c '[v2:172.21.15.193:3301,v1:172.21.15.193:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:11.694 INFO:teuthology.orchestra.run.smithi159.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:11.694 INFO:teuthology.orchestra.run.smithi159.stdout:monmaptool: generated fsid 15e9c2b9-79b9-45cf-833e-5ce98c29c7f6 2024-07-24T16:23:11.694 INFO:teuthology.orchestra.run.smithi159.stdout:setting min_mon_release = quincy 2024-07-24T16:23:11.695 INFO:teuthology.orchestra.run.smithi159.stdout:epoch 0 2024-07-24T16:23:11.695 INFO:teuthology.orchestra.run.smithi159.stdout:fsid 15e9c2b9-79b9-45cf-833e-5ce98c29c7f6 2024-07-24T16:23:11.695 INFO:teuthology.orchestra.run.smithi159.stdout:last_changed 2024-07-24T16:23:11.693219+0000 2024-07-24T16:23:11.695 INFO:teuthology.orchestra.run.smithi159.stdout:created 2024-07-24T16:23:11.693219+0000 2024-07-24T16:23:11.695 INFO:teuthology.orchestra.run.smithi159.stdout:min_mon_release 17 (quincy) 2024-07-24T16:23:11.695 INFO:teuthology.orchestra.run.smithi159.stdout:election_strategy: 1 2024-07-24T16:23:11.695 INFO:teuthology.orchestra.run.smithi159.stdout:0: [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] mon.a 2024-07-24T16:23:11.695 INFO:teuthology.orchestra.run.smithi159.stdout:1: [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] mon.b 2024-07-24T16:23:11.695 INFO:teuthology.orchestra.run.smithi159.stdout:2: [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] mon.c 2024-07-24T16:23:11.696 INFO:teuthology.orchestra.run.smithi159.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-07-24T16:23:11.697 DEBUG:teuthology.orchestra.run.smithi159:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-07-24T16:23:11.711 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 15e9c2b9-79b9-45cf-833e-5ce98c29c7f6... 2024-07-24T16:23:11.712 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-07-24T16:23:11.754 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-07-24T16:23:11.795 INFO:teuthology.orchestra.run.smithi159.stdout:[global] 2024-07-24T16:23:11.795 INFO:teuthology.orchestra.run.smithi159.stdout: chdir = "" 2024-07-24T16:23:11.795 INFO:teuthology.orchestra.run.smithi159.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-07-24T16:23:11.795 INFO:teuthology.orchestra.run.smithi159.stdout: auth supported = cephx 2024-07-24T16:23:11.795 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.795 INFO:teuthology.orchestra.run.smithi159.stdout: filestore xattr use omap = true 2024-07-24T16:23:11.795 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.795 INFO:teuthology.orchestra.run.smithi159.stdout: mon clock drift allowed = 1.000 2024-07-24T16:23:11.795 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.795 INFO:teuthology.orchestra.run.smithi159.stdout: osd crush chooseleaf type = 0 2024-07-24T16:23:11.795 INFO:teuthology.orchestra.run.smithi159.stdout: auth debug = true 2024-07-24T16:23:11.796 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.796 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on old message = true 2024-07-24T16:23:11.796 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on bug = true 2024-07-24T16:23:11.796 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.796 INFO:teuthology.orchestra.run.smithi159.stdout: mon max pg per osd = 10000 # >= luminous 2024-07-24T16:23:11.796 INFO:teuthology.orchestra.run.smithi159.stdout: mon pg warn max object skew = 0 2024-07-24T16:23:11.796 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.796 INFO:teuthology.orchestra.run.smithi159.stdout: # disable pg_autoscaler by default for new pools 2024-07-24T16:23:11.796 INFO:teuthology.orchestra.run.smithi159.stdout: osd_pool_default_pg_autoscale_mode = off 2024-07-24T16:23:11.796 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.796 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default size = 2 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow primary affinity = true 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd allow pg remap = true 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on legacy crush tunables = false 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on crush straw calc version zero = false 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on no sortbitwise = false 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on osd down out interval zero = false 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: mon warn on too few osds = false 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_pool_no_redundancy = false 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: mon_allow_pool_size_one = true 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.797 INFO:teuthology.orchestra.run.smithi159.stdout: osd default data pool replay window = 5 2024-07-24T16:23:11.798 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.798 INFO:teuthology.orchestra.run.smithi159.stdout: mon allow pool delete = true 2024-07-24T16:23:11.798 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.798 INFO:teuthology.orchestra.run.smithi159.stdout: mon cluster log file level = debug 2024-07-24T16:23:11.798 INFO:teuthology.orchestra.run.smithi159.stdout: debug asserts on shutdown = true 2024-07-24T16:23:11.798 INFO:teuthology.orchestra.run.smithi159.stdout: mon health detail to clog = false 2024-07-24T16:23:11.798 INFO:teuthology.orchestra.run.smithi159.stdout: mon host = "172.21.15.159,172.21.15.193,[v2:172.21.15.193:3301,v1:172.21.15.193:6790]" 2024-07-24T16:23:11.798 INFO:teuthology.orchestra.run.smithi159.stdout: ms die on skipped message = False 2024-07-24T16:23:11.798 INFO:teuthology.orchestra.run.smithi159.stdout: fsid = 15e9c2b9-79b9-45cf-833e-5ce98c29c7f6 2024-07-24T16:23:11.798 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.798 INFO:teuthology.orchestra.run.smithi159.stdout:[osd] 2024-07-24T16:23:11.798 INFO:teuthology.orchestra.run.smithi159.stdout: osd journal size = 100 2024-07-24T16:23:11.798 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.799 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub load threshold = 5.0 2024-07-24T16:23:11.799 INFO:teuthology.orchestra.run.smithi159.stdout: osd scrub max interval = 600 2024-07-24T16:23:11.799 INFO:teuthology.orchestra.run.smithi159.stdout: osd mclock profile = high_recovery_ops 2024-07-24T16:23:11.799 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.799 INFO:teuthology.orchestra.run.smithi159.stdout: osd recover clone overlap = true 2024-07-24T16:23:11.799 INFO:teuthology.orchestra.run.smithi159.stdout: osd recovery max chunk = 1048576 2024-07-24T16:23:11.799 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.799 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug shutdown = true 2024-07-24T16:23:11.799 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug op order = true 2024-07-24T16:23:11.799 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug verify stray on activate = true 2024-07-24T16:23:11.799 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug trim objects = true 2024-07-24T16:23:11.799 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.799 INFO:teuthology.orchestra.run.smithi159.stdout: osd open classes on start = true 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug pg log writeout = true 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: osd deep scrub update digest min age = 30 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: osd map max advance = 10 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: journal zero on create = true 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: filestore ondisk finisher threads = 3 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: filestore apply finisher threads = 3 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: bdev debug aio = true 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: osd debug misdirected ops = true 2024-07-24T16:23:11.800 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore block size = 96636764160 2024-07-24T16:23:11.801 INFO:teuthology.orchestra.run.smithi159.stdout: bluestore fsck on mount = True 2024-07-24T16:23:11.801 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluefs = 20 2024-07-24T16:23:11.801 INFO:teuthology.orchestra.run.smithi159.stdout: debug bluestore = 20 2024-07-24T16:23:11.801 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2024-07-24T16:23:11.801 INFO:teuthology.orchestra.run.smithi159.stdout: debug osd = 20 2024-07-24T16:23:11.801 INFO:teuthology.orchestra.run.smithi159.stdout: debug rocksdb = 10 2024-07-24T16:23:11.801 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd backfillfull_ratio = 0.85 2024-07-24T16:23:11.801 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd full ratio = 0.9 2024-07-24T16:23:11.801 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd nearfull ratio = 0.8 2024-07-24T16:23:11.801 INFO:teuthology.orchestra.run.smithi159.stdout: osd failsafe full ratio = 0.95 2024-07-24T16:23:11.801 INFO:teuthology.orchestra.run.smithi159.stdout: osd objectstore = bluestore 2024-07-24T16:23:11.801 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.802 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr] 2024-07-24T16:23:11.802 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2024-07-24T16:23:11.802 INFO:teuthology.orchestra.run.smithi159.stdout: debug mgr = 20 2024-07-24T16:23:11.802 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2024-07-24T16:23:11.802 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2024-07-24T16:23:11.802 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2024-07-24T16:23:11.802 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2024-07-24T16:23:11.802 INFO:teuthology.orchestra.run.smithi159.stdout: mgr/telemetry/nag = false 2024-07-24T16:23:11.802 INFO:teuthology.orchestra.run.smithi159.stdout: debug client = 20 2024-07-24T16:23:11.802 INFO:teuthology.orchestra.run.smithi159.stdout: debug finisher = 20 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout:[mon] 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout: debug ms = 1 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout: debug mon = 20 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout: debug paxos = 20 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout: debug auth = 20 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout: mon data avail warn = 5 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout: mon mgr mkfs grace = 240 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min pgs per osd = 4 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd reporter subtree level = osd 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout: mon osd prime pg temp = true 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout: mon reweight min bytes per osd = 10 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.803 INFO:teuthology.orchestra.run.smithi159.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout: auth mon ticket ttl = 660 # 11m 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout: auth service ticket ttl = 240 # 4m 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout: # don't complain about insecure global_id in the test suite 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout: # 1m isn't quite enough 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout: mon_down_mkfs_grace = 2m 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout: mon_warn_on_filestore_osds = false 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout: mon down mkfs grace = 300 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:11.804 INFO:teuthology.orchestra.run.smithi159.stdout:[client] 2024-07-24T16:23:11.805 INFO:teuthology.orchestra.run.smithi159.stdout: rgw cache enabled = true 2024-07-24T16:23:11.805 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable ops log = true 2024-07-24T16:23:11.805 INFO:teuthology.orchestra.run.smithi159.stdout: rgw enable usage log = true 2024-07-24T16:23:11.805 INFO:teuthology.orchestra.run.smithi159.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-07-24T16:23:11.805 INFO:teuthology.orchestra.run.smithi159.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-07-24T16:23:11.805 INFO:teuthology.orchestra.run.smithi159.stdout: pid file = "" 2024-07-24T16:23:11.805 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.a] 2024-07-24T16:23:11.805 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.b] 2024-07-24T16:23:11.805 INFO:teuthology.orchestra.run.smithi159.stdout:[mon.c] 2024-07-24T16:23:11.805 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.a] 2024-07-24T16:23:11.805 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.c] 2024-07-24T16:23:11.805 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.b] 2024-07-24T16:23:11.805 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.d] 2024-07-24T16:23:11.806 INFO:teuthology.orchestra.run.smithi193.stdout:[global] 2024-07-24T16:23:11.806 INFO:teuthology.orchestra.run.smithi193.stdout: chdir = "" 2024-07-24T16:23:11.806 INFO:teuthology.orchestra.run.smithi193.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-07-24T16:23:11.806 INFO:teuthology.orchestra.run.smithi193.stdout: auth supported = cephx 2024-07-24T16:23:11.806 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.806 INFO:teuthology.orchestra.run.smithi193.stdout: filestore xattr use omap = true 2024-07-24T16:23:11.806 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.806 INFO:teuthology.orchestra.run.smithi193.stdout: mon clock drift allowed = 1.000 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: osd crush chooseleaf type = 0 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: auth debug = true 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: ms die on old message = true 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: ms die on bug = true 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: mon max pg per osd = 10000 # >= luminous 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: mon pg warn max object skew = 0 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: # disable pg_autoscaler by default for new pools 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: osd_pool_default_pg_autoscale_mode = off 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: osd pool default size = 2 2024-07-24T16:23:11.807 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd allow primary affinity = true 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd allow pg remap = true 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on legacy crush tunables = false 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on crush straw calc version zero = false 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on no sortbitwise = false 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on osd down out interval zero = false 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: mon warn on too few osds = false 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_pool_no_redundancy = false 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: mon_allow_pool_size_one = true 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: osd default data pool replay window = 5 2024-07-24T16:23:11.808 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: mon allow pool delete = true 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: mon cluster log file level = debug 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: debug asserts on shutdown = true 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: mon health detail to clog = false 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: mon host = "172.21.15.159,172.21.15.193,[v2:172.21.15.193:3301,v1:172.21.15.193:6790]" 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: ms die on skipped message = False 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: fsid = 15e9c2b9-79b9-45cf-833e-5ce98c29c7f6 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout:[osd] 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: osd journal size = 100 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: osd scrub load threshold = 5.0 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: osd scrub max interval = 600 2024-07-24T16:23:11.809 INFO:teuthology.orchestra.run.smithi193.stdout: osd mclock profile = high_recovery_ops 2024-07-24T16:23:11.810 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.810 INFO:teuthology.orchestra.run.smithi193.stdout: osd recover clone overlap = true 2024-07-24T16:23:11.810 INFO:teuthology.orchestra.run.smithi193.stdout: osd recovery max chunk = 1048576 2024-07-24T16:23:11.810 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.810 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug shutdown = true 2024-07-24T16:23:11.810 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug op order = true 2024-07-24T16:23:11.810 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug verify stray on activate = true 2024-07-24T16:23:11.810 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug trim objects = true 2024-07-24T16:23:11.810 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.810 INFO:teuthology.orchestra.run.smithi193.stdout: osd open classes on start = true 2024-07-24T16:23:11.810 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug pg log writeout = true 2024-07-24T16:23:11.810 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.810 INFO:teuthology.orchestra.run.smithi193.stdout: osd deep scrub update digest min age = 30 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: osd map max advance = 10 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: journal zero on create = true 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: filestore ondisk finisher threads = 3 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: filestore apply finisher threads = 3 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: bdev debug aio = true 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: osd debug misdirected ops = true 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore block size = 96636764160 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: bluestore fsck on mount = True 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: debug bluefs = 20 2024-07-24T16:23:11.811 INFO:teuthology.orchestra.run.smithi193.stdout: debug bluestore = 20 2024-07-24T16:23:11.812 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-07-24T16:23:11.812 INFO:teuthology.orchestra.run.smithi193.stdout: debug osd = 20 2024-07-24T16:23:11.812 INFO:teuthology.orchestra.run.smithi193.stdout: debug rocksdb = 10 2024-07-24T16:23:11.812 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd backfillfull_ratio = 0.85 2024-07-24T16:23:11.812 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd full ratio = 0.9 2024-07-24T16:23:11.812 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd nearfull ratio = 0.8 2024-07-24T16:23:11.812 INFO:teuthology.orchestra.run.smithi193.stdout: osd failsafe full ratio = 0.95 2024-07-24T16:23:11.812 INFO:teuthology.orchestra.run.smithi193.stdout: osd objectstore = bluestore 2024-07-24T16:23:11.812 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.812 INFO:teuthology.orchestra.run.smithi193.stdout:[mgr] 2024-07-24T16:23:11.812 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-07-24T16:23:11.812 INFO:teuthology.orchestra.run.smithi193.stdout: debug mgr = 20 2024-07-24T16:23:11.813 INFO:teuthology.orchestra.run.smithi193.stdout: debug mon = 20 2024-07-24T16:23:11.813 INFO:teuthology.orchestra.run.smithi193.stdout: debug auth = 20 2024-07-24T16:23:11.813 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min pgs per osd = 4 2024-07-24T16:23:11.813 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min bytes per osd = 10 2024-07-24T16:23:11.813 INFO:teuthology.orchestra.run.smithi193.stdout: mgr/telemetry/nag = false 2024-07-24T16:23:11.813 INFO:teuthology.orchestra.run.smithi193.stdout: debug client = 20 2024-07-24T16:23:11.813 INFO:teuthology.orchestra.run.smithi193.stdout: debug finisher = 20 2024-07-24T16:23:11.813 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.813 INFO:teuthology.orchestra.run.smithi193.stdout:[mon] 2024-07-24T16:23:11.813 INFO:teuthology.orchestra.run.smithi193.stdout: debug ms = 1 2024-07-24T16:23:11.813 INFO:teuthology.orchestra.run.smithi193.stdout: debug mon = 20 2024-07-24T16:23:11.814 INFO:teuthology.orchestra.run.smithi193.stdout: debug paxos = 20 2024-07-24T16:23:11.814 INFO:teuthology.orchestra.run.smithi193.stdout: debug auth = 20 2024-07-24T16:23:11.814 INFO:teuthology.orchestra.run.smithi193.stdout: mon data avail warn = 5 2024-07-24T16:23:11.814 INFO:teuthology.orchestra.run.smithi193.stdout: mon mgr mkfs grace = 240 2024-07-24T16:23:11.814 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min pgs per osd = 4 2024-07-24T16:23:11.814 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd reporter subtree level = osd 2024-07-24T16:23:11.814 INFO:teuthology.orchestra.run.smithi193.stdout: mon osd prime pg temp = true 2024-07-24T16:23:11.814 INFO:teuthology.orchestra.run.smithi193.stdout: mon reweight min bytes per osd = 10 2024-07-24T16:23:11.814 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.814 INFO:teuthology.orchestra.run.smithi193.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-07-24T16:23:11.814 INFO:teuthology.orchestra.run.smithi193.stdout: auth mon ticket ttl = 660 # 11m 2024-07-24T16:23:11.814 INFO:teuthology.orchestra.run.smithi193.stdout: auth service ticket ttl = 240 # 4m 2024-07-24T16:23:11.814 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout: # don't complain about insecure global_id in the test suite 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout: # 1m isn't quite enough 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout: mon_down_mkfs_grace = 2m 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout: mon_warn_on_filestore_osds = false 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout: mon down mkfs grace = 300 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout: 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout:[client] 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout: rgw cache enabled = true 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout: rgw enable ops log = true 2024-07-24T16:23:11.815 INFO:teuthology.orchestra.run.smithi193.stdout: rgw enable usage log = true 2024-07-24T16:23:11.816 INFO:teuthology.orchestra.run.smithi193.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-07-24T16:23:11.816 INFO:teuthology.orchestra.run.smithi193.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-07-24T16:23:11.816 INFO:teuthology.orchestra.run.smithi193.stdout: pid file = "" 2024-07-24T16:23:11.816 INFO:teuthology.orchestra.run.smithi193.stdout:[mon.a] 2024-07-24T16:23:11.816 INFO:teuthology.orchestra.run.smithi193.stdout:[mon.b] 2024-07-24T16:23:11.816 INFO:teuthology.orchestra.run.smithi193.stdout:[mon.c] 2024-07-24T16:23:11.816 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.a] 2024-07-24T16:23:11.816 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.c] 2024-07-24T16:23:11.816 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.b] 2024-07-24T16:23:11.816 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.d] 2024-07-24T16:23:11.817 INFO:tasks.ceph:Creating admin key on mon.a... 2024-07-24T16:23:11.818 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-07-24T16:23:11.912 INFO:tasks.ceph:Copying monmap to all nodes... 2024-07-24T16:23:11.913 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:11.913 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-07-24T16:23:11.928 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:11.928 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-07-24T16:23:11.984 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:23:11.984 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:11.984 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd of=/etc/ceph/ceph.keyring 2024-07-24T16:23:11.984 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-07-24T16:23:12.058 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:12.059 DEBUG:teuthology.orchestra.run.smithi159:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:12.114 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi193.front.sepia.ceph.com 2024-07-24T16:23:12.115 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:12.115 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd of=/etc/ceph/ceph.keyring 2024-07-24T16:23:12.115 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-07-24T16:23:12.150 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:12.150 DEBUG:teuthology.orchestra.run.smithi193:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:12.206 INFO:tasks.ceph:Setting up mon nodes... 2024-07-24T16:23:12.206 INFO:tasks.ceph:Setting up mgr nodes... 2024-07-24T16:23:12.207 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-07-24T16:23:12.258 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-07-24T16:23:12.261 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-07-24T16:23:12.329 INFO:teuthology.orchestra.run.smithi193.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-07-24T16:23:12.332 INFO:tasks.ceph:Setting up mds nodes... 2024-07-24T16:23:12.332 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-07-24T16:23:12.383 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-07-24T16:23:12.385 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-07-24T16:23:12.410 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-07-24T16:23:12.501 INFO:teuthology.orchestra.run.smithi159.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-07-24T16:23:12.503 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-07-24T16:23:12.528 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-07-24T16:23:12.579 INFO:teuthology.orchestra.run.smithi193.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-07-24T16:23:12.582 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-07-24T16:23:12.607 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-07-24T16:23:12.698 INFO:teuthology.orchestra.run.smithi193.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-07-24T16:23:12.700 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-07-24T16:23:12.724 INFO:tasks.ceph_client:Setting up client nodes... 2024-07-24T16:23:12.724 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-07-24T16:23:12.765 INFO:teuthology.orchestra.run.smithi159.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-07-24T16:23:12.778 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-07-24T16:23:12.859 INFO:teuthology.orchestra.run.smithi159.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-07-24T16:23:12.871 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-07-24T16:23:12.912 INFO:teuthology.orchestra.run.smithi193.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-07-24T16:23:12.925 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-07-24T16:23:13.006 INFO:teuthology.orchestra.run.smithi193.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-07-24T16:23:13.019 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-07-24T16:23:13.019 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi159.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi193.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-07-24T16:23:13.019 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-07-24T16:23:13.043 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-07-24T16:23:13.044 INFO:tasks.ceph:role: osd.0 2024-07-24T16:23:13.044 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:23:13.044 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-07-24T16:23:13.116 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-07-24T16:23:13.116 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-24T16:23:13.116 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-24T16:23:13.116 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-24T16:23:13.116 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-24T16:23:13.116 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2024-07-24T16:23:13.117 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-24T16:23:13.117 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-24T16:23:13.117 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-24T16:23:13.117 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-24T16:23:13.624 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2024-07-24T16:23:13.626 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2024-07-24T16:23:13.626 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-07-24T16:23:13.738 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-07-24T16:23:13.769 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-07-24T16:23:13.834 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-07-24T16:23:13.835 INFO:tasks.ceph:role: osd.1 2024-07-24T16:23:13.835 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:23:13.835 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-07-24T16:23:13.907 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-07-24T16:23:13.907 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-24T16:23:13.908 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-24T16:23:13.908 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-24T16:23:13.908 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-24T16:23:13.908 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2024-07-24T16:23:13.908 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-24T16:23:13.908 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-24T16:23:13.908 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-24T16:23:13.908 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-24T16:23:14.377 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2024-07-24T16:23:14.379 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2024-07-24T16:23:14.379 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-07-24T16:23:14.473 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-07-24T16:23:14.502 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-07-24T16:23:14.567 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-07-24T16:23:14.568 INFO:tasks.ceph:role: osd.2 2024-07-24T16:23:14.568 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:23:14.568 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-07-24T16:23:14.639 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-07-24T16:23:14.639 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-24T16:23:14.640 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-24T16:23:14.640 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-24T16:23:14.640 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-24T16:23:14.640 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2024-07-24T16:23:14.640 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-24T16:23:14.640 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-24T16:23:14.640 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-24T16:23:14.640 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-24T16:23:15.126 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2024-07-24T16:23:15.129 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2024-07-24T16:23:15.129 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-07-24T16:23:15.260 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-07-24T16:23:15.289 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-07-24T16:23:15.355 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-07-24T16:23:15.355 INFO:tasks.ceph:role: osd.3 2024-07-24T16:23:15.355 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:23:15.355 DEBUG:teuthology.orchestra.run.smithi159:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-07-24T16:23:15.427 INFO:teuthology.orchestra.run.smithi159.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-07-24T16:23:15.427 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-24T16:23:15.427 INFO:teuthology.orchestra.run.smithi159.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-24T16:23:15.427 INFO:teuthology.orchestra.run.smithi159.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-24T16:23:15.427 INFO:teuthology.orchestra.run.smithi159.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-24T16:23:15.427 INFO:teuthology.orchestra.run.smithi159.stdout: = sunit=0 swidth=0 blks 2024-07-24T16:23:15.427 INFO:teuthology.orchestra.run.smithi159.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-24T16:23:15.427 INFO:teuthology.orchestra.run.smithi159.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-24T16:23:15.428 INFO:teuthology.orchestra.run.smithi159.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-24T16:23:15.428 INFO:teuthology.orchestra.run.smithi159.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-24T16:23:15.971 INFO:teuthology.orchestra.run.smithi159.stdout:Discarding blocks...Done. 2024-07-24T16:23:15.973 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi159.front.sepia.ceph.com -o noatime 2024-07-24T16:23:15.973 DEBUG:teuthology.orchestra.run.smithi159:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-07-24T16:23:16.114 DEBUG:teuthology.orchestra.run.smithi159:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-07-24T16:23:16.146 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:16.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:16.254+0000 7f79f8218640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-07-24T16:23:16.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:16.254+0000 7f79f8218640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-07-24T16:23:16.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:16.254+0000 7f79f8218640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-07-24T16:23:16.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:16.254+0000 7f79f8218640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-07-24T16:23:16.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:16.255+0000 7f79f8218640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-07-24T16:23:16.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:16.255+0000 7f79f8218640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-07-24T16:23:19.111 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-07-24T16:23:19.141 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:19.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:19.231+0000 7f4b3a9dc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-07-24T16:23:19.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:19.232+0000 7f4b3a9dc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-07-24T16:23:19.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:19.232+0000 7f4b3a9dc640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-07-24T16:23:19.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:19.232+0000 7f4b3a9dc640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-07-24T16:23:19.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:19.232+0000 7f4b3a9dc640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-07-24T16:23:19.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:19.232+0000 7f4b3a9dc640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-07-24T16:23:22.092 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-07-24T16:23:22.122 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:22.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:22.209+0000 7faf5d7b1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-07-24T16:23:22.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:22.209+0000 7faf5d7b1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-07-24T16:23:22.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:22.209+0000 7faf5d7b1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-07-24T16:23:22.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:22.209+0000 7faf5d7b1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-07-24T16:23:22.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:22.209+0000 7faf5d7b1640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-07-24T16:23:22.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:22.210+0000 7faf5d7b1640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-07-24T16:23:25.071 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-07-24T16:23:25.101 DEBUG:teuthology.orchestra.run.smithi159:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:25.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:25.191+0000 7f9e1ce18640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-07-24T16:23:25.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:25.192+0000 7f9e1ce18640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-07-24T16:23:25.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:25.192+0000 7f9e1ce18640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-07-24T16:23:25.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:25.192+0000 7f9e1ce18640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-07-24T16:23:25.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:25.192+0000 7f9e1ce18640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-07-24T16:23:25.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:25.192+0000 7f9e1ce18640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-07-24T16:23:28.046 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-07-24T16:23:28.076 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-07-24T16:23:28.106 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-07-24T16:23:28.106 INFO:tasks.ceph:role: osd.4 2024-07-24T16:23:28.106 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi193.front.sepia.ceph.com 2024-07-24T16:23:28.106 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-07-24T16:23:28.182 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-07-24T16:23:28.182 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-24T16:23:28.182 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-24T16:23:28.182 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-24T16:23:28.182 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-24T16:23:28.182 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-07-24T16:23:28.182 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-24T16:23:28.182 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-24T16:23:28.182 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-24T16:23:28.182 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-24T16:23:28.684 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-07-24T16:23:28.686 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-07-24T16:23:28.686 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-07-24T16:23:28.807 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-07-24T16:23:28.840 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-07-24T16:23:28.907 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-07-24T16:23:28.907 INFO:tasks.ceph:role: osd.5 2024-07-24T16:23:28.907 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi193.front.sepia.ceph.com 2024-07-24T16:23:28.907 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-07-24T16:23:28.983 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-07-24T16:23:28.983 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-24T16:23:28.983 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-24T16:23:28.983 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-24T16:23:28.984 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-24T16:23:28.984 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-07-24T16:23:28.984 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-24T16:23:28.984 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-24T16:23:28.984 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-24T16:23:28.984 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-24T16:23:29.445 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-07-24T16:23:29.447 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-07-24T16:23:29.447 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-07-24T16:23:29.538 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-07-24T16:23:29.567 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-07-24T16:23:29.631 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-07-24T16:23:29.632 INFO:tasks.ceph:role: osd.6 2024-07-24T16:23:29.632 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi193.front.sepia.ceph.com 2024-07-24T16:23:29.632 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-07-24T16:23:29.703 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-07-24T16:23:29.703 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-24T16:23:29.703 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-24T16:23:29.704 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-24T16:23:29.704 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-24T16:23:29.704 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-07-24T16:23:29.704 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-24T16:23:29.704 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-24T16:23:29.704 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-24T16:23:29.704 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-24T16:23:30.193 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-07-24T16:23:30.196 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-07-24T16:23:30.196 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-07-24T16:23:30.333 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-07-24T16:23:30.363 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-07-24T16:23:30.429 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-07-24T16:23:30.430 INFO:tasks.ceph:role: osd.7 2024-07-24T16:23:30.430 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi193.front.sepia.ceph.com 2024-07-24T16:23:30.430 DEBUG:teuthology.orchestra.run.smithi193:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-07-24T16:23:30.503 INFO:teuthology.orchestra.run.smithi193.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-07-24T16:23:30.503 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 attr=2, projid32bit=1 2024-07-24T16:23:30.503 INFO:teuthology.orchestra.run.smithi193.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-07-24T16:23:30.503 INFO:teuthology.orchestra.run.smithi193.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-07-24T16:23:30.503 INFO:teuthology.orchestra.run.smithi193.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-07-24T16:23:30.503 INFO:teuthology.orchestra.run.smithi193.stdout: = sunit=0 swidth=0 blks 2024-07-24T16:23:30.503 INFO:teuthology.orchestra.run.smithi193.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-07-24T16:23:30.503 INFO:teuthology.orchestra.run.smithi193.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-07-24T16:23:30.503 INFO:teuthology.orchestra.run.smithi193.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-07-24T16:23:30.503 INFO:teuthology.orchestra.run.smithi193.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-07-24T16:23:31.020 INFO:teuthology.orchestra.run.smithi193.stdout:Discarding blocks...Done. 2024-07-24T16:23:31.022 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi193.front.sepia.ceph.com -o noatime 2024-07-24T16:23:31.022 DEBUG:teuthology.orchestra.run.smithi193:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-07-24T16:23:31.139 DEBUG:teuthology.orchestra.run.smithi193:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-07-24T16:23:31.168 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:31.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:31.281+0000 7f0029e5d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-07-24T16:23:31.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:31.281+0000 7f0029e5d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-07-24T16:23:31.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:31.281+0000 7f0029e5d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-07-24T16:23:31.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:31.281+0000 7f0029e5d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-07-24T16:23:31.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:31.281+0000 7f0029e5d640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-07-24T16:23:31.284 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:31.282+0000 7f0029e5d640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-07-24T16:23:34.131 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-07-24T16:23:34.160 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:34.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:34.247+0000 7fae586ec640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-07-24T16:23:34.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:34.247+0000 7fae586ec640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-07-24T16:23:34.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:34.247+0000 7fae586ec640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-07-24T16:23:34.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:34.247+0000 7fae586ec640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-07-24T16:23:34.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:34.247+0000 7fae586ec640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-07-24T16:23:34.250 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:34.248+0000 7fae586ec640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-07-24T16:23:37.096 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-07-24T16:23:37.122 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:37.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:37.206+0000 7fb74e20d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-07-24T16:23:37.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:37.206+0000 7fb74e20d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-07-24T16:23:37.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:37.206+0000 7fb74e20d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-07-24T16:23:37.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:37.206+0000 7fb74e20d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-07-24T16:23:37.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:37.206+0000 7fb74e20d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-07-24T16:23:37.209 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:37.207+0000 7fb74e20d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-07-24T16:23:39.854 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:23:39.857 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:23:40.081 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-07-24T16:23:40.106 DEBUG:teuthology.orchestra.run.smithi193:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:40.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:40.188+0000 7f6199333640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-07-24T16:23:40.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:40.189+0000 7f6199333640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-07-24T16:23:40.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:40.189+0000 7f6199333640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-07-24T16:23:40.191 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:40.189+0000 7f6199333640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-07-24T16:23:40.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:40.189+0000 7f6199333640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-07-24T16:23:40.192 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:40.189+0000 7f6199333640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-07-24T16:23:43.032 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-07-24T16:23:43.058 INFO:tasks.ceph:Reading keys from all nodes... 2024-07-24T16:23:43.058 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:43.058 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-07-24T16:23:43.089 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:43.089 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-07-24T16:23:43.158 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:43.158 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-07-24T16:23:43.226 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:43.226 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-07-24T16:23:43.293 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:43.293 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-07-24T16:23:43.360 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:43.360 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-07-24T16:23:43.427 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:43.427 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-07-24T16:23:43.493 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:43.493 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-07-24T16:23:43.518 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:43.519 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-07-24T16:23:43.584 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:43.584 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-07-24T16:23:43.649 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:43.649 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-07-24T16:23:43.714 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:43.714 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-07-24T16:23:43.779 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:43.779 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-07-24T16:23:43.843 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:43.843 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-07-24T16:23:43.908 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:43.908 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-07-24T16:23:43.927 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:43.927 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-07-24T16:23:43.984 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:43.984 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-07-24T16:23:43.999 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:43.999 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-07-24T16:23:44.054 INFO:tasks.ceph:Adding keys to all mons... 2024-07-24T16:23:44.054 DEBUG:teuthology.orchestra.run.smithi159:> sudo tee -a /etc/ceph/ceph.keyring 2024-07-24T16:23:44.057 DEBUG:teuthology.orchestra.run.smithi193:> sudo tee -a /etc/ceph/ceph.keyring 2024-07-24T16:23:44.097 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.y] 2024-07-24T16:23:44.098 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBwKqFmKFxUDxAAiFTz+i9lmpUGmYQLBlNfLg== 2024-07-24T16:23:44.098 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.a] 2024-07-24T16:23:44.098 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBwKqFm5KfHFhAAY2Za2E4Gx30qtxlasNyN8A== 2024-07-24T16:23:44.098 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.c] 2024-07-24T16:23:44.098 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBwKqFmEsnMHRAAb3Hsgjo+OSBszRC2eA4QAw== 2024-07-24T16:23:44.098 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.0] 2024-07-24T16:23:44.098 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB0KqFmKfM9DxAADINqtpam4FeXnyDKqdKo8w== 2024-07-24T16:23:44.098 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.1] 2024-07-24T16:23:44.098 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB3KqFmVrnhDRAAIqQelAm1HZgnifSROfOC3w== 2024-07-24T16:23:44.098 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.2] 2024-07-24T16:23:44.098 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB6KqFm1MyIDBAAduCyQkJJflqiatmZQnFojA== 2024-07-24T16:23:44.098 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.3] 2024-07-24T16:23:44.099 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQB9KqFm+jV/CxAAhB1z7oYLJ5G5A19FyCxzoQ== 2024-07-24T16:23:44.099 INFO:teuthology.orchestra.run.smithi159.stdout:[mgr.x] 2024-07-24T16:23:44.099 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBwKqFm5PSOExAAiVy9cpsNzzUXYeHA2ObdMQ== 2024-07-24T16:23:44.099 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.b] 2024-07-24T16:23:44.099 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBwKqFmDIh+IhAA+PC+rx36kT5DRJA9ME7ZoA== 2024-07-24T16:23:44.099 INFO:teuthology.orchestra.run.smithi159.stdout:[mds.d] 2024-07-24T16:23:44.099 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBwKqFmwVuGKRAAd1JqAKzMFph6sn3NsEKNKQ== 2024-07-24T16:23:44.099 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.4] 2024-07-24T16:23:44.099 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCDKqFmRXzWEBAAcOfwJxUM0QqEhMQZJq2ttQ== 2024-07-24T16:23:44.099 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.5] 2024-07-24T16:23:44.099 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCGKqFmvf7LDhAATDjsR+93NeLyzFgkMtlkIg== 2024-07-24T16:23:44.099 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.6] 2024-07-24T16:23:44.099 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCJKqFm79FbDBAAvQ7mougCMteNRU0ZYhPDtw== 2024-07-24T16:23:44.100 INFO:teuthology.orchestra.run.smithi159.stdout:[osd.7] 2024-07-24T16:23:44.100 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQCMKqFm1kpRCxAAy674XU+yH6FDhRtEA6bQfw== 2024-07-24T16:23:44.100 INFO:teuthology.orchestra.run.smithi159.stdout:[client.0] 2024-07-24T16:23:44.100 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBwKqFmSByWLRAAlc1hHDXFceGP9BYk8GpZJA== 2024-07-24T16:23:44.100 INFO:teuthology.orchestra.run.smithi159.stdout:[client.2] 2024-07-24T16:23:44.100 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBwKqFma6ElMxAAkFEc8XeYlEJfuiT5W/bnig== 2024-07-24T16:23:44.100 INFO:teuthology.orchestra.run.smithi159.stdout:[client.1] 2024-07-24T16:23:44.100 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBwKqFmLnZUNhAADbBfaqZTiBxwXvsI/8Oetw== 2024-07-24T16:23:44.100 INFO:teuthology.orchestra.run.smithi159.stdout:[client.3] 2024-07-24T16:23:44.100 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBxKqFmWh5PABAAZbCzsIQ1u3ryno6wsxLHaw== 2024-07-24T16:23:44.117 INFO:teuthology.orchestra.run.smithi193.stdout:[mgr.y] 2024-07-24T16:23:44.117 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBwKqFmKFxUDxAAiFTz+i9lmpUGmYQLBlNfLg== 2024-07-24T16:23:44.117 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.a] 2024-07-24T16:23:44.117 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBwKqFm5KfHFhAAY2Za2E4Gx30qtxlasNyN8A== 2024-07-24T16:23:44.117 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.c] 2024-07-24T16:23:44.117 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBwKqFmEsnMHRAAb3Hsgjo+OSBszRC2eA4QAw== 2024-07-24T16:23:44.117 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.0] 2024-07-24T16:23:44.117 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQB0KqFmKfM9DxAADINqtpam4FeXnyDKqdKo8w== 2024-07-24T16:23:44.117 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.1] 2024-07-24T16:23:44.118 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQB3KqFmVrnhDRAAIqQelAm1HZgnifSROfOC3w== 2024-07-24T16:23:44.118 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.2] 2024-07-24T16:23:44.118 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQB6KqFm1MyIDBAAduCyQkJJflqiatmZQnFojA== 2024-07-24T16:23:44.118 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.3] 2024-07-24T16:23:44.118 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQB9KqFm+jV/CxAAhB1z7oYLJ5G5A19FyCxzoQ== 2024-07-24T16:23:44.118 INFO:teuthology.orchestra.run.smithi193.stdout:[mgr.x] 2024-07-24T16:23:44.118 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBwKqFm5PSOExAAiVy9cpsNzzUXYeHA2ObdMQ== 2024-07-24T16:23:44.118 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.b] 2024-07-24T16:23:44.118 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBwKqFmDIh+IhAA+PC+rx36kT5DRJA9ME7ZoA== 2024-07-24T16:23:44.118 INFO:teuthology.orchestra.run.smithi193.stdout:[mds.d] 2024-07-24T16:23:44.118 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBwKqFmwVuGKRAAd1JqAKzMFph6sn3NsEKNKQ== 2024-07-24T16:23:44.118 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.4] 2024-07-24T16:23:44.118 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQCDKqFmRXzWEBAAcOfwJxUM0QqEhMQZJq2ttQ== 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.5] 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQCGKqFmvf7LDhAATDjsR+93NeLyzFgkMtlkIg== 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.6] 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQCJKqFm79FbDBAAvQ7mougCMteNRU0ZYhPDtw== 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout:[osd.7] 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQCMKqFm1kpRCxAAy674XU+yH6FDhRtEA6bQfw== 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout:[client.0] 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBwKqFmSByWLRAAlc1hHDXFceGP9BYk8GpZJA== 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout:[client.2] 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBwKqFma6ElMxAAkFEc8XeYlEJfuiT5W/bnig== 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout:[client.1] 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBwKqFmLnZUNhAADbBfaqZTiBxwXvsI/8Oetw== 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout:[client.3] 2024-07-24T16:23:44.119 INFO:teuthology.orchestra.run.smithi193.stdout: key = AQBxKqFmWh5PABAAZbCzsIQ1u3ryno6wsxLHaw== 2024-07-24T16:23:44.120 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-07-24T16:23:44.144 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-07-24T16:23:44.211 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-24T16:23:44.213 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-24T16:23:44.270 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-24T16:23:44.272 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-24T16:23:44.326 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.329 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.379 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.382 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.433 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.435 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.486 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.488 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.539 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-07-24T16:23:44.542 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-07-24T16:23:44.593 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-24T16:23:44.595 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-24T16:23:44.649 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-24T16:23:44.651 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-07-24T16:23:44.705 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.710 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.761 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.763 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.814 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.816 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.867 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.869 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-07-24T16:23:44.920 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-24T16:23:44.922 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-24T16:23:44.976 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-24T16:23:44.979 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-24T16:23:45.033 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-24T16:23:45.035 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-24T16:23:45.089 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-24T16:23:45.091 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-07-24T16:23:45.145 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-07-24T16:23:45.145 DEBUG:teuthology.orchestra.run.smithi159:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-07-24T16:23:45.170 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-07-24T16:23:45.267 DEBUG:teuthology.orchestra.run.smithi159:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-07-24T16:23:45.291 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-07-24T16:23:45.317 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-07-24T16:23:45.414 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-07-24T16:23:45.438 DEBUG:teuthology.orchestra.run.smithi193:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-07-24T16:23:45.503 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-07-24T16:23:45.599 DEBUG:teuthology.orchestra.run.smithi193:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-07-24T16:23:45.624 DEBUG:teuthology.orchestra.run.smithi159:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:45.626 DEBUG:teuthology.orchestra.run.smithi193:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-07-24T16:23:45.679 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-07-24T16:23:45.679 INFO:tasks.ceph.mon.a:Restarting daemon 2024-07-24T16:23:45.679 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-07-24T16:23:45.682 INFO:tasks.ceph.mon.a:Started 2024-07-24T16:23:45.682 INFO:tasks.ceph.mon.b:Restarting daemon 2024-07-24T16:23:45.683 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-07-24T16:23:45.721 INFO:tasks.ceph.mon.b:Started 2024-07-24T16:23:45.722 INFO:tasks.ceph.mon.c:Restarting daemon 2024-07-24T16:23:45.722 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-07-24T16:23:45.724 INFO:tasks.ceph.mon.c:Started 2024-07-24T16:23:45.724 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-07-24T16:23:45.724 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-07-24T16:23:45.724 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-07-24T16:23:45.726 INFO:tasks.ceph.mgr.y:Started 2024-07-24T16:23:45.727 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-07-24T16:23:45.727 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-07-24T16:23:45.729 INFO:tasks.ceph.mgr.x:Started 2024-07-24T16:23:45.729 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-07-24T16:23:45.729 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-07-24T16:23:45.731 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-07-24T16:23:45.731 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set client debug_client 20 2024-07-24T16:23:45.775 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-07-24T16:23:45.775 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set client debug_ms 1 2024-07-24T16:23:45.818 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-07-24T16:23:45.818 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-07-24T16:23:45.861 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-07-24T16:23:45.861 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-07-24T16:23:45.904 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-07-24T16:23:45.904 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-07-24T16:23:45.948 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-07-24T16:23:45.948 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-07-24T16:23:45.991 INFO:tasks.ceph:setting config [mds] debug_ms = 1 2024-07-24T16:23:45.991 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set mds debug_ms 1 2024-07-24T16:23:46.034 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-07-24T16:23:46.034 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-07-24T16:23:46.078 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-07-24T16:23:46.078 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-07-24T16:23:46.130 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-07-24T16:23:46.130 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-07-24T16:23:46.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.169+0000 7f28b8ee4640 1 -- 172.21.15.159:0/3931442449 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28a00040d0 msgr2=0x7f28b413eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.171 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.169+0000 7f28b8ee4640 1 --2- 172.21.15.159:0/3931442449 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28a00040d0 0x7f28b413eaf0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f28a4010850 tx=0x7f28a4010d10 comp rx=0 tx=0).stop 2024-07-24T16:23:46.173 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-07-24T16:23:46.173 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-07-24T16:23:46.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.169+0000 7f28b8ee4640 1 -- 172.21.15.159:0/3931442449 shutdown_connections 2024-07-24T16:23:46.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.169+0000 7f28b8ee4640 1 --2- 172.21.15.159:0/3931442449 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28b4154fd0 0x7f28b4155450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.169+0000 7f28b8ee4640 1 --2- 172.21.15.159:0/3931442449 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28b41500f0 0x7f28b4150570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.169+0000 7f28b8ee4640 1 --2- 172.21.15.159:0/3931442449 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f28a00040d0 0x7f28b413eaf0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.169+0000 7f28b8ee4640 1 -- 172.21.15.159:0/3931442449 >> 172.21.15.159:0/3931442449 conn(0x7f28b4068ca0 msgr2=0x7f28b40b4f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.169+0000 7f28b8ee4640 1 -- 172.21.15.159:0/3931442449 shutdown_connections 2024-07-24T16:23:46.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.170+0000 7f28b8ee4640 1 -- 172.21.15.159:0/3931442449 wait complete. 2024-07-24T16:23:46.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.172+0000 7f1b68d13640 1 -- 172.21.15.159:0/3425807373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b640b52d0 msgr2=0x7f1b641f1bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.172+0000 7f1b68d13640 1 --2- 172.21.15.159:0/3425807373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b640b52d0 0x7f1b641f1bc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1b58005fd0 tx=0x7f1b58003b00 comp rx=0 tx=0).stop 2024-07-24T16:23:46.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.174+0000 7f97da3dd640 1 -- 172.21.15.159:0/3681835158 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97cc054850 msgr2=0x7f97cc054c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.174+0000 7f97da3dd640 1 --2- 172.21.15.159:0/3681835158 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97cc054850 0x7f97cc054c30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f97cc055ef0 tx=0x7f97c402a360 comp rx=0 tx=0).stop 2024-07-24T16:23:46.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.174+0000 7f97da3dd640 1 -- 172.21.15.159:0/3681835158 shutdown_connections 2024-07-24T16:23:46.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.174+0000 7f97da3dd640 1 --2- 172.21.15.159:0/3681835158 >> v2:172.21.15.193:3300/0 conn(0x7f97cc034640 0x7f97cc008b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.174+0000 7f97da3dd640 1 --2- 172.21.15.159:0/3681835158 >> v2:172.21.15.159:3300/0 conn(0x7f97cc034b90 0x7f97cc008630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.174+0000 7f97da3dd640 1 --2- 172.21.15.159:0/3681835158 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97cc054850 0x7f97cc054c30 secure :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f97cc055ef0 tx=0x7f97c402a360 comp rx=0 tx=0).stop 2024-07-24T16:23:46.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.174+0000 7f97da3dd640 1 -- 172.21.15.159:0/3681835158 >> 172.21.15.159:0/3681835158 conn(0x7f97cc01e880 msgr2=0x7f97cc055630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.177+0000 7f97da3dd640 1 -- 172.21.15.159:0/3681835158 shutdown_connections 2024-07-24T16:23:46.182 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-07-24T16:23:46.183 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-07-24T16:23:46.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.181+0000 7f1b68d13640 1 -- 172.21.15.159:0/3425807373 shutdown_connections 2024-07-24T16:23:46.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.181+0000 7f1b68d13640 1 --2- 172.21.15.159:0/3425807373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1b640b5710 0x7f1b641f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.181+0000 7f1b68d13640 1 --2- 172.21.15.159:0/3425807373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1b640b52d0 0x7f1b641f1bc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.181+0000 7f1b68d13640 1 --2- 172.21.15.159:0/3425807373 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1b640b62b0 0x7f1b6415e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.181+0000 7f1b68d13640 1 -- 172.21.15.159:0/3425807373 >> 172.21.15.159:0/3425807373 conn(0x7f1b64072a80 msgr2=0x7f1b640b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.182+0000 7f1b68d13640 1 -- 172.21.15.159:0/3425807373 shutdown_connections 2024-07-24T16:23:46.189 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-07-24T16:23:46.189 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-07-24T16:23:46.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.185+0000 7fb98affd640 1 -- 172.21.15.159:0/3277300770 <== mon.2 v2:172.21.15.193:3301/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fb990010c20 con 0x7fb99c0ab180 2024-07-24T16:23:46.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.185+0000 7fb98affd640 1 -- 172.21.15.159:0/3277300770 <== mon.2 v2:172.21.15.193:3301/0 10 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v4)=0 v4) ==== 123+0+0 (secure 0 0 0) 0x7fb990023390 con 0x7fb99c0ab180 2024-07-24T16:23:46.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.186+0000 7f1b68d13640 1 -- 172.21.15.159:0/3425807373 wait complete. 2024-07-24T16:23:46.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.187+0000 7fe15cff9640 1 -- 172.21.15.159:0/3622460789 <== mon.0 v2:172.21.15.159:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fe148025600 con 0x7fe16013e500 2024-07-24T16:23:46.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.187+0000 7ff70f7fe640 1 -- 172.21.15.159:0/3336961990 <== mon.2 v2:172.21.15.193:3301/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7ff71c004b80 con 0x7ff72815a110 2024-07-24T16:23:46.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.181+0000 7f97da3dd640 1 -- 172.21.15.159:0/3681835158 wait complete. 2024-07-24T16:23:46.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.189+0000 7fb9a0dd0640 1 -- 172.21.15.159:0/3277300770 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb99c0ab180 msgr2=0x7fb99c1f2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.189+0000 7fb9a0dd0640 1 --2- 172.21.15.159:0/3277300770 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb99c0ab180 0x7fb99c1f2120 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb990006630 tx=0x7fb9900039c0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.183+0000 7f97da3dd640 1 Processor -- start 2024-07-24T16:23:46.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.183+0000 7f97da3dd640 1 -- start start 2024-07-24T16:23:46.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.188+0000 7f97da3dd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97cc034640 0x7f97cc0dc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.196 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-07-24T16:23:46.196 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-07-24T16:23:46.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.189+0000 7fb9a0dd0640 1 -- 172.21.15.159:0/3277300770 shutdown_connections 2024-07-24T16:23:46.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.189+0000 7fb9a0dd0640 1 --2- 172.21.15.159:0/3277300770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb99c1f2660 0x7fb99c1eeb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.189+0000 7fb9a0dd0640 1 --2- 172.21.15.159:0/3277300770 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb99c0ab180 0x7fb99c1f2120 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.189+0000 7fb9a0dd0640 1 --2- 172.21.15.159:0/3277300770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb984005210 0x7fb99c15f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.189+0000 7fb9a0dd0640 1 -- 172.21.15.159:0/3277300770 >> 172.21.15.159:0/3277300770 conn(0x7fb99c072a80 msgr2=0x7fb99c0b1270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.190+0000 7fb9a0dd0640 1 -- 172.21.15.159:0/3277300770 shutdown_connections 2024-07-24T16:23:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.190+0000 7fb9a0dd0640 1 -- 172.21.15.159:0/3277300770 wait complete. 2024-07-24T16:23:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.191+0000 7fe16594b640 1 -- 172.21.15.159:0/3622460789 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7fe138005100 con 0x7fe16013e500 2024-07-24T16:23:46.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.190+0000 7fb88e7fc640 1 -- 172.21.15.159:0/2334761718 <== mon.0 v2:172.21.15.159:3300/0 9 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7fb890004dc0 con 0x7fb89815cd80 2024-07-24T16:23:46.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.188+0000 7f97da3dd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97cc034b90 0x7f97cc00bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.188+0000 7f97da3dd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97cc005920 0x7f97cc00c310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.188+0000 7f97da3dd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc0e71b0 con 0x7f97cc034640 2024-07-24T16:23:46.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.188+0000 7f97da3dd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc0e6ed0 con 0x7f97cc005920 2024-07-24T16:23:46.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.188+0000 7f97da3dd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f97cc0e7490 con 0x7f97cc034b90 2024-07-24T16:23:46.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.189+0000 7f97d9bdc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97cc005920 0x7f97cc00c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.189+0000 7f97d9bdc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97cc005920 0x7f97cc00c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:50922/0 (socket says 172.21.15.159:50922) 2024-07-24T16:23:46.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.189+0000 7f97d9bdc640 1 -- 172.21.15.159:0/1733383918 learned_addr learned my addr 172.21.15.159:0/1733383918 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:46.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.190+0000 7f97d9bdc640 1 -- 172.21.15.159:0/1733383918 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97cc034b90 msgr2=0x7f97cc00bdd0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T16:23:46.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.190+0000 7f97d9bdc640 1 --2- 172.21.15.159:0/1733383918 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97cc034b90 0x7f97cc00bdd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.190+0000 7f97d9bdc640 1 -- 172.21.15.159:0/1733383918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97cc034640 msgr2=0x7f97cc0dc1d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:23:46.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.190+0000 7f97d9bdc640 1 --2- 172.21.15.159:0/1733383918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97cc034640 0x7f97cc0dc1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.190+0000 7f97d9bdc640 1 -- 172.21.15.159:0/1733383918 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc0e4580 con 0x7f97cc005920 2024-07-24T16:23:46.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.190+0000 7f97d9bdc640 1 --2- 172.21.15.159:0/1733383918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97cc005920 0x7f97cc00c310 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f97d000d680 tx=0x7f97d000db40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:46.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.191+0000 7f97c9ffb640 1 -- 172.21.15.159:0/1733383918 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0017070 con 0x7f97cc005920 2024-07-24T16:23:46.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.191+0000 7f97da3dd640 1 -- 172.21.15.159:0/1733383918 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97cc0e3f50 con 0x7f97cc005920 2024-07-24T16:23:46.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.191+0000 7f97da3dd640 1 -- 172.21.15.159:0/1733383918 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97cc0e4b00 con 0x7f97cc005920 2024-07-24T16:23:46.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.191+0000 7f97c9ffb640 1 -- 172.21.15.159:0/1733383918 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(3 keys) ==== 79+0+0 (secure 0 0 0) 0x7f97d00052d0 con 0x7f97cc005920 2024-07-24T16:23:46.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.191+0000 7f97c9ffb640 1 -- 172.21.15.159:0/1733383918 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97d0009820 con 0x7f97cc005920 2024-07-24T16:23:46.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.191+0000 7f97c9ffb640 1 -- 172.21.15.159:0/1733383918 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f97d00099c0 con 0x7f97cc005920 2024-07-24T16:23:46.200 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.191+0000 7f97c9ffb640 1 -- 172.21.15.159:0/1733383918 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f97d00105f0 con 0x7f97cc005920 2024-07-24T16:23:46.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.193+0000 7f97da3dd640 1 -- 172.21.15.159:0/1733383918 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97cc0e7770 con 0x7f97cc005920 2024-07-24T16:23:46.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.198+0000 7ff72d1ae640 1 -- 172.21.15.159:0/3336961990 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7ff700005100 con 0x7ff72815a110 2024-07-24T16:23:46.206 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-07-24T16:23:46.206 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-07-24T16:23:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.203+0000 7ff70f7fe640 1 -- 172.21.15.159:0/3336961990 <== mon.2 v2:172.21.15.193:3301/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7ff71c004020 con 0x7ff72815a110 2024-07-24T16:23:46.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.198+0000 7f97c9ffb640 1 -- 172.21.15.159:0/1733383918 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f97d0009df0 con 0x7f97cc005920 2024-07-24T16:23:46.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.207+0000 7fb88e7fc640 1 -- 172.21.15.159:0/2334761718 <== mon.0 v2:172.21.15.159:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fb890004020 con 0x7fb89815cd80 2024-07-24T16:23:46.211 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-07-24T16:23:46.211 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-07-24T16:23:46.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.212+0000 7ff70f7fe640 1 -- 172.21.15.159:0/3336961990 <== mon.2 v2:172.21.15.193:3301/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff71c0043b0 con 0x7ff72815a110 2024-07-24T16:23:46.220 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-07-24T16:23:46.220 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-07-24T16:23:46.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.213+0000 7ff70f7fe640 1 -- 172.21.15.159:0/3336961990 <== mon.2 v2:172.21.15.193:3301/0 12 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7ff71c0036a0 con 0x7ff72815a110 2024-07-24T16:23:46.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.215+0000 7fb88e7fc640 1 -- 172.21.15.159:0/2334761718 <== mon.0 v2:172.21.15.159:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb890004410 con 0x7fb89815cd80 2024-07-24T16:23:46.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.212+0000 7f97c9ffb640 1 -- 172.21.15.159:0/1733383918 <== mon.1 v2:172.21.15.193:3300/0 7 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f97d00047a0 con 0x7f97cc005920 2024-07-24T16:23:46.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.212+0000 7f97c9ffb640 1 -- 172.21.15.159:0/1733383918 <== mon.1 v2:172.21.15.193:3300/0 8 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97d0004aa0 con 0x7f97cc005920 2024-07-24T16:23:46.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.218+0000 7fe15cff9640 1 -- 172.21.15.159:0/3622460789 <== mon.0 v2:172.21.15.159:3300/0 10 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7fe148025830 con 0x7fe16013e500 2024-07-24T16:23:46.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.218+0000 7fe15cff9640 1 -- 172.21.15.159:0/3622460789 <== mon.0 v2:172.21.15.159:3300/0 11 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fe148025be0 con 0x7fe16013e500 2024-07-24T16:23:46.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.218+0000 7fe15cff9640 1 -- 172.21.15.159:0/3622460789 <== mon.0 v2:172.21.15.159:3300/0 12 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe14801b470 con 0x7fe16013e500 2024-07-24T16:23:46.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.220+0000 7fe16594b640 1 -- 172.21.15.159:0/3622460789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe16013e500 msgr2=0x7fe1600c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.220+0000 7fe16594b640 1 --2- 172.21.15.159:0/3622460789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe16013e500 0x7fe1600c7f40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe14800c5e0 tx=0x7fe14800caa0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.222+0000 7fe16594b640 1 -- 172.21.15.159:0/3622460789 shutdown_connections 2024-07-24T16:23:46.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.222+0000 7fe16594b640 1 --2- 172.21.15.159:0/3622460789 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe1600b3e70 0x7fe1600b42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.222+0000 7fe16594b640 1 --2- 172.21.15.159:0/3622460789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe16013e500 0x7fe1600c7f40 secure :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fe14800c5e0 tx=0x7fe14800caa0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.222+0000 7fe16594b640 1 --2- 172.21.15.159:0/3622460789 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe14c0051c0 0x7fe1601f22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.222+0000 7fe16594b640 1 -- 172.21.15.159:0/3622460789 >> 172.21.15.159:0/3622460789 conn(0x7fe160068ca0 msgr2=0x7fe16015cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.225 DEBUG:tasks.ceph:set 18 configs 2024-07-24T16:23:46.225 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.223+0000 7fe16594b640 1 -- 172.21.15.159:0/3622460789 shutdown_connections 2024-07-24T16:23:46.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.224+0000 7ff72d1ae640 1 -- 172.21.15.159:0/3336961990 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff72815a110 msgr2=0x7ff72814fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.224+0000 7ff72d1ae640 1 --2- 172.21.15.159:0/3336961990 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff72815a110 0x7ff72814fdb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00d730 tx=0x7ff71c00dbf0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.224+0000 7ff72d1ae640 1 -- 172.21.15.159:0/3336961990 shutdown_connections 2024-07-24T16:23:46.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.224+0000 7ff72d1ae640 1 --2- 172.21.15.159:0/3336961990 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff72815a4f0 0x7ff7281f3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.224+0000 7ff72d1ae640 1 --2- 172.21.15.159:0/3336961990 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff72815a110 0x7ff72814fdb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.224+0000 7ff72d1ae640 1 --2- 172.21.15.159:0/3336961990 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff72806ec90 0x7ff7281547b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.224+0000 7ff72d1ae640 1 -- 172.21.15.159:0/3336961990 >> 172.21.15.159:0/3336961990 conn(0x7ff72806e1a0 msgr2=0x7ff7280b49f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.224+0000 7ff72d1ae640 1 -- 172.21.15.159:0/3336961990 shutdown_connections 2024-07-24T16:23:46.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.225+0000 7ff72d1ae640 1 -- 172.21.15.159:0/3336961990 wait complete. 2024-07-24T16:23:46.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.226+0000 7fe16594b640 1 -- 172.21.15.159:0/3622460789 wait complete. 2024-07-24T16:23:46.244 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.244 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.247 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.271 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.271 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.270+0000 7fb6e6340640 1 -- 172.21.15.159:0/2199472102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d80e6d80 msgr2=0x7fb6d8036810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.273 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.270+0000 7fb6e6340640 1 --2- 172.21.15.159:0/2199472102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d80e6d80 0x7fb6d8036810 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb6d804b490 tx=0x7fb6d002a250 comp rx=0 tx=0).stop 2024-07-24T16:23:46.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.274+0000 7fb6e6340640 1 -- 172.21.15.159:0/2199472102 shutdown_connections 2024-07-24T16:23:46.280 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.274+0000 7fb6e6340640 1 --2- 172.21.15.159:0/2199472102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d80e6d80 0x7fb6d8036810 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.274+0000 7fb6e6340640 1 --2- 172.21.15.159:0/2199472102 >> v2:172.21.15.159:3300/0 conn(0x7fb6d80e69a0 0x7fb6d8006e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.274+0000 7fb6e6340640 1 -- 172.21.15.159:0/2199472102 >> 172.21.15.159:0/2199472102 conn(0x7fb6d801d760 msgr2=0x7fb6d8054550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.274+0000 7fb6e6340640 1 -- 172.21.15.159:0/2199472102 shutdown_connections 2024-07-24T16:23:46.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.274+0000 7fb6e6340640 1 -- 172.21.15.159:0/2199472102 wait complete. 2024-07-24T16:23:46.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.276+0000 7fb6e6340640 1 Processor -- start 2024-07-24T16:23:46.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.276+0000 7fb6e6340640 1 -- start start 2024-07-24T16:23:46.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.277+0000 7fb6e6340640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6d804eb10 0x7fb6d8189310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.277+0000 7fb6e6340640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6d80e69a0 0x7fb6d80d92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.277+0000 7fb6e6340640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d80e6d80 0x7fb6d81899f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.277+0000 7fb6e6340640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d8055280 con 0x7fb6d80e69a0 2024-07-24T16:23:46.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.277+0000 7fb6e6340640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb6d80e1600 con 0x7fb6d80e6d80 2024-07-24T16:23:46.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.277+0000 7fb6e6340640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb6d8032950 con 0x7fb6d804eb10 2024-07-24T16:23:46.281 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.278+0000 7fb6e4b3d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6d80e69a0 0x7fb6d80d92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.282 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.278+0000 7fb6e4b3d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6d80e69a0 0x7fb6d80d92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58634/0 (socket says 172.21.15.159:58634) 2024-07-24T16:23:46.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.278+0000 7fb6e4b3d640 1 -- 172.21.15.159:0/51284112 learned_addr learned my addr 172.21.15.159:0/51284112 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:46.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.279+0000 7fb6e4b3d640 1 -- 172.21.15.159:0/51284112 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6d804eb10 msgr2=0x7fb6d8189310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:23:46.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.279+0000 7fb6e4b3d640 1 --2- 172.21.15.159:0/51284112 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6d804eb10 0x7fb6d8189310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.279+0000 7fb6e4b3d640 1 -- 172.21.15.159:0/51284112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d80e6d80 msgr2=0x7fb6d81899f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:23:46.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.279+0000 7fb6e4b3d640 1 --2- 172.21.15.159:0/51284112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d80e6d80 0x7fb6d81899f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.279+0000 7fb6e4b3d640 1 -- 172.21.15.159:0/51284112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6d8031d40 con 0x7fb6d80e69a0 2024-07-24T16:23:46.283 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.280+0000 7fb6e4b3d640 1 --2- 172.21.15.159:0/51284112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6d80e69a0 0x7fb6d80d92f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb6e006a950 tx=0x7fb6e0075b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:46.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.284+0000 7fb6d5ffb640 1 -- 172.21.15.159:0/51284112 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e006a0e0 con 0x7fb6d80e69a0 2024-07-24T16:23:46.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.284+0000 7fb6d5ffb640 1 -- 172.21.15.159:0/51284112 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6e008f030 con 0x7fb6d80e69a0 2024-07-24T16:23:46.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.284+0000 7fb6d5ffb640 1 -- 172.21.15.159:0/51284112 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0074e20 con 0x7fb6d80e69a0 2024-07-24T16:23:46.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.284+0000 7fb6e6340640 1 -- 172.21.15.159:0/51284112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6d8032020 con 0x7fb6d80e69a0 2024-07-24T16:23:46.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.284+0000 7fb6e6340640 1 -- 172.21.15.159:0/51284112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6d80325e0 con 0x7fb6d80e69a0 2024-07-24T16:23:46.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.286+0000 7fb6d5ffb640 1 -- 172.21.15.159:0/51284112 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb6e006d6e0 con 0x7fb6d80e69a0 2024-07-24T16:23:46.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.286+0000 7fb6d5ffb640 1 -- 172.21.15.159:0/51284112 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb6e0094ae0 con 0x7fb6d80e69a0 2024-07-24T16:23:46.289 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.287+0000 7fb6c37fe640 1 -- 172.21.15.159:0/51284112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6d80078a0 con 0x7fb6d80e69a0 2024-07-24T16:23:46.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.290+0000 7fb6d5ffb640 1 -- 172.21.15.159:0/51284112 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7fb6d80078a0 con 0x7fb6d80e69a0 2024-07-24T16:23:46.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.322+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/1712385721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f9c15eee0 msgr2=0x7f4f9c161400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.322+0000 7f4fa3eb0640 1 --2- 172.21.15.159:0/1712385721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f9c15eee0 0x7f4f9c161400 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f4f8c005fd0 tx=0x7f4f8c02a4d0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.339+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/1712385721 shutdown_connections 2024-07-24T16:23:46.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.339+0000 7f4fa3eb0640 1 --2- 172.21.15.159:0/1712385721 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f9c15eee0 0x7f4f9c161400 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.339+0000 7f4fa3eb0640 1 --2- 172.21.15.159:0/1712385721 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4f9c06fb40 0x7f4f9c0ae9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.339+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/1712385721 >> 172.21.15.159:0/1712385721 conn(0x7f4f9c06cbc0 msgr2=0x7f4f9c0b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.348+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/1712385721 shutdown_connections 2024-07-24T16:23:46.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.348+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/1712385721 wait complete. 2024-07-24T16:23:46.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.350+0000 7f4fa3eb0640 1 Processor -- start 2024-07-24T16:23:46.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.350+0000 7f4fa3eb0640 1 -- start start 2024-07-24T16:23:46.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.351+0000 7f4fa3eb0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f9c06fb40 0x7f4f9c147ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.351+0000 7f4fa3eb0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4f9c06ff20 0x7f4f9c157900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.351+0000 7f4fa3eb0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f9c15eee0 0x7f4f9c1f98b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.351+0000 7f4fa3eb0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c06e5b0 con 0x7f4f9c06fb40 2024-07-24T16:23:46.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.351+0000 7f4fa3eb0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4f9c162260 con 0x7f4f9c15eee0 2024-07-24T16:23:46.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.351+0000 7f4fa3eb0640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9c06e730 con 0x7f4f9c06ff20 2024-07-24T16:23:46.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.352+0000 7f4fa244d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f9c15eee0 0x7f4f9c1f98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.352+0000 7f4fa244d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f9c15eee0 0x7f4f9c1f98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:50936/0 (socket says 172.21.15.159:50936) 2024-07-24T16:23:46.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.352+0000 7f4fa244d640 1 -- 172.21.15.159:0/2645366791 learned_addr learned my addr 172.21.15.159:0/2645366791 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:46.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.352+0000 7f4fa1c4c640 1 --2- 172.21.15.159:0/2645366791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f9c06fb40 0x7f4f9c147ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.352+0000 7f4fa1c4c640 1 -- 172.21.15.159:0/2645366791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4f9c06ff20 msgr2=0x7f4f9c157900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:23:46.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.352+0000 7f4fa1c4c640 1 --2- 172.21.15.159:0/2645366791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4f9c06ff20 0x7f4f9c157900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.352+0000 7f4fa1c4c640 1 -- 172.21.15.159:0/2645366791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f9c15eee0 msgr2=0x7f4f9c1f98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.352+0000 7f4fa1c4c640 1 --2- 172.21.15.159:0/2645366791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f9c15eee0 0x7f4f9c1f98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.352+0000 7f4fa1c4c640 1 -- 172.21.15.159:0/2645366791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9c153d80 con 0x7f4f9c06fb40 2024-07-24T16:23:46.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.353+0000 7f4fa1c4c640 1 --2- 172.21.15.159:0/2645366791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f9c06fb40 0x7f4f9c147ca0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800ea60 tx=0x7f4f9800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:46.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.356+0000 7f4f927fc640 1 -- 172.21.15.159:0/2645366791 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f9800cc30 con 0x7f4f9c06fb40 2024-07-24T16:23:46.359 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.356+0000 7f4f927fc640 1 -- 172.21.15.159:0/2645366791 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f98032440 con 0x7f4f9c06fb40 2024-07-24T16:23:46.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.356+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/2645366791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9c1481e0 con 0x7f4f9c06fb40 2024-07-24T16:23:46.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.356+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/2645366791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9c14f580 con 0x7f4f9c06fb40 2024-07-24T16:23:46.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.356+0000 7f4f927fc640 1 -- 172.21.15.159:0/2645366791 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f98032850 con 0x7f4f9c06fb40 2024-07-24T16:23:46.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.357+0000 7f4f927fc640 1 -- 172.21.15.159:0/2645366791 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4f980329f0 con 0x7f4f9c06fb40 2024-07-24T16:23:46.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.357+0000 7f4f927fc640 1 -- 172.21.15.159:0/2645366791 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4f980433f0 con 0x7f4f9c06fb40 2024-07-24T16:23:46.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.365+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/2645366791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f84005290 con 0x7f4f9c06fb40 2024-07-24T16:23:46.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.377+0000 7f4f927fc640 1 -- 172.21.15.159:0/2645366791 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f4f9803ae20 con 0x7f4f9c06fb40 2024-07-24T16:23:46.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.405+0000 7fb89fae4640 1 -- 172.21.15.159:0/2334761718 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7fb880004300 con 0x7fb89815cd80 2024-07-24T16:23:46.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.419+0000 7fb88e7fc640 1 -- 172.21.15.159:0/2334761718 <== mon.0 v2:172.21.15.159:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7fb890005690 con 0x7fb89815cd80 2024-07-24T16:23:46.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.420+0000 7ff8a8209640 1 -- 172.21.15.159:0/87392611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8980377c0 msgr2=0x7ff8980369f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.420+0000 7ff8a8209640 1 --2- 172.21.15.159:0/87392611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8980377c0 0x7ff8980369f0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7ff8a007a1b0 tx=0x7ff8a00a5420 comp rx=0 tx=0).stop 2024-07-24T16:23:46.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.421+0000 7ff8a8209640 1 -- 172.21.15.159:0/87392611 shutdown_connections 2024-07-24T16:23:46.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.421+0000 7ff8a8209640 1 --2- 172.21.15.159:0/87392611 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8980377c0 0x7ff8980369f0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.421+0000 7ff8a8209640 1 -- 172.21.15.159:0/87392611 >> 172.21.15.159:0/87392611 conn(0x7ff89801e880 msgr2=0x7ff898055630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.421+0000 7fb89fae4640 1 -- 172.21.15.159:0/2334761718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb89815cd80 msgr2=0x7fb8980b0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.421+0000 7fb89fae4640 1 --2- 172.21.15.159:0/2334761718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb89815cd80 0x7fb8980b0200 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb89000dcf0 tx=0x7fb89000b630 comp rx=0 tx=0).stop 2024-07-24T16:23:46.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.421+0000 7fb89fae4640 1 -- 172.21.15.159:0/2334761718 shutdown_connections 2024-07-24T16:23:46.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.421+0000 7fb89fae4640 1 --2- 172.21.15.159:0/2334761718 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb898155150 0x7fb898157b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.421+0000 7fb89fae4640 1 --2- 172.21.15.159:0/2334761718 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb89815d160 0x7fb8982046b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.421+0000 7fb89fae4640 1 --2- 172.21.15.159:0/2334761718 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb89815cd80 0x7fb8980b0200 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.421+0000 7fb89fae4640 1 -- 172.21.15.159:0/2334761718 >> 172.21.15.159:0/2334761718 conn(0x7fb89806e1a0 msgr2=0x7fb8980b2f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.422+0000 7fb89fae4640 1 -- 172.21.15.159:0/2334761718 shutdown_connections 2024-07-24T16:23:46.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.422+0000 7fb89fae4640 1 -- 172.21.15.159:0/2334761718 wait complete. 2024-07-24T16:23:46.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.425+0000 7ff8a8209640 1 -- 172.21.15.159:0/87392611 shutdown_connections 2024-07-24T16:23:46.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.425+0000 7ff8a8209640 1 -- 172.21.15.159:0/87392611 wait complete. 2024-07-24T16:23:46.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.427+0000 7ff8a8209640 1 Processor -- start 2024-07-24T16:23:46.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.427+0000 7ff8a8209640 1 -- start start 2024-07-24T16:23:46.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.429+0000 7ff8a8209640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff898034330 0x7ff8980e1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.430+0000 7ff8a5fa5640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff898034330 0x7ff8980e1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.430+0000 7ff8a5fa5640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff898034330 0x7ff8980e1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:55680/0 (socket says 172.21.15.159:55680) 2024-07-24T16:23:46.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.430+0000 7ff8a5fa5640 1 -- 172.21.15.159:0/3035781026 learned_addr learned my addr 172.21.15.159:0/3035781026 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:46.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.430+0000 7ff8a8209640 1 --2- 172.21.15.159:0/3035781026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8980377c0 0x7ff8980d9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.430+0000 7ff8a8209640 1 --2- 172.21.15.159:0/3035781026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8980e2c10 0x7ff89804cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.430+0000 7ff8a57a4640 1 --2- 172.21.15.159:0/3035781026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8980377c0 0x7ff8980d9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.431+0000 7ff8a67a6640 1 --2- 172.21.15.159:0/3035781026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8980e2c10 0x7ff89804cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.431+0000 7ff8a8209640 1 -- 172.21.15.159:0/3035781026 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff898008570 con 0x7ff8980e2c10 2024-07-24T16:23:46.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.431+0000 7ff8a8209640 1 -- 172.21.15.159:0/3035781026 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff8980083f0 con 0x7ff8980377c0 2024-07-24T16:23:46.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.431+0000 7ff8a8209640 1 -- 172.21.15.159:0/3035781026 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff8980086f0 con 0x7ff898034330 2024-07-24T16:23:46.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.432+0000 7ff8a5fa5640 1 -- 172.21.15.159:0/3035781026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8980377c0 msgr2=0x7ff8980d9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.432+0000 7ff8a5fa5640 1 --2- 172.21.15.159:0/3035781026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8980377c0 0x7ff8980d9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.432+0000 7ff8a5fa5640 1 -- 172.21.15.159:0/3035781026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8980e2c10 msgr2=0x7ff89804cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.432+0000 7ff8a5fa5640 1 --2- 172.21.15.159:0/3035781026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8980e2c10 0x7ff89804cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.432+0000 7ff8a5fa5640 1 -- 172.21.15.159:0/3035781026 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8980da0c0 con 0x7ff898034330 2024-07-24T16:23:46.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.432+0000 7ff8a67a6640 1 --2- 172.21.15.159:0/3035781026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8980e2c10 0x7ff89804cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:23:46.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.432+0000 7ff8a5fa5640 1 --2- 172.21.15.159:0/3035781026 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff898034330 0x7ff8980e1d90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0095f0 tx=0x7ff89c009ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:46.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.433+0000 7ff8967fc640 1 -- 172.21.15.159:0/3035781026 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c01b070 con 0x7ff898034330 2024-07-24T16:23:46.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.433+0000 7ff8a8209640 1 -- 172.21.15.159:0/3035781026 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8980daaf0 con 0x7ff898034330 2024-07-24T16:23:46.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.433+0000 7ff8a8209640 1 -- 172.21.15.159:0/3035781026 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8980db0b0 con 0x7ff898034330 2024-07-24T16:23:46.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.433+0000 7ff8967fc640 1 -- 172.21.15.159:0/3035781026 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff89c00eb60 con 0x7ff898034330 2024-07-24T16:23:46.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.433+0000 7ff8967fc640 1 -- 172.21.15.159:0/3035781026 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89c016440 con 0x7ff898034330 2024-07-24T16:23:46.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.434+0000 7ff8967fc640 1 -- 172.21.15.159:0/3035781026 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff89c01e070 con 0x7ff898034330 2024-07-24T16:23:46.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.434+0000 7ff8967fc640 1 -- 172.21.15.159:0/3035781026 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff89c020c60 con 0x7ff898034330 2024-07-24T16:23:46.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.435+0000 7f5602c29640 1 -- 172.21.15.159:0/1945540223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f404eb10 msgr2=0x7f55f4036100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.435+0000 7f5602c29640 1 --2- 172.21.15.159:0/1945540223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f404eb10 0x7f55f4036100 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f55f4035df0 tx=0x7f55fc0a54d0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.435+0000 7f5602c29640 1 -- 172.21.15.159:0/1945540223 shutdown_connections 2024-07-24T16:23:46.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.435+0000 7f5602c29640 1 --2- 172.21.15.159:0/1945540223 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55f40e6d80 0x7f55f4036640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.435+0000 7f5602c29640 1 --2- 172.21.15.159:0/1945540223 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f404eb10 0x7f55f4036100 secure :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f55f4035df0 tx=0x7f55fc0a54d0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.435+0000 7f5602c29640 1 -- 172.21.15.159:0/1945540223 >> 172.21.15.159:0/1945540223 conn(0x7f55f401d760 msgr2=0x7f55f4054550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.435+0000 7ff8a8209640 1 -- 172.21.15.159:0/3035781026 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff888005290 con 0x7ff898034330 2024-07-24T16:23:46.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.441+0000 7f5602c29640 1 -- 172.21.15.159:0/1945540223 shutdown_connections 2024-07-24T16:23:46.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.438+0000 7ff8967fc640 1 -- 172.21.15.159:0/3035781026 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7ff89c020440 con 0x7ff898034330 2024-07-24T16:23:46.457 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.442+0000 7f5602c29640 1 -- 172.21.15.159:0/1945540223 wait complete. 2024-07-24T16:23:46.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.443+0000 7f5602c29640 1 Processor -- start 2024-07-24T16:23:46.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.444+0000 7f5602c29640 1 -- start start 2024-07-24T16:23:46.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.445+0000 7f5602c29640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f40e69a0 0x7f55f4053350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.447+0000 7f5601c27640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f40e69a0 0x7f55f4053350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.448+0000 7f5601c27640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f40e69a0 0x7f55f4053350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58694/0 (socket says 172.21.15.159:58694) 2024-07-24T16:23:46.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.448+0000 7f5601c27640 1 -- 172.21.15.159:0/3290162169 learned_addr learned my addr 172.21.15.159:0/3290162169 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:46.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.448+0000 7f5602c29640 1 --2- 172.21.15.159:0/3290162169 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55f40e6d80 0x7f55f40dd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.448+0000 7f5602c29640 1 --2- 172.21.15.159:0/3290162169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55f40df160 0x7f55f40ddd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.448+0000 7f5602c29640 1 -- 172.21.15.159:0/3290162169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f55f4036f10 con 0x7f55f40e69a0 2024-07-24T16:23:46.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.448+0000 7f5602c29640 1 -- 172.21.15.159:0/3290162169 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f55f4036d90 con 0x7f55f40df160 2024-07-24T16:23:46.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.448+0000 7f5602c29640 1 -- 172.21.15.159:0/3290162169 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f55f40553b0 con 0x7f55f40e6d80 2024-07-24T16:23:46.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.449+0000 7f5602428640 1 --2- 172.21.15.159:0/3290162169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55f40df160 0x7f55f40ddd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.450+0000 7f5601c27640 1 -- 172.21.15.159:0/3290162169 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55f40e6d80 msgr2=0x7f55f40dd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.450+0000 7f5601c27640 1 --2- 172.21.15.159:0/3290162169 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55f40e6d80 0x7f55f40dd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.450+0000 7f5601c27640 1 -- 172.21.15.159:0/3290162169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55f40df160 msgr2=0x7f55f40ddd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.450+0000 7f5601c27640 1 --2- 172.21.15.159:0/3290162169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55f40df160 0x7f55f40ddd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.450+0000 7f5601c27640 1 -- 172.21.15.159:0/3290162169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f40d2940 con 0x7f55f40e69a0 2024-07-24T16:23:46.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.452+0000 7f5601c27640 1 --2- 172.21.15.159:0/3290162169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f40e69a0 0x7f55f4053350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f55f800b780 tx=0x7f55f800bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:46.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.453+0000 7f55f27fc640 1 -- 172.21.15.159:0/3290162169 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8005bc0 con 0x7f55f40e69a0 2024-07-24T16:23:46.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.453+0000 7f55f27fc640 1 -- 172.21.15.159:0/3290162169 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f55f8006020 con 0x7f55f40e69a0 2024-07-24T16:23:46.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.454+0000 7f55f27fc640 1 -- 172.21.15.159:0/3290162169 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55f8006470 con 0x7f55f40e69a0 2024-07-24T16:23:46.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.454+0000 7f5602c29640 1 -- 172.21.15.159:0/3290162169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55f40d2380 con 0x7f55f40e69a0 2024-07-24T16:23:46.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.455+0000 7f55f27fc640 1 -- 172.21.15.159:0/3290162169 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f55f801b020 con 0x7f55f40e69a0 2024-07-24T16:23:46.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.455+0000 7f5602c29640 1 -- 172.21.15.159:0/3290162169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55f4047c90 con 0x7f55f40e69a0 2024-07-24T16:23:46.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.455+0000 7f55f27fc640 1 -- 172.21.15.159:0/3290162169 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f55f8003aa0 con 0x7f55f40e69a0 2024-07-24T16:23:46.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.458+0000 7f55dffff640 1 -- 172.21.15.159:0/3290162169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55d8005290 con 0x7f55f40e69a0 2024-07-24T16:23:46.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.460+0000 7fb6c37fe640 1 -- 172.21.15.159:0/51284112 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fb6d8006e40 con 0x7fb6d80e69a0 2024-07-24T16:23:46.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.462+0000 7f55f27fc640 1 -- 172.21.15.159:0/3290162169 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f55f8022070 con 0x7f55f40e69a0 2024-07-24T16:23:46.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.473+0000 7fb6d5ffb640 1 -- 172.21.15.159:0/51284112 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v8)=0 v8) ==== 106+0+0 (secure 0 0 0) 0x7fb6e0094ce0 con 0x7fb6d80e69a0 2024-07-24T16:23:46.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.488+0000 7fb6c37fe640 1 -- 172.21.15.159:0/51284112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6d80e69a0 msgr2=0x7fb6d80d92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.488+0000 7fb6c37fe640 1 --2- 172.21.15.159:0/51284112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6d80e69a0 0x7fb6d80d92f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb6e006a950 tx=0x7fb6e0075b10 comp rx=0 tx=0).stop 2024-07-24T16:23:46.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.488+0000 7fb6c37fe640 1 -- 172.21.15.159:0/51284112 shutdown_connections 2024-07-24T16:23:46.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.488+0000 7fb6c37fe640 1 --2- 172.21.15.159:0/51284112 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb6d80e6d80 0x7fb6d81899f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.488+0000 7fb6c37fe640 1 --2- 172.21.15.159:0/51284112 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb6d80e69a0 0x7fb6d80d92f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.488+0000 7fb6c37fe640 1 --2- 172.21.15.159:0/51284112 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb6d804eb10 0x7fb6d8189310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.488+0000 7fb6c37fe640 1 -- 172.21.15.159:0/51284112 >> 172.21.15.159:0/51284112 conn(0x7fb6d801d760 msgr2=0x7fb6d80e1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.490+0000 7fb6c37fe640 1 -- 172.21.15.159:0/51284112 shutdown_connections 2024-07-24T16:23:46.495 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.490+0000 7fb6c37fe640 1 -- 172.21.15.159:0/51284112 wait complete. 2024-07-24T16:23:46.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.497+0000 7f97da3dd640 1 -- 172.21.15.159:0/1733383918 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f97cc0dd0b0 con 0x7f97cc005920 2024-07-24T16:23:46.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.500+0000 7f1e3518b640 1 -- 172.21.15.159:0/2637986310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e18004ef0 msgr2=0x7f1e1800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.502 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.500+0000 7f1e3518b640 1 --2- 172.21.15.159:0/2637986310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e18004ef0 0x7f1e1800b9c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1e24001bf0 tx=0x7f1e18005830 comp rx=0 tx=0).stop 2024-07-24T16:23:46.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.501+0000 7f1e2f59e640 1 -- 172.21.15.159:0/2637986310 reap_dead start 2024-07-24T16:23:46.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.502+0000 7f1e3518b640 1 -- 172.21.15.159:0/2637986310 shutdown_connections 2024-07-24T16:23:46.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.502+0000 7f1e3518b640 1 -- 172.21.15.159:0/2637986310 >> 172.21.15.159:0/2637986310 conn(0x7f1e3006c560 msgr2=0x7f1e3006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.503+0000 7f1e3518b640 1 -- 172.21.15.159:0/2637986310 shutdown_connections 2024-07-24T16:23:46.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.504+0000 7f97c9ffb640 1 -- 172.21.15.159:0/1733383918 <== mon.1 v2:172.21.15.193:3300/0 9 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v9)=0 v9) ==== 117+0+0 (secure 0 0 0) 0x7f97d0010840 con 0x7f97cc005920 2024-07-24T16:23:46.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.503+0000 7f1e3518b640 1 -- 172.21.15.159:0/2637986310 wait complete. 2024-07-24T16:23:46.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.505+0000 7f1e3518b640 1 Processor -- start 2024-07-24T16:23:46.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.505+0000 7f1e3518b640 1 -- start start 2024-07-24T16:23:46.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.506+0000 7f1e3518b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e300aa5f0 0x7f1e301fb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.506+0000 7f1e3518b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1e300a9560 0x7f1e300b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.506+0000 7f1e3518b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e300b3cf0 0x7f1e301f8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.506+0000 7f1e3518b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1e30142e20 con 0x7f1e300b3cf0 2024-07-24T16:23:46.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.506+0000 7f1e3518b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1e30142ca0 con 0x7f1e300aa5f0 2024-07-24T16:23:46.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.506+0000 7f1e3518b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1e300745d0 con 0x7f1e300a9560 2024-07-24T16:23:46.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.507+0000 7f1e2f59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e300b3cf0 0x7f1e301f8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.507+0000 7f1e2f59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e300b3cf0 0x7f1e301f8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58710/0 (socket says 172.21.15.159:58710) 2024-07-24T16:23:46.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.507+0000 7f1e2f59e640 1 -- 172.21.15.159:0/3107024101 learned_addr learned my addr 172.21.15.159:0/3107024101 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:46.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.508+0000 7f1e2f59e640 1 -- 172.21.15.159:0/3107024101 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1e300a9560 msgr2=0x7f1e300b37b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:23:46.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.508+0000 7f1e2f59e640 1 --2- 172.21.15.159:0/3107024101 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1e300a9560 0x7f1e300b37b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.508+0000 7f1e2f59e640 1 -- 172.21.15.159:0/3107024101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e300aa5f0 msgr2=0x7f1e301fb990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:23:46.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.508+0000 7f1e2f59e640 1 --2- 172.21.15.159:0/3107024101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e300aa5f0 0x7f1e301fb990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.508+0000 7f1e2f59e640 1 -- 172.21.15.159:0/3107024101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e301fc020 con 0x7f1e300b3cf0 2024-07-24T16:23:46.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.508+0000 7f76a0adb640 1 -- 172.21.15.159:0/2658471925 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f769c0731d0 msgr2=0x7f769c06fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.508+0000 7f76a0adb640 1 --2- 172.21.15.159:0/2658471925 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f769c0731d0 0x7f769c06fd90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f7694005fd0 tx=0x7f769402a870 comp rx=0 tx=0).stop 2024-07-24T16:23:46.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.508+0000 7f76a0adb640 1 -- 172.21.15.159:0/2658471925 shutdown_connections 2024-07-24T16:23:46.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.508+0000 7f76a0adb640 1 --2- 172.21.15.159:0/2658471925 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f769c0731d0 0x7f769c06fd90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.508+0000 7f76a0adb640 1 --2- 172.21.15.159:0/2658471925 >> v2:172.21.15.193:3300/0 conn(0x7f769c06dd80 0x7f769c06f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.511 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.508+0000 7f76a0adb640 1 -- 172.21.15.159:0/2658471925 >> 172.21.15.159:0/2658471925 conn(0x7f769c06cbc0 msgr2=0x7f769c0b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.508+0000 7f1e2f59e640 1 --2- 172.21.15.159:0/3107024101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e300b3cf0 0x7f1e301f8a60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1e24004050 tx=0x7f1e24001700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:46.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.509+0000 7f76a0adb640 1 -- 172.21.15.159:0/2658471925 shutdown_connections 2024-07-24T16:23:46.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.509+0000 7f1e177fe640 1 -- 172.21.15.159:0/3107024101 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e24003bb0 con 0x7f1e300b3cf0 2024-07-24T16:23:46.512 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.509+0000 7f1e177fe640 1 -- 172.21.15.159:0/3107024101 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e24007550 con 0x7f1e300b3cf0 2024-07-24T16:23:46.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.510+0000 7f1e177fe640 1 -- 172.21.15.159:0/3107024101 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e24001bb0 con 0x7f1e300b3cf0 2024-07-24T16:23:46.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.510+0000 7f1e3518b640 1 -- 172.21.15.159:0/3107024101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e301fc300 con 0x7f1e300b3cf0 2024-07-24T16:23:46.513 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.510+0000 7f1e3518b640 1 -- 172.21.15.159:0/3107024101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e300aa9d0 con 0x7f1e300b3cf0 2024-07-24T16:23:46.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.511+0000 7f97da3dd640 1 -- 172.21.15.159:0/1733383918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97cc005920 msgr2=0x7f97cc00c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.511+0000 7f97da3dd640 1 --2- 172.21.15.159:0/1733383918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97cc005920 0x7f97cc00c310 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f97d000d680 tx=0x7f97d000db40 comp rx=0 tx=0).stop 2024-07-24T16:23:46.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.511+0000 7f97da3dd640 1 -- 172.21.15.159:0/1733383918 shutdown_connections 2024-07-24T16:23:46.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.511+0000 7f97da3dd640 1 --2- 172.21.15.159:0/1733383918 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97cc005920 0x7f97cc00c310 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.511+0000 7f97da3dd640 1 --2- 172.21.15.159:0/1733383918 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97cc034b90 0x7f97cc00bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.511+0000 7f97da3dd640 1 --2- 172.21.15.159:0/1733383918 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97cc034640 0x7f97cc0dc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.511+0000 7f97da3dd640 1 -- 172.21.15.159:0/1733383918 >> 172.21.15.159:0/1733383918 conn(0x7f97cc01e880 msgr2=0x7f97cc0502f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.512+0000 7f97da3dd640 1 -- 172.21.15.159:0/1733383918 shutdown_connections 2024-07-24T16:23:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.514+0000 7f97da3dd640 1 -- 172.21.15.159:0/1733383918 wait complete. 2024-07-24T16:23:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.512+0000 7f76a0adb640 1 -- 172.21.15.159:0/2658471925 wait complete. 2024-07-24T16:23:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.514+0000 7f76a0adb640 1 Processor -- start 2024-07-24T16:23:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.514+0000 7f1e157fa640 1 -- 172.21.15.159:0/3107024101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e30160e50 con 0x7f1e300b3cf0 2024-07-24T16:23:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.514+0000 7f1e177fe640 1 -- 172.21.15.159:0/3107024101 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1e240046e0 con 0x7f1e300b3cf0 2024-07-24T16:23:46.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.514+0000 7f1e177fe640 1 -- 172.21.15.159:0/3107024101 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1e2403fbe0 con 0x7f1e300b3cf0 2024-07-24T16:23:46.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.519+0000 7f1e177fe640 1 -- 172.21.15.159:0/3107024101 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f1e2403f440 con 0x7f1e300b3cf0 2024-07-24T16:23:46.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.522+0000 7f76a0adb640 1 -- start start 2024-07-24T16:23:46.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f7a5a760640 1 -- 172.21.15.159:0/3627982220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a4c04fb30 msgr2=0x7f7a4c0e3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f7a5a760640 1 --2- 172.21.15.159:0/3627982220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a4c04fb30 0x7f7a4c0e3910 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7a44005fd0 tx=0x7f7a4402e7b0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f7a5a760640 1 -- 172.21.15.159:0/3627982220 shutdown_connections 2024-07-24T16:23:46.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f7a5a760640 1 --2- 172.21.15.159:0/3627982220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a4c04fb30 0x7f7a4c0e3910 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f7a5a760640 1 -- 172.21.15.159:0/3627982220 >> 172.21.15.159:0/3627982220 conn(0x7f7a4c01d770 msgr2=0x7f7a4c054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.524+0000 7f76a0adb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f769c06dd80 0x7f769c15daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.524+0000 7f76a0adb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f769c0731d0 0x7f769c16c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.524+0000 7f76a0adb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f769c08b990 0x7f769c16cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.524+0000 7f76a0adb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f769c0b3020 con 0x7f769c06dd80 2024-07-24T16:23:46.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.524+0000 7f76a0adb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f769c0b2ea0 con 0x7f769c08b990 2024-07-24T16:23:46.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.524+0000 7f76a0adb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f769c0b31a0 con 0x7f769c0731d0 2024-07-24T16:23:46.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f769ad9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f769c08b990 0x7f769c16cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f769ad9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f769c08b990 0x7f769c16cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:51010/0 (socket says 172.21.15.159:51010) 2024-07-24T16:23:46.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f769ad9d640 1 -- 172.21.15.159:0/2462815753 learned_addr learned my addr 172.21.15.159:0/2462815753 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:46.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f7699d9b640 1 --2- 172.21.15.159:0/2462815753 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f769c0731d0 0x7f769c16c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f769ad9d640 1 -- 172.21.15.159:0/2462815753 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f769c0731d0 msgr2=0x7f769c16c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f769ad9d640 1 --2- 172.21.15.159:0/2462815753 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f769c0731d0 0x7f769c16c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f769ad9d640 1 -- 172.21.15.159:0/2462815753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f769c06dd80 msgr2=0x7f769c15daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f769ad9d640 1 --2- 172.21.15.159:0/2462815753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f769c06dd80 0x7f769c15daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f769ad9d640 1 -- 172.21.15.159:0/2462815753 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f769c205770 con 0x7f769c08b990 2024-07-24T16:23:46.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f7699d9b640 1 --2- 172.21.15.159:0/2462815753 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f769c0731d0 0x7f769c16c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:23:46.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.526+0000 7f769ad9d640 1 --2- 172.21.15.159:0/2462815753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f769c08b990 0x7f769c16cd80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f769400b3d0 tx=0x7f7694032f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:46.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.527+0000 7f768affd640 1 -- 172.21.15.159:0/2462815753 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694041030 con 0x7f769c08b990 2024-07-24T16:23:46.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.528+0000 7f7a5a760640 1 -- 172.21.15.159:0/3627982220 shutdown_connections 2024-07-24T16:23:46.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.528+0000 7f7a5a760640 1 -- 172.21.15.159:0/3627982220 wait complete. 2024-07-24T16:23:46.532 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.527+0000 7f76a0adb640 1 -- 172.21.15.159:0/2462815753 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f769c2081d0 con 0x7f769c08b990 2024-07-24T16:23:46.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.527+0000 7f76a0adb640 1 -- 172.21.15.159:0/2462815753 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f769c15e030 con 0x7f769c08b990 2024-07-24T16:23:46.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.527+0000 7f768affd640 1 -- 172.21.15.159:0/2462815753 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7694037040 con 0x7f769c08b990 2024-07-24T16:23:46.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.527+0000 7f768affd640 1 -- 172.21.15.159:0/2462815753 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7694036070 con 0x7f769c08b990 2024-07-24T16:23:46.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.529+0000 7f768affd640 1 -- 172.21.15.159:0/2462815753 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7694044070 con 0x7f769c08b990 2024-07-24T16:23:46.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.529+0000 7f768affd640 1 -- 172.21.15.159:0/2462815753 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f769403d480 con 0x7f769c08b990 2024-07-24T16:23:46.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.530+0000 7f76a0adb640 1 -- 172.21.15.159:0/2462815753 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7680005290 con 0x7f769c08b990 2024-07-24T16:23:46.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.530+0000 7f7a5a760640 1 Processor -- start 2024-07-24T16:23:46.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.530+0000 7f7a5a760640 1 -- start start 2024-07-24T16:23:46.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.532+0000 7f7a5a760640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a4c039520 0x7f7a4c0df680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.528+0000 7f220759e640 1 -- 172.21.15.159:0/2049545732 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f220004eb10 msgr2=0x7f2200036100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.528+0000 7f220759e640 1 --2- 172.21.15.159:0/2049545732 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f220004eb10 0x7f2200036100 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2200035df0 tx=0x7f22080a54a0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.528+0000 7f220759e640 1 -- 172.21.15.159:0/2049545732 shutdown_connections 2024-07-24T16:23:46.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.528+0000 7f220759e640 1 --2- 172.21.15.159:0/2049545732 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f220004eb10 0x7f2200036100 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.528+0000 7f220759e640 1 --2- 172.21.15.159:0/2049545732 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f22000e69a0 0x7f2200006e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.528+0000 7f220759e640 1 -- 172.21.15.159:0/2049545732 >> 172.21.15.159:0/2049545732 conn(0x7f220001d760 msgr2=0x7f2200054550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.528+0000 7f220759e640 1 -- 172.21.15.159:0/2049545732 shutdown_connections 2024-07-24T16:23:46.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.528+0000 7f220759e640 1 -- 172.21.15.159:0/2049545732 wait complete. 2024-07-24T16:23:46.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.530+0000 7f220759e640 1 Processor -- start 2024-07-24T16:23:46.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.530+0000 7f220759e640 1 -- start start 2024-07-24T16:23:46.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.531+0000 7f220759e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f220004eb10 0x7f22000daa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.532+0000 7f220659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f220004eb10 0x7f22000daa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.532+0000 7f220659c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f220004eb10 0x7f22000daa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58728/0 (socket says 172.21.15.159:58728) 2024-07-24T16:23:46.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.532+0000 7f220659c640 1 -- 172.21.15.159:0/1390889279 learned_addr learned my addr 172.21.15.159:0/1390889279 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:46.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.532+0000 7f220759e640 1 --2- 172.21.15.159:0/1390889279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22000e69a0 0x7f22000c19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.532+0000 7f7a5a760640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a4c039900 0x7f7a4c1750e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.532+0000 7f7a5a760640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a4c04fb30 0x7f7a4c0494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.537 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '1'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.537 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.532+0000 7f220759e640 1 --2- 172.21.15.159:0/1390889279 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f22000e6d80 0x7f22000dfc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.532+0000 7f2205d9b640 1 --2- 172.21.15.159:0/1390889279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22000e69a0 0x7f22000c19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.532+0000 7f220759e640 1 -- 172.21.15.159:0/1390889279 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2200055280 con 0x7f220004eb10 2024-07-24T16:23:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.532+0000 7f220759e640 1 -- 172.21.15.159:0/1390889279 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2200036f40 con 0x7f22000e69a0 2024-07-24T16:23:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.532+0000 7f220759e640 1 -- 172.21.15.159:0/1390889279 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f22000318d0 con 0x7f22000e6d80 2024-07-24T16:23:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.533+0000 7f220659c640 1 -- 172.21.15.159:0/1390889279 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f22000e6d80 msgr2=0x7f22000dfc30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:23:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.533+0000 7f220659c640 1 --2- 172.21.15.159:0/1390889279 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f22000e6d80 0x7f22000dfc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.533+0000 7f220659c640 1 -- 172.21.15.159:0/1390889279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22000e69a0 msgr2=0x7f22000c19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.533+0000 7f220659c640 1 --2- 172.21.15.159:0/1390889279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22000e69a0 0x7f22000c19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.533+0000 7f220659c640 1 -- 172.21.15.159:0/1390889279 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22000315f0 con 0x7f220004eb10 2024-07-24T16:23:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.533+0000 7f220659c640 1 --2- 172.21.15.159:0/1390889279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f220004eb10 0x7f22000daa50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00b750 tx=0x7f21fc00bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f2205d9b640 1 --2- 172.21.15.159:0/1390889279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22000e69a0 0x7f22000c19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:23:46.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f7a59f5f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a4c04fb30 0x7f7a4c0494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f21f6ffd640 1 -- 172.21.15.159:0/1390889279 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc005bc0 con 0x7f220004eb10 2024-07-24T16:23:46.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f7a5975e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a4c039520 0x7f7a4c0df680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f7a5975e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a4c039520 0x7f7a4c0df680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:51038/0 (socket says 172.21.15.159:51038) 2024-07-24T16:23:46.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f7a58f5d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a4c039900 0x7f7a4c1750e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f7a58f5d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a4c039900 0x7f7a4c1750e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:55738/0 (socket says 172.21.15.159:55738) 2024-07-24T16:23:46.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f7a59f5f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a4c04fb30 0x7f7a4c0494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58736/0 (socket says 172.21.15.159:58736) 2024-07-24T16:23:46.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f7a5a760640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c036050 con 0x7f7a4c04fb30 2024-07-24T16:23:46.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f7a5a760640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4c0e4060 con 0x7f7a4c039520 2024-07-24T16:23:46.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f7a5a760640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7a4c0361d0 con 0x7f7a4c039900 2024-07-24T16:23:46.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f220759e640 1 -- 172.21.15.159:0/1390889279 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22000d9f70 con 0x7f220004eb10 2024-07-24T16:23:46.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f220759e640 1 -- 172.21.15.159:0/1390889279 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22000da530 con 0x7f220004eb10 2024-07-24T16:23:46.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.534+0000 7f768affd640 1 -- 172.21.15.159:0/2462815753 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f769404b020 con 0x7f769c08b990 2024-07-24T16:23:46.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.536+0000 7f220759e640 1 -- 172.21.15.159:0/1390889279 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22000db050 con 0x7f220004eb10 2024-07-24T16:23:46.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.540+0000 7f21f6ffd640 1 -- 172.21.15.159:0/1390889279 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21fc006020 con 0x7f220004eb10 2024-07-24T16:23:46.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.540+0000 7f21f6ffd640 1 -- 172.21.15.159:0/1390889279 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21fc006470 con 0x7f220004eb10 2024-07-24T16:23:46.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.540+0000 7f21f6ffd640 1 -- 172.21.15.159:0/1390889279 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f21fc0066d0 con 0x7f220004eb10 2024-07-24T16:23:46.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.540+0000 7f21f6ffd640 1 -- 172.21.15.159:0/1390889279 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f21fc014600 con 0x7f220004eb10 2024-07-24T16:23:46.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.540+0000 7f21f6ffd640 1 -- 172.21.15.159:0/1390889279 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f22000db050 con 0x7f220004eb10 2024-07-24T16:23:46.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.542+0000 7f3166aa6640 1 -- 172.21.15.159:0/2978839050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3158036a80 msgr2=0x7f31581007b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.542+0000 7f3166aa6640 1 --2- 172.21.15.159:0/2978839050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3158036a80 0x7f31581007b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f316006b170 tx=0x7f316009cd70 comp rx=0 tx=0).stop 2024-07-24T16:23:46.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.543+0000 7f7a5975e640 1 -- 172.21.15.159:0/4137926314 learned_addr learned my addr 172.21.15.159:0/4137926314 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:46.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.544+0000 7f7a5975e640 1 -- 172.21.15.159:0/4137926314 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a4c039900 msgr2=0x7f7a4c1750e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.544+0000 7f7a5975e640 1 --2- 172.21.15.159:0/4137926314 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a4c039900 0x7f7a4c1750e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.544+0000 7f7a5975e640 1 -- 172.21.15.159:0/4137926314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a4c04fb30 msgr2=0x7f7a4c0494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.544+0000 7f7a5975e640 1 --2- 172.21.15.159:0/4137926314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a4c04fb30 0x7f7a4c0494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.544+0000 7f7a5975e640 1 -- 172.21.15.159:0/4137926314 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a4c049a10 con 0x7f7a4c039520 2024-07-24T16:23:46.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.545+0000 7f7a58f5d640 1 --2- 172.21.15.159:0/4137926314 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a4c039900 0x7f7a4c1750e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-07-24T16:23:46.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.545+0000 7f7a59f5f640 1 --2- 172.21.15.159:0/4137926314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a4c04fb30 0x7f7a4c0494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-07-24T16:23:46.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.546+0000 7f4ca6139640 1 -- 172.21.15.159:0/2066499362 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4ca00cf7f0 msgr2=0x7f4ca0068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.546+0000 7f4ca6139640 1 --2- 172.21.15.159:0/2066499362 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4ca00cf7f0 0x7f4ca0068ac0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009830 tx=0x7f4c9402a530 comp rx=0 tx=0).stop 2024-07-24T16:23:46.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f7a5975e640 1 --2- 172.21.15.159:0/4137926314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a4c039520 0x7f7a4c0df680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7a54051b40 tx=0x7f7a5406c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:46.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f3166aa6640 1 -- 172.21.15.159:0/2978839050 shutdown_connections 2024-07-24T16:23:46.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f3166aa6640 1 --2- 172.21.15.159:0/2978839050 >> v2:172.21.15.193:3300/0 conn(0x7f31581042e0 0x7f3158104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f3166aa6640 1 --2- 172.21.15.159:0/2978839050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3158036a80 0x7f31581007b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f3166aa6640 1 -- 172.21.15.159:0/2978839050 >> 172.21.15.159:0/2978839050 conn(0x7f315801d770 msgr2=0x7f3158054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f7a49ffb640 1 -- 172.21.15.159:0/4137926314 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a5406a0e0 con 0x7f7a4c039520 2024-07-24T16:23:46.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f7a49ffb640 1 -- 172.21.15.159:0/4137926314 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a5408f030 con 0x7f7a4c039520 2024-07-24T16:23:46.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f7a49ffb640 1 -- 172.21.15.159:0/4137926314 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a54074e20 con 0x7f7a4c039520 2024-07-24T16:23:46.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.549+0000 7f7a5a760640 1 -- 172.21.15.159:0/4137926314 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a4c175850 con 0x7f7a4c039520 2024-07-24T16:23:46.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.549+0000 7f7a5a760640 1 -- 172.21.15.159:0/4137926314 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a4c175e10 con 0x7f7a4c039520 2024-07-24T16:23:46.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.549+0000 7f7a49ffb640 1 -- 172.21.15.159:0/4137926314 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7a5406d6e0 con 0x7f7a4c039520 2024-07-24T16:23:46.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.549+0000 7f7a49ffb640 1 -- 172.21.15.159:0/4137926314 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7a54094760 con 0x7f7a4c039520 2024-07-24T16:23:46.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f4ca6139640 1 -- 172.21.15.159:0/2066499362 shutdown_connections 2024-07-24T16:23:46.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f4ca6139640 1 --2- 172.21.15.159:0/2066499362 >> v2:172.21.15.193:3300/0 conn(0x7f4ca00723c0 0x7f4ca0072850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f4ca6139640 1 --2- 172.21.15.159:0/2066499362 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4ca00cf7f0 0x7f4ca0068ac0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f4ca6139640 1 -- 172.21.15.159:0/2066499362 >> 172.21.15.159:0/2066499362 conn(0x7f4ca006e1a0 msgr2=0x7f4ca006e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f4ca6139640 1 -- 172.21.15.159:0/2066499362 shutdown_connections 2024-07-24T16:23:46.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.547+0000 7f4ca6139640 1 -- 172.21.15.159:0/2066499362 wait complete. 2024-07-24T16:23:46.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.549+0000 7f4ca6139640 1 Processor -- start 2024-07-24T16:23:46.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.549+0000 7f4ca6139640 1 -- start start 2024-07-24T16:23:46.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.550+0000 7f4ca6139640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ca00723c0 0x7f4ca0135230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.550+0000 7f4ca6139640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4ca00cf7f0 0x7f4ca0139270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4ca6139640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ca015adc0 0x7f4ca01432f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4ca6139640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca015b440 con 0x7f4ca00723c0 2024-07-24T16:23:46.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4ca6139640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca015b2c0 con 0x7f4ca015adc0 2024-07-24T16:23:46.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4ca6139640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4ca015b5c0 con 0x7f4ca00cf7f0 2024-07-24T16:23:46.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4c9effd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4ca00cf7f0 0x7f4ca0139270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4c9effd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4ca00cf7f0 0x7f4ca0139270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:55746/0 (socket says 172.21.15.159:55746) 2024-07-24T16:23:46.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4c9effd640 1 -- 172.21.15.159:0/1468422226 learned_addr learned my addr 172.21.15.159:0/1468422226 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:46.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4c9ffff640 1 --2- 172.21.15.159:0/1468422226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ca015adc0 0x7f4ca01432f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4c9effd640 1 -- 172.21.15.159:0/1468422226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ca015adc0 msgr2=0x7f4ca01432f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4c9effd640 1 --2- 172.21.15.159:0/1468422226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ca015adc0 0x7f4ca01432f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4c9effd640 1 -- 172.21.15.159:0/1468422226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ca00723c0 msgr2=0x7f4ca0135230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4c9effd640 1 --2- 172.21.15.159:0/1468422226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ca00723c0 0x7f4ca0135230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4c9effd640 1 -- 172.21.15.159:0/1468422226 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca01358c0 con 0x7f4ca00cf7f0 2024-07-24T16:23:46.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f4c9effd640 1 --2- 172.21.15.159:0/1468422226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4ca00cf7f0 0x7f4ca0139270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009950 tx=0x7f4c94003820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:46.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.553+0000 7f4c87fff640 1 -- 172.21.15.159:0/1468422226 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c94003e20 con 0x7f4ca00cf7f0 2024-07-24T16:23:46.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.553+0000 7f4ca6139640 1 -- 172.21.15.159:0/1468422226 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca0135ba0 con 0x7f4ca00cf7f0 2024-07-24T16:23:46.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.553+0000 7f4ca6139640 1 -- 172.21.15.159:0/1468422226 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca0136160 con 0x7f4ca00cf7f0 2024-07-24T16:23:46.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f4c87fff640 1 -- 172.21.15.159:0/1468422226 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c94005110 con 0x7f4ca00cf7f0 2024-07-24T16:23:46.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f4c87fff640 1 -- 172.21.15.159:0/1468422226 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c94005540 con 0x7f4ca00cf7f0 2024-07-24T16:23:46.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f4c87fff640 1 -- 172.21.15.159:0/1468422226 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4c94039040 con 0x7f4ca00cf7f0 2024-07-24T16:23:46.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f4c87fff640 1 -- 172.21.15.159:0/1468422226 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f4c9403c420 con 0x7f4ca00cf7f0 2024-07-24T16:23:46.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f3166aa6640 1 -- 172.21.15.159:0/2978839050 shutdown_connections 2024-07-24T16:23:46.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.551+0000 7f3166aa6640 1 -- 172.21.15.159:0/2978839050 wait complete. 2024-07-24T16:23:46.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.552+0000 7f3166aa6640 1 Processor -- start 2024-07-24T16:23:46.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.553+0000 7f3166aa6640 1 -- start start 2024-07-24T16:23:46.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f3166aa6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3158036a80 0x7f31580e9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f3166aa6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3158039cc0 0x7f31580f7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f3166aa6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31581042e0 0x7f31580f8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f3166aa6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3158006130 con 0x7f3158039cc0 2024-07-24T16:23:46.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f3166aa6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3158005fb0 con 0x7f31581042e0 2024-07-24T16:23:46.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f3166aa6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f31580062b0 con 0x7f3158036a80 2024-07-24T16:23:46.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f31662a5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31581042e0 0x7f31580f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f31662a5640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31581042e0 0x7f31580f8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:51078/0 (socket says 172.21.15.159:51078) 2024-07-24T16:23:46.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f31662a5640 1 -- 172.21.15.159:0/2356979526 learned_addr learned my addr 172.21.15.159:0/2356979526 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:46.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f3165aa4640 1 --2- 172.21.15.159:0/2356979526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3158036a80 0x7f31580e9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f31662a5640 1 -- 172.21.15.159:0/2356979526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3158036a80 msgr2=0x7f31580e9c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f31662a5640 1 --2- 172.21.15.159:0/2356979526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3158036a80 0x7f31580e9c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f31662a5640 1 -- 172.21.15.159:0/2356979526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3158039cc0 msgr2=0x7f31580f7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f31662a5640 1 --2- 172.21.15.159:0/2356979526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3158039cc0 0x7f31580f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.554+0000 7f31662a5640 1 -- 172.21.15.159:0/2356979526 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31581038c0 con 0x7f31581042e0 2024-07-24T16:23:46.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.555+0000 7f7a5a760640 1 -- 172.21.15.159:0/4137926314 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a4c176050 con 0x7f7a4c039520 2024-07-24T16:23:46.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.557+0000 7fac790e9640 1 -- 172.21.15.159:0/3447638540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac740b2640 msgr2=0x7fac740b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.557+0000 7fac790e9640 1 --2- 172.21.15.159:0/3447638540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac740b2640 0x7fac740b2a90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fac6c005fd0 tx=0x7fac6c03bc20 comp rx=0 tx=0).stop 2024-07-24T16:23:46.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.557+0000 7f31662a5640 1 --2- 172.21.15.159:0/2356979526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31581042e0 0x7f31580f8140 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f315c00a6f0 tx=0x7f315c00abb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:46.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.557+0000 7f4ca6139640 1 -- 172.21.15.159:0/1468422226 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c80005290 con 0x7f4ca00cf7f0 2024-07-24T16:23:46.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.558+0000 7fac790e9640 1 -- 172.21.15.159:0/3447638540 shutdown_connections 2024-07-24T16:23:46.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.558+0000 7fac790e9640 1 --2- 172.21.15.159:0/3447638540 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac740b2640 0x7fac740b2a90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.558+0000 7fac790e9640 1 -- 172.21.15.159:0/3447638540 >> 172.21.15.159:0/3447638540 conn(0x7fac740b0ff0 msgr2=0x7fac740b13d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.560+0000 7f7a49ffb640 1 -- 172.21.15.159:0/4137926314 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f7a4c176050 con 0x7f7a4c039520 2024-07-24T16:23:46.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.558+0000 7fac790e9640 1 -- 172.21.15.159:0/3447638540 shutdown_connections 2024-07-24T16:23:46.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.558+0000 7fac790e9640 1 -- 172.21.15.159:0/3447638540 wait complete. 2024-07-24T16:23:46.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.560+0000 7fac790e9640 1 Processor -- start 2024-07-24T16:23:46.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.560+0000 7fac790e9640 1 -- start start 2024-07-24T16:23:46.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.561+0000 7fac790e9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fac7406dba0 0x7fac741543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.561+0000 7fac790e9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac7406df80 0x7fac74154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.562+0000 7fac790e9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac740b2640 0x7fac74142700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.562+0000 7fac737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac7406df80 0x7fac74154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.562+0000 7fac790e9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fac74145620 con 0x7fac7406df80 2024-07-24T16:23:46.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.562+0000 7fac790e9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fac740b31e0 con 0x7fac740b2640 2024-07-24T16:23:46.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.562+0000 7fac790e9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fac741457a0 con 0x7fac7406dba0 2024-07-24T16:23:46.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.562+0000 7fac737fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac7406df80 0x7fac74154910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58778/0 (socket says 172.21.15.159:58778) 2024-07-24T16:23:46.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.562+0000 7fac737fe640 1 -- 172.21.15.159:0/1110368040 learned_addr learned my addr 172.21.15.159:0/1110368040 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:46.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.562+0000 7fac737fe640 1 -- 172.21.15.159:0/1110368040 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fac7406dba0 msgr2=0x7fac741543d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T16:23:46.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.563+0000 7fac737fe640 1 --2- 172.21.15.159:0/1110368040 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fac7406dba0 0x7fac741543d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.563+0000 7fac737fe640 1 -- 172.21.15.159:0/1110368040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac740b2640 msgr2=0x7fac74142700 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T16:23:46.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.563+0000 7fac737fe640 1 --2- 172.21.15.159:0/1110368040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac740b2640 0x7fac74142700 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.563+0000 7fac737fe640 1 -- 172.21.15.159:0/1110368040 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac74143410 con 0x7fac7406df80 2024-07-24T16:23:46.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.563+0000 7fac737fe640 1 --2- 172.21.15.159:0/1110368040 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac7406df80 0x7fac74154910 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fac6400b450 tx=0x7fac6400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:46.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.564+0000 7fac70ff9640 1 -- 172.21.15.159:0/1110368040 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64015020 con 0x7fac7406df80 2024-07-24T16:23:46.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.564+0000 7fac70ff9640 1 -- 172.21.15.159:0/1110368040 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac64011920 con 0x7fac7406df80 2024-07-24T16:23:46.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.564+0000 7fac70ff9640 1 -- 172.21.15.159:0/1110368040 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac64011d70 con 0x7fac7406df80 2024-07-24T16:23:46.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.564+0000 7fac790e9640 1 -- 172.21.15.159:0/1110368040 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac741436f0 con 0x7fac7406df80 2024-07-24T16:23:46.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.564+0000 7fac790e9640 1 -- 172.21.15.159:0/1110368040 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac74143cb0 con 0x7fac7406df80 2024-07-24T16:23:46.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.565+0000 7fac70ff9640 1 -- 172.21.15.159:0/1110368040 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fac64018020 con 0x7fac7406df80 2024-07-24T16:23:46.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.565+0000 7fac70ff9640 1 -- 172.21.15.159:0/1110368040 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fac64019970 con 0x7fac7406df80 2024-07-24T16:23:46.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.569+0000 7f31567fc640 1 -- 172.21.15.159:0/2356979526 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c007bb0 con 0x7f31581042e0 2024-07-24T16:23:46.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.571+0000 7fac790e9640 1 -- 172.21.15.159:0/1110368040 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac740b2a90 con 0x7fac7406df80 2024-07-24T16:23:46.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.568+0000 7f4c87fff640 1 -- 172.21.15.159:0/1468422226 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f4c94040030 con 0x7f4ca00cf7f0 2024-07-24T16:23:46.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.569+0000 7f3166aa6640 1 -- 172.21.15.159:0/2356979526 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3158103ba0 con 0x7f31581042e0 2024-07-24T16:23:46.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.569+0000 7f3166aa6640 1 -- 172.21.15.159:0/2356979526 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f315811dbc0 con 0x7f31581042e0 2024-07-24T16:23:46.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.574+0000 7f31567fc640 1 -- 172.21.15.159:0/2356979526 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f315c007e40 con 0x7f31581042e0 2024-07-24T16:23:46.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.574+0000 7f31567fc640 1 -- 172.21.15.159:0/2356979526 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f315c005280 con 0x7f31581042e0 2024-07-24T16:23:46.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.574+0000 7f31567fc640 1 -- 172.21.15.159:0/2356979526 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f315c00c050 con 0x7f31581042e0 2024-07-24T16:23:46.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.574+0000 7f31567fc640 1 -- 172.21.15.159:0/2356979526 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f315c00f9f0 con 0x7f31581042e0 2024-07-24T16:23:46.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.578+0000 7f3166aa6640 1 -- 172.21.15.159:0/2356979526 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3148005290 con 0x7f31581042e0 2024-07-24T16:23:46.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.578+0000 7fac70ff9640 1 -- 172.21.15.159:0/1110368040 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7fac6401f020 con 0x7fac7406df80 2024-07-24T16:23:46.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.584+0000 7f31567fc640 1 -- 172.21.15.159:0/2356979526 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f315c013030 con 0x7f31581042e0 2024-07-24T16:23:46.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.591+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/2645366791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f4f84005580 con 0x7f4f9c06fb40 2024-07-24T16:23:46.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.595+0000 7f4f927fc640 1 -- 172.21.15.159:0/2645366791 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7f4f98004020 con 0x7f4f9c06fb40 2024-07-24T16:23:46.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.596+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/2645366791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f9c06fb40 msgr2=0x7f4f9c147ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.597+0000 7f4fa3eb0640 1 --2- 172.21.15.159:0/2645366791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f9c06fb40 0x7f4f9c147ca0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4f9800ea60 tx=0x7f4f9800ef20 comp rx=0 tx=0).stop 2024-07-24T16:23:46.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.597+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/2645366791 shutdown_connections 2024-07-24T16:23:46.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.597+0000 7f4fa3eb0640 1 --2- 172.21.15.159:0/2645366791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f9c15eee0 0x7f4f9c1f98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.597+0000 7f4fa3eb0640 1 --2- 172.21.15.159:0/2645366791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4f9c06ff20 0x7f4f9c157900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.597+0000 7f4fa3eb0640 1 --2- 172.21.15.159:0/2645366791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f9c06fb40 0x7f4f9c147ca0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.597+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/2645366791 >> 172.21.15.159:0/2645366791 conn(0x7f4f9c06cbc0 msgr2=0x7f4f9c14ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.597+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/2645366791 shutdown_connections 2024-07-24T16:23:46.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.597+0000 7f4fa3eb0640 1 -- 172.21.15.159:0/2645366791 wait complete. 2024-07-24T16:23:46.615 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.621+0000 7ff8a8209640 1 -- 172.21.15.159:0/3035781026 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7ff888005580 con 0x7ff898034330 2024-07-24T16:23:46.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.628+0000 7ff8967fc640 1 -- 172.21.15.159:0/3035781026 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v11)=0 v11) ==== 121+0+0 (secure 0 0 0) 0x7ff89c0167a0 con 0x7ff898034330 2024-07-24T16:23:46.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.632+0000 7ff8a8209640 1 -- 172.21.15.159:0/3035781026 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff898034330 msgr2=0x7ff8980e1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.632+0000 7ff8a8209640 1 --2- 172.21.15.159:0/3035781026 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff898034330 0x7ff8980e1d90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff89c0095f0 tx=0x7ff89c009ab0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.632+0000 7ff8a8209640 1 -- 172.21.15.159:0/3035781026 shutdown_connections 2024-07-24T16:23:46.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.632+0000 7ff8a8209640 1 --2- 172.21.15.159:0/3035781026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff8980e2c10 0x7ff89804cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.632+0000 7ff8a8209640 1 --2- 172.21.15.159:0/3035781026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8980377c0 0x7ff8980d9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.632+0000 7ff8a8209640 1 --2- 172.21.15.159:0/3035781026 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff898034330 0x7ff8980e1d90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.632+0000 7ff8a8209640 1 -- 172.21.15.159:0/3035781026 >> 172.21.15.159:0/3035781026 conn(0x7ff89801e880 msgr2=0x7ff89804fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.636+0000 7ff8a8209640 1 -- 172.21.15.159:0/3035781026 shutdown_connections 2024-07-24T16:23:46.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.636+0000 7ff8a8209640 1 -- 172.21.15.159:0/3035781026 wait complete. 2024-07-24T16:23:46.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.660+0000 7f55dffff640 1 -- 172.21.15.159:0/3290162169 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f55d8005580 con 0x7f55f40e69a0 2024-07-24T16:23:46.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.666+0000 7f55f27fc640 1 -- 172.21.15.159:0/3290162169 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f55f800c5e0 con 0x7f55f40e69a0 2024-07-24T16:23:46.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.669+0000 7f55dffff640 1 -- 172.21.15.159:0/3290162169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f40e69a0 msgr2=0x7f55f4053350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.669+0000 7f55dffff640 1 --2- 172.21.15.159:0/3290162169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f40e69a0 0x7f55f4053350 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f55f800b780 tx=0x7f55f800bc40 comp rx=0 tx=0).stop 2024-07-24T16:23:46.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.669+0000 7f55dffff640 1 -- 172.21.15.159:0/3290162169 shutdown_connections 2024-07-24T16:23:46.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.669+0000 7f55dffff640 1 --2- 172.21.15.159:0/3290162169 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f55f40df160 0x7f55f40ddd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.669+0000 7f55dffff640 1 --2- 172.21.15.159:0/3290162169 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55f40e6d80 0x7f55f40dd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.669+0000 7f55dffff640 1 --2- 172.21.15.159:0/3290162169 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55f40e69a0 0x7f55f4053350 secure :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f55f800b780 tx=0x7f55f800bc40 comp rx=0 tx=0).stop 2024-07-24T16:23:46.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.669+0000 7f55dffff640 1 -- 172.21.15.159:0/3290162169 >> 172.21.15.159:0/3290162169 conn(0x7f55f401d760 msgr2=0x7f55f4004a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.670+0000 7f55dffff640 1 -- 172.21.15.159:0/3290162169 shutdown_connections 2024-07-24T16:23:46.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.670+0000 7f55dffff640 1 -- 172.21.15.159:0/3290162169 wait complete. 2024-07-24T16:23:46.696 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.696 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.694+0000 7f1e157fa640 1 -- 172.21.15.159:0/3107024101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f1e30160ad0 con 0x7f1e300b3cf0 2024-07-24T16:23:46.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.700+0000 7f1e177fe640 1 -- 172.21.15.159:0/3107024101 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v13)=0 v13) ==== 125+0+0 (secure 0 0 0) 0x7f1e240049d0 con 0x7f1e300b3cf0 2024-07-24T16:23:46.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.701+0000 7f76a0adb640 1 -- 172.21.15.159:0/2462815753 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f7680005580 con 0x7f769c08b990 2024-07-24T16:23:46.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.702+0000 7f1e157fa640 1 -- 172.21.15.159:0/3107024101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e300b3cf0 msgr2=0x7f1e301f8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.702+0000 7f1e157fa640 1 --2- 172.21.15.159:0/3107024101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e300b3cf0 0x7f1e301f8a60 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1e24004050 tx=0x7f1e24001700 comp rx=0 tx=0).stop 2024-07-24T16:23:46.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.702+0000 7f1e157fa640 1 -- 172.21.15.159:0/3107024101 shutdown_connections 2024-07-24T16:23:46.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.702+0000 7f1e157fa640 1 --2- 172.21.15.159:0/3107024101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1e300b3cf0 0x7f1e301f8a60 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.702+0000 7f1e157fa640 1 --2- 172.21.15.159:0/3107024101 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1e300a9560 0x7f1e300b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.702+0000 7f1e157fa640 1 --2- 172.21.15.159:0/3107024101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1e300aa5f0 0x7f1e301fb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.702+0000 7f1e157fa640 1 -- 172.21.15.159:0/3107024101 >> 172.21.15.159:0/3107024101 conn(0x7f1e3006c560 msgr2=0x7f1e30161650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.702+0000 7f1e157fa640 1 -- 172.21.15.159:0/3107024101 shutdown_connections 2024-07-24T16:23:46.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.702+0000 7f1e157fa640 1 -- 172.21.15.159:0/3107024101 wait complete. 2024-07-24T16:23:46.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.707+0000 7f768affd640 1 -- 172.21.15.159:0/2462815753 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v14)=0 v14) ==== 121+0+0 (secure 0 0 0) 0x7f7694004250 con 0x7f769c08b990 2024-07-24T16:23:46.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.711+0000 7f76a0adb640 1 -- 172.21.15.159:0/2462815753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f769c08b990 msgr2=0x7f769c16cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.711+0000 7f76a0adb640 1 --2- 172.21.15.159:0/2462815753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f769c08b990 0x7f769c16cd80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f769400b3d0 tx=0x7f7694032f50 comp rx=0 tx=0).stop 2024-07-24T16:23:46.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.711+0000 7f76a0adb640 1 -- 172.21.15.159:0/2462815753 shutdown_connections 2024-07-24T16:23:46.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.711+0000 7f76a0adb640 1 --2- 172.21.15.159:0/2462815753 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f769c08b990 0x7f769c16cd80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.711+0000 7f76a0adb640 1 --2- 172.21.15.159:0/2462815753 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f769c0731d0 0x7f769c16c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.711+0000 7f76a0adb640 1 --2- 172.21.15.159:0/2462815753 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f769c06dd80 0x7f769c15daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.711+0000 7f76a0adb640 1 -- 172.21.15.159:0/2462815753 >> 172.21.15.159:0/2462815753 conn(0x7f769c06cbc0 msgr2=0x7f769c0cfdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.711+0000 7f76a0adb640 1 -- 172.21.15.159:0/2462815753 shutdown_connections 2024-07-24T16:23:46.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.711+0000 7f76a0adb640 1 -- 172.21.15.159:0/2462815753 wait complete. 2024-07-24T16:23:46.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.714+0000 7f7a5a760640 1 -- 172.21.15.159:0/4137926314 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f7a4c034850 con 0x7f7a4c039520 2024-07-24T16:23:46.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.720+0000 7f7a49ffb640 1 -- 172.21.15.159:0/4137926314 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v15)=0 v15) ==== 120+0+0 (secure 0 0 0) 0x7f7a5406d9d0 con 0x7f7a4c039520 2024-07-24T16:23:46.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.722+0000 7f7a5a760640 1 -- 172.21.15.159:0/4137926314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a4c039520 msgr2=0x7f7a4c0df680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.722+0000 7f7a5a760640 1 --2- 172.21.15.159:0/4137926314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a4c039520 0x7f7a4c0df680 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f7a54051b40 tx=0x7f7a5406c490 comp rx=0 tx=0).stop 2024-07-24T16:23:46.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.722+0000 7f7a5a760640 1 -- 172.21.15.159:0/4137926314 shutdown_connections 2024-07-24T16:23:46.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.722+0000 7f7a5a760640 1 --2- 172.21.15.159:0/4137926314 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a4c04fb30 0x7f7a4c0494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.722+0000 7f7a5a760640 1 --2- 172.21.15.159:0/4137926314 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a4c039900 0x7f7a4c1750e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.722+0000 7f7a5a760640 1 --2- 172.21.15.159:0/4137926314 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a4c039520 0x7f7a4c0df680 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.722+0000 7f7a5a760640 1 -- 172.21.15.159:0/4137926314 >> 172.21.15.159:0/4137926314 conn(0x7f7a4c01d770 msgr2=0x7f7a4c0e2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.722+0000 7f7a5a760640 1 -- 172.21.15.159:0/4137926314 shutdown_connections 2024-07-24T16:23:46.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.722+0000 7f7a5a760640 1 -- 172.21.15.159:0/4137926314 wait complete. 2024-07-24T16:23:46.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.727+0000 7f3166aa6640 1 -- 172.21.15.159:0/2356979526 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f3148005580 con 0x7f31581042e0 2024-07-24T16:23:46.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.731+0000 7f31567fc640 1 -- 172.21.15.159:0/2356979526 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v16)=0 v16) ==== 121+0+0 (secure 0 0 0) 0x7f315c00f450 con 0x7f31581042e0 2024-07-24T16:23:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.733+0000 7f3166aa6640 1 -- 172.21.15.159:0/2356979526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31581042e0 msgr2=0x7f31580f8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.733+0000 7f3166aa6640 1 --2- 172.21.15.159:0/2356979526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31581042e0 0x7f31580f8140 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f315c00a6f0 tx=0x7f315c00abb0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.733+0000 7f3166aa6640 1 -- 172.21.15.159:0/2356979526 shutdown_connections 2024-07-24T16:23:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.733+0000 7f3166aa6640 1 --2- 172.21.15.159:0/2356979526 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31581042e0 0x7f31580f8140 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.733+0000 7f3166aa6640 1 --2- 172.21.15.159:0/2356979526 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3158039cc0 0x7f31580f7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.733+0000 7f3166aa6640 1 --2- 172.21.15.159:0/2356979526 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3158036a80 0x7f31580e9c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.733+0000 7f3166aa6640 1 -- 172.21.15.159:0/2356979526 >> 172.21.15.159:0/2356979526 conn(0x7f315801d770 msgr2=0x7f315804f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.733+0000 7f3166aa6640 1 -- 172.21.15.159:0/2356979526 shutdown_connections 2024-07-24T16:23:46.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.733+0000 7f3166aa6640 1 -- 172.21.15.159:0/2356979526 wait complete. 2024-07-24T16:23:46.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.737+0000 7f220759e640 1 -- 172.21.15.159:0/1390889279 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f2200006e40 con 0x7f220004eb10 2024-07-24T16:23:46.744 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.742+0000 7f21f6ffd640 1 -- 172.21.15.159:0/1390889279 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v17)=0 v17) ==== 119+0+0 (secure 0 0 0) 0x7f21fc0149c0 con 0x7f220004eb10 2024-07-24T16:23:46.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.743+0000 7f220759e640 1 -- 172.21.15.159:0/1390889279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f220004eb10 msgr2=0x7f22000daa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.743+0000 7f220759e640 1 --2- 172.21.15.159:0/1390889279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f220004eb10 0x7f22000daa50 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f21fc00b750 tx=0x7f21fc00bc10 comp rx=0 tx=0).stop 2024-07-24T16:23:46.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.743+0000 7f220759e640 1 -- 172.21.15.159:0/1390889279 shutdown_connections 2024-07-24T16:23:46.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.743+0000 7f220759e640 1 --2- 172.21.15.159:0/1390889279 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f22000e6d80 0x7f22000dfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.743+0000 7f220759e640 1 --2- 172.21.15.159:0/1390889279 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f22000e69a0 0x7f22000c19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.743+0000 7f220759e640 1 --2- 172.21.15.159:0/1390889279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f220004eb10 0x7f22000daa50 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.743+0000 7f220759e640 1 -- 172.21.15.159:0/1390889279 >> 172.21.15.159:0/1390889279 conn(0x7f220001d760 msgr2=0x7f22000e18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.743+0000 7f220759e640 1 -- 172.21.15.159:0/1390889279 shutdown_connections 2024-07-24T16:23:46.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.743+0000 7f220759e640 1 -- 172.21.15.159:0/1390889279 wait complete. 2024-07-24T16:23:46.756 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.757 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.757 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.764+0000 7f4ca6139640 1 -- 172.21.15.159:0/1468422226 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f4c80005580 con 0x7f4ca00cf7f0 2024-07-24T16:23:46.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.765+0000 7fac790e9640 1 -- 172.21.15.159:0/1110368040 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fac74156240 con 0x7fac7406df80 2024-07-24T16:23:46.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.767+0000 7fac70ff9640 1 -- 172.21.15.159:0/1110368040 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v18)=0 v18) ==== 120+0+0 (secure 0 0 0) 0x7fac64019bc0 con 0x7fac7406df80 2024-07-24T16:23:46.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.768+0000 7fac790e9640 1 -- 172.21.15.159:0/1110368040 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac7406df80 msgr2=0x7fac74154910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.768+0000 7fac790e9640 1 --2- 172.21.15.159:0/1110368040 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac7406df80 0x7fac74154910 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fac6400b450 tx=0x7fac6400b910 comp rx=0 tx=0).stop 2024-07-24T16:23:46.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.768+0000 7fac790e9640 1 -- 172.21.15.159:0/1110368040 shutdown_connections 2024-07-24T16:23:46.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.768+0000 7fac790e9640 1 --2- 172.21.15.159:0/1110368040 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac740b2640 0x7fac74142700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.768+0000 7fac790e9640 1 --2- 172.21.15.159:0/1110368040 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac7406df80 0x7fac74154910 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.768+0000 7fac790e9640 1 --2- 172.21.15.159:0/1110368040 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fac7406dba0 0x7fac741543d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.768+0000 7fac790e9640 1 -- 172.21.15.159:0/1110368040 >> 172.21.15.159:0/1110368040 conn(0x7fac740b0ff0 msgr2=0x7fac7415f930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.768+0000 7fac790e9640 1 -- 172.21.15.159:0/1110368040 shutdown_connections 2024-07-24T16:23:46.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.768+0000 7fac790e9640 1 -- 172.21.15.159:0/1110368040 wait complete. 2024-07-24T16:23:46.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.772+0000 7f4c87fff640 1 -- 172.21.15.159:0/1468422226 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f4c94004c70 con 0x7f4ca00cf7f0 2024-07-24T16:23:46.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.773+0000 7f4ca6139640 1 -- 172.21.15.159:0/1468422226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4ca00cf7f0 msgr2=0x7f4ca0139270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.773+0000 7f4ca6139640 1 --2- 172.21.15.159:0/1468422226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4ca00cf7f0 0x7f4ca0139270 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009950 tx=0x7f4c94003820 comp rx=0 tx=0).stop 2024-07-24T16:23:46.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.773+0000 7f4ca6139640 1 -- 172.21.15.159:0/1468422226 shutdown_connections 2024-07-24T16:23:46.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.773+0000 7f4ca6139640 1 --2- 172.21.15.159:0/1468422226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4ca015adc0 0x7f4ca01432f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.773+0000 7f4ca6139640 1 --2- 172.21.15.159:0/1468422226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4ca00cf7f0 0x7f4ca0139270 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.773+0000 7f4ca6139640 1 --2- 172.21.15.159:0/1468422226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4ca00723c0 0x7f4ca0135230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.773+0000 7f4ca6139640 1 -- 172.21.15.159:0/1468422226 >> 172.21.15.159:0/1468422226 conn(0x7f4ca006e1a0 msgr2=0x7f4ca014e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.774+0000 7f4ca6139640 1 -- 172.21.15.159:0/1468422226 shutdown_connections 2024-07-24T16:23:46.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.774+0000 7f4ca6139640 1 -- 172.21.15.159:0/1468422226 wait complete. 2024-07-24T16:23:46.781 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.782 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.782 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi159') 2024-07-24T16:23:46.787 INFO:tasks.ceph:Setting crush tunables to default 2024-07-24T16:23:46.787 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph osd crush tunables default 2024-07-24T16:23:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.929+0000 7fbe2b631640 1 -- 172.21.15.159:0/2565025155 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe240b62b0 msgr2=0x7fbe2415f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.929+0000 7fbe2b631640 1 --2- 172.21.15.159:0/2565025155 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe240b62b0 0x7fbe2415f0f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fbe20005fd0 tx=0x7fbe2002a540 comp rx=0 tx=0).stop 2024-07-24T16:23:46.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.929+0000 7fbe2b631640 1 -- 172.21.15.159:0/2565025155 shutdown_connections 2024-07-24T16:23:46.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.929+0000 7fbe2b631640 1 --2- 172.21.15.159:0/2565025155 >> v2:172.21.15.193:3300/0 conn(0x7fbe24070fc0 0x7fbe240afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.929+0000 7fbe2b631640 1 --2- 172.21.15.159:0/2565025155 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe240b62b0 0x7fbe2415f0f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.929+0000 7fbe2b631640 1 -- 172.21.15.159:0/2565025155 >> 172.21.15.159:0/2565025155 conn(0x7fbe24072a80 msgr2=0x7fbe24072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:46.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.930+0000 7fbe2b631640 1 -- 172.21.15.159:0/2565025155 shutdown_connections 2024-07-24T16:23:46.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.930+0000 7fbe2b631640 1 -- 172.21.15.159:0/2565025155 wait complete. 2024-07-24T16:23:46.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.931+0000 7fbe2b631640 1 Processor -- start 2024-07-24T16:23:46.933 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.931+0000 7fbe2b631640 1 -- start start 2024-07-24T16:23:46.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.931+0000 7fbe2b631640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe24070fc0 0x7fbe241f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.931+0000 7fbe2b631640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe240b62b0 0x7fbe2415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.931+0000 7fbe2b631640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe2415b490 0x7fbe2415e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:46.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.931+0000 7fbe2b631640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2406c980 con 0x7fbe24070fc0 2024-07-24T16:23:46.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.931+0000 7fbe2b631640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2406c800 con 0x7fbe2415b490 2024-07-24T16:23:46.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.931+0000 7fbe2b631640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbe2406cb00 con 0x7fbe240b62b0 2024-07-24T16:23:46.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe293cd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe24070fc0 0x7fbe241f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe293cd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe24070fc0 0x7fbe241f2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58780/0 (socket says 172.21.15.159:58780) 2024-07-24T16:23:46.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe28bcc640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe240b62b0 0x7fbe2415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe293cd640 1 -- 172.21.15.159:0/747453621 learned_addr learned my addr 172.21.15.159:0/747453621 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:46.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe29bce640 1 --2- 172.21.15.159:0/747453621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe2415b490 0x7fbe2415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:46.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe28bcc640 1 -- 172.21.15.159:0/747453621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe2415b490 msgr2=0x7fbe2415e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe28bcc640 1 --2- 172.21.15.159:0/747453621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe2415b490 0x7fbe2415e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe28bcc640 1 -- 172.21.15.159:0/747453621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe24070fc0 msgr2=0x7fbe241f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:46.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe28bcc640 1 --2- 172.21.15.159:0/747453621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe24070fc0 0x7fbe241f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:46.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe28bcc640 1 -- 172.21.15.159:0/747453621 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2415c780 con 0x7fbe240b62b0 2024-07-24T16:23:46.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe293cd640 1 --2- 172.21.15.159:0/747453621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe24070fc0 0x7fbe241f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:23:46.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe28bcc640 1 --2- 172.21.15.159:0/747453621 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe240b62b0 0x7fbe2415dc30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbe20031000 tx=0x7fbe200038a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:46.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe19ffb640 1 -- 172.21.15.159:0/747453621 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe2003f070 con 0x7fbe240b62b0 2024-07-24T16:23:46.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe19ffb640 1 -- 172.21.15.159:0/747453621 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe200047a0 con 0x7fbe240b62b0 2024-07-24T16:23:46.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe2b631640 1 -- 172.21.15.159:0/747453621 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe2415ca60 con 0x7fbe240b62b0 2024-07-24T16:23:46.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.932+0000 7fbe19ffb640 1 -- 172.21.15.159:0/747453621 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe20035030 con 0x7fbe240b62b0 2024-07-24T16:23:46.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.933+0000 7fbe2b631640 1 -- 172.21.15.159:0/747453621 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe2415d020 con 0x7fbe240b62b0 2024-07-24T16:23:46.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.933+0000 7fbe19ffb640 1 -- 172.21.15.159:0/747453621 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbe20042070 con 0x7fbe240b62b0 2024-07-24T16:23:46.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.933+0000 7fbe19ffb640 1 -- 172.21.15.159:0/747453621 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fbe2003b910 con 0x7fbe240b62b0 2024-07-24T16:23:46.938 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.933+0000 7fbe2b631640 1 -- 172.21.15.159:0/747453621 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe240cede0 con 0x7fbe240b62b0 2024-07-24T16:23:46.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:46.935+0000 7fbe19ffb640 1 -- 172.21.15.159:0/747453621 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7fbe240cede0 con 0x7fbe240b62b0 2024-07-24T16:23:47.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:47.003+0000 7fbe2b631640 1 -- 172.21.15.159:0/747453621 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fbe240afc70 con 0x7fbe240b62b0 2024-07-24T16:23:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:47.008+0000 7fbe19ffb640 1 -- 172.21.15.159:0/747453621 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fbe2003bb60 con 0x7fbe240b62b0 2024-07-24T16:23:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:adjusted tunables profile to default 2024-07-24T16:23:47.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:47.009+0000 7fbe2b631640 1 -- 172.21.15.159:0/747453621 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe240b62b0 msgr2=0x7fbe2415dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:47.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:47.009+0000 7fbe2b631640 1 --2- 172.21.15.159:0/747453621 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe240b62b0 0x7fbe2415dc30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbe20031000 tx=0x7fbe200038a0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:47.009+0000 7fbe2b631640 1 -- 172.21.15.159:0/747453621 shutdown_connections 2024-07-24T16:23:47.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:47.009+0000 7fbe2b631640 1 --2- 172.21.15.159:0/747453621 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe2415b490 0x7fbe2415e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:47.009+0000 7fbe2b631640 1 --2- 172.21.15.159:0/747453621 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe240b62b0 0x7fbe2415dc30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:47.009+0000 7fbe2b631640 1 --2- 172.21.15.159:0/747453621 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe24070fc0 0x7fbe241f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:47.009+0000 7fbe2b631640 1 -- 172.21.15.159:0/747453621 >> 172.21.15.159:0/747453621 conn(0x7fbe24072a80 msgr2=0x7fbe241562d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:47.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:47.009+0000 7fbe2b631640 1 -- 172.21.15.159:0/747453621 shutdown_connections 2024-07-24T16:23:47.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:47.009+0000 7fbe2b631640 1 -- 172.21.15.159:0/747453621 wait complete. 2024-07-24T16:23:47.023 INFO:tasks.ceph:check_enable_crimson: False 2024-07-24T16:23:47.023 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-07-24T16:23:47.023 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:47.023 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-07-24T16:23:47.049 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:47.049 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-07-24T16:23:47.115 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:47.115 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-07-24T16:23:47.181 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:23:47.181 DEBUG:teuthology.orchestra.run.smithi159:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-07-24T16:23:47.247 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:47.248 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-07-24T16:23:47.273 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:47.273 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-07-24T16:23:47.338 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:47.338 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-07-24T16:23:47.403 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:23:47.403 DEBUG:teuthology.orchestra.run.smithi193:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-07-24T16:23:47.468 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new b968801f-08a9-417b-987d-cd15190d1510 0 2024-07-24T16:23:47.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.609+0000 7f8f2f279640 1 -- 172.21.15.193:0/4236517670 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8f2815b3e0 msgr2=0x7f8f2815f9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:47.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.609+0000 7f8f2f279640 1 --2- 172.21.15.193:0/4236517670 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8f2815b3e0 0x7f8f2815f9c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8f24005fd0 tx=0x7f8f2402a530 comp rx=0 tx=0).stop 2024-07-24T16:23:47.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.609+0000 7f8f2f279640 1 -- 172.21.15.193:0/4236517670 shutdown_connections 2024-07-24T16:23:47.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.609+0000 7f8f2f279640 1 --2- 172.21.15.193:0/4236517670 >> v2:172.21.15.159:3300/0 conn(0x7f8f2806cc70 0x7f8f2806eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.609+0000 7f8f2f279640 1 --2- 172.21.15.193:0/4236517670 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8f2815b3e0 0x7f8f2815f9c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.609+0000 7f8f2f279640 1 -- 172.21.15.193:0/4236517670 >> 172.21.15.193:0/4236517670 conn(0x7f8f28071140 msgr2=0x7f8f2806d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:47.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.609+0000 7f8f2f279640 1 -- 172.21.15.193:0/4236517670 shutdown_connections 2024-07-24T16:23:47.612 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.609+0000 7f8f2f279640 1 -- 172.21.15.193:0/4236517670 wait complete. 2024-07-24T16:23:47.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.610+0000 7f8f2f279640 1 Processor -- start 2024-07-24T16:23:47.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.610+0000 7f8f2f279640 1 -- start start 2024-07-24T16:23:47.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2f279640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f2806cc70 0x7f8f28140cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:47.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2f279640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f2815b3e0 0x7f8f2813d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:47.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2f279640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8f281f79f0 0x7f8f281f7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:47.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2f279640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2806f520 con 0x7f8f2815b3e0 2024-07-24T16:23:47.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2f279640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8f2806f3a0 con 0x7f8f2806cc70 2024-07-24T16:23:47.615 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2f279640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8f2806f6a0 con 0x7f8f281f79f0 2024-07-24T16:23:47.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2d816640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8f281f79f0 0x7f8f281f7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:47.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2d015640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f2806cc70 0x7f8f28140cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:47.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2d816640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8f281f79f0 0x7f8f281f7e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.193:54904/0 (socket says 172.21.15.193:54904) 2024-07-24T16:23:47.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2d816640 1 -- 172.21.15.193:0/2153668760 learned_addr learned my addr 172.21.15.193:0/2153668760 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-07-24T16:23:47.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2c814640 1 --2- 172.21.15.193:0/2153668760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f2815b3e0 0x7f8f2813d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:47.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2d816640 1 -- 172.21.15.193:0/2153668760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f2806cc70 msgr2=0x7f8f28140cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:47.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2d816640 1 --2- 172.21.15.193:0/2153668760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f2806cc70 0x7f8f28140cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2d816640 1 -- 172.21.15.193:0/2153668760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f2815b3e0 msgr2=0x7f8f2813d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:47.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2d816640 1 --2- 172.21.15.193:0/2153668760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f2815b3e0 0x7f8f2813d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2d816640 1 -- 172.21.15.193:0/2153668760 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f281f8540 con 0x7f8f281f79f0 2024-07-24T16:23:47.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2d015640 1 --2- 172.21.15.193:0/2153668760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f2806cc70 0x7f8f28140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:23:47.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.611+0000 7f8f2d816640 1 --2- 172.21.15.193:0/2153668760 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8f281f79f0 0x7f8f281f7e80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8f2000ead0 tx=0x7f8f2000ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:47.616 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.612+0000 7f8f1dffb640 1 -- 172.21.15.193:0/2153668760 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2000cde0 con 0x7f8f281f79f0 2024-07-24T16:23:47.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.612+0000 7f8f1dffb640 1 -- 172.21.15.193:0/2153668760 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f20004c10 con 0x7f8f281f79f0 2024-07-24T16:23:47.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.612+0000 7f8f2f279640 1 -- 172.21.15.193:0/2153668760 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f281f8820 con 0x7f8f281f79f0 2024-07-24T16:23:47.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.612+0000 7f8f1dffb640 1 -- 172.21.15.193:0/2153668760 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f20005020 con 0x7f8f281f79f0 2024-07-24T16:23:47.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.612+0000 7f8f1dffb640 1 -- 172.21.15.193:0/2153668760 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8f200051c0 con 0x7f8f281f79f0 2024-07-24T16:23:47.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.612+0000 7f8f2f279640 1 -- 172.21.15.193:0/2153668760 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f281404f0 con 0x7f8f281f79f0 2024-07-24T16:23:47.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.612+0000 7f8f1dffb640 1 -- 172.21.15.193:0/2153668760 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f8f20011ca0 con 0x7f8f281f79f0 2024-07-24T16:23:47.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.613+0000 7f8f2f279640 1 -- 172.21.15.193:0/2153668760 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f2806fb70 con 0x7f8f281f79f0 2024-07-24T16:23:47.617 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.615+0000 7f8f1dffb640 1 -- 172.21.15.193:0/2153668760 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f8f20016030 con 0x7f8f281f79f0 2024-07-24T16:23:47.689 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.687+0000 7f8f2f279640 1 -- 172.21.15.193:0/2153668760 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b968801f-08a9-417b-987d-cd15190d1510", "id": 0} v 0) -- 0x7f8f2806ca30 con 0x7f8f281f79f0 2024-07-24T16:23:47.692 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.690+0000 7f8f1dffb640 1 -- 172.21.15.193:0/2153668760 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b968801f-08a9-417b-987d-cd15190d1510", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f8f20005640 con 0x7f8f281f79f0 2024-07-24T16:23:47.693 INFO:teuthology.orchestra.run.smithi193.stdout:0 2024-07-24T16:23:47.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.691+0000 7f8f2f279640 1 -- 172.21.15.193:0/2153668760 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8f281f79f0 msgr2=0x7f8f281f7e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:47.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.691+0000 7f8f2f279640 1 --2- 172.21.15.193:0/2153668760 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8f281f79f0 0x7f8f281f7e80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8f2000ead0 tx=0x7f8f2000ef90 comp rx=0 tx=0).stop 2024-07-24T16:23:47.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.691+0000 7f8f2f279640 1 -- 172.21.15.193:0/2153668760 shutdown_connections 2024-07-24T16:23:47.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.691+0000 7f8f2f279640 1 --2- 172.21.15.193:0/2153668760 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8f281f79f0 0x7f8f281f7e80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.691+0000 7f8f2f279640 1 --2- 172.21.15.193:0/2153668760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8f2815b3e0 0x7f8f2813d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.691+0000 7f8f2f279640 1 --2- 172.21.15.193:0/2153668760 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8f2806cc70 0x7f8f28140cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.694 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.691+0000 7f8f2f279640 1 -- 172.21.15.193:0/2153668760 >> 172.21.15.193:0/2153668760 conn(0x7f8f28071140 msgr2=0x7f8f280b3890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:47.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.691+0000 7f8f2f279640 1 -- 172.21.15.193:0/2153668760 shutdown_connections 2024-07-24T16:23:47.695 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.691+0000 7f8f2f279640 1 -- 172.21.15.193:0/2153668760 wait complete. 2024-07-24T16:23:47.704 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 7eb2f57d-b24e-49d0-8118-f4cb0332b493 1 2024-07-24T16:23:47.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.804+0000 7f43ab3fa640 1 -- 172.21.15.193:0/4253844233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43a40cf880 msgr2=0x7f43a406c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:47.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.804+0000 7f43ab3fa640 1 --2- 172.21.15.193:0/4253844233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43a40cf880 0x7f43a406c560 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f43a40d0de0 tx=0x7f43a002b9a0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.804+0000 7f43ab3fa640 1 -- 172.21.15.193:0/4253844233 shutdown_connections 2024-07-24T16:23:47.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.804+0000 7f43ab3fa640 1 --2- 172.21.15.193:0/4253844233 >> v2:172.21.15.159:3300/0 conn(0x7f43a415adc0 0x7f43a40723c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.804+0000 7f43ab3fa640 1 --2- 172.21.15.193:0/4253844233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43a40cf880 0x7f43a406c560 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.807 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.804+0000 7f43ab3fa640 1 -- 172.21.15.193:0/4253844233 >> 172.21.15.193:0/4253844233 conn(0x7f43a406e1a0 msgr2=0x7f43a406e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:47.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.804+0000 7f43ab3fa640 1 -- 172.21.15.193:0/4253844233 shutdown_connections 2024-07-24T16:23:47.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.804+0000 7f43ab3fa640 1 -- 172.21.15.193:0/4253844233 wait complete. 2024-07-24T16:23:47.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.806+0000 7f43ab3fa640 1 Processor -- start 2024-07-24T16:23:47.808 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.806+0000 7f43ab3fa640 1 -- start start 2024-07-24T16:23:47.811 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.807+0000 7f43ab3fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43a4072900 0x7f43a41e4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:47.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.807+0000 7f43ab3fa640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43a40cf880 0x7f43a41457c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:47.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.807+0000 7f43ab3fa640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43a415adc0 0x7f43a4153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:47.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.807+0000 7f43ab3fa640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f43a415c450 con 0x7f43a4072900 2024-07-24T16:23:47.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.807+0000 7f43ab3fa640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f43a415c2d0 con 0x7f43a40cf880 2024-07-24T16:23:47.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.807+0000 7f43ab3fa640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f43a4068ac0 con 0x7f43a415adc0 2024-07-24T16:23:47.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f43a8995640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43a40cf880 0x7f43a41457c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:47.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f43a9997640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43a415adc0 0x7f43a4153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:47.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f43a9196640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43a4072900 0x7f43a41e4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:47.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f43a9196640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43a4072900 0x7f43a41e4e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.193:42208/0 (socket says 172.21.15.193:42208) 2024-07-24T16:23:47.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f43a9196640 1 -- 172.21.15.193:0/2573987683 learned_addr learned my addr 172.21.15.193:0/2573987683 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-07-24T16:23:47.812 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f43a9997640 1 -- 172.21.15.193:0/2573987683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43a40cf880 msgr2=0x7f43a41457c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:47.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f43a9997640 1 --2- 172.21.15.193:0/2573987683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43a40cf880 0x7f43a41457c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f43a9997640 1 -- 172.21.15.193:0/2573987683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43a4072900 msgr2=0x7f43a41e4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:47.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f43a9997640 1 --2- 172.21.15.193:0/2573987683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43a4072900 0x7f43a41e4e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f43a9997640 1 -- 172.21.15.193:0/2573987683 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a41476b0 con 0x7f43a415adc0 2024-07-24T16:23:47.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f43a9997640 1 --2- 172.21.15.193:0/2573987683 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43a415adc0 0x7f43a4153200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c3c0 tx=0x7f439c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:47.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f4399ffb640 1 -- 172.21.15.193:0/2573987683 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c017070 con 0x7f43a415adc0 2024-07-24T16:23:47.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f4399ffb640 1 -- 172.21.15.193:0/2573987683 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f439c0053c0 con 0x7f43a415adc0 2024-07-24T16:23:47.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f4399ffb640 1 -- 172.21.15.193:0/2573987683 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c003850 con 0x7f43a415adc0 2024-07-24T16:23:47.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f43ab3fa640 1 -- 172.21.15.193:0/2573987683 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a41e53d0 con 0x7f43a415adc0 2024-07-24T16:23:47.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f4399ffb640 1 -- 172.21.15.193:0/2573987683 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f439c01a070 con 0x7f43a415adc0 2024-07-24T16:23:47.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.808+0000 7f43ab3fa640 1 -- 172.21.15.193:0/2573987683 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a41f2d60 con 0x7f43a415adc0 2024-07-24T16:23:47.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.809+0000 7f4399ffb640 1 -- 172.21.15.193:0/2573987683 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f439c011cd0 con 0x7f43a415adc0 2024-07-24T16:23:47.813 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.809+0000 7f43ab3fa640 1 -- 172.21.15.193:0/2573987683 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43a4068f70 con 0x7f43a415adc0 2024-07-24T16:23:47.814 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.811+0000 7f4399ffb640 1 -- 172.21.15.193:0/2573987683 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f439c022070 con 0x7f43a415adc0 2024-07-24T16:23:47.885 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.883+0000 7f43ab3fa640 1 -- 172.21.15.193:0/2573987683 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7eb2f57d-b24e-49d0-8118-f4cb0332b493", "id": 1} v 0) -- 0x7f43a406f150 con 0x7f43a415adc0 2024-07-24T16:23:47.889 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.886+0000 7f4399ffb640 1 -- 172.21.15.193:0/2573987683 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7eb2f57d-b24e-49d0-8118-f4cb0332b493", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f439c011590 con 0x7f43a415adc0 2024-07-24T16:23:47.889 INFO:teuthology.orchestra.run.smithi193.stdout:1 2024-07-24T16:23:47.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.887+0000 7f43ab3fa640 1 -- 172.21.15.193:0/2573987683 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43a415adc0 msgr2=0x7f43a4153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:47.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.887+0000 7f43ab3fa640 1 --2- 172.21.15.193:0/2573987683 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43a415adc0 0x7f43a4153200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c3c0 tx=0x7f439c00c880 comp rx=0 tx=0).stop 2024-07-24T16:23:47.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.887+0000 7f43ab3fa640 1 -- 172.21.15.193:0/2573987683 shutdown_connections 2024-07-24T16:23:47.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.887+0000 7f43ab3fa640 1 --2- 172.21.15.193:0/2573987683 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f43a415adc0 0x7f43a4153200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.887+0000 7f43ab3fa640 1 --2- 172.21.15.193:0/2573987683 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f43a40cf880 0x7f43a41457c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.887+0000 7f43ab3fa640 1 --2- 172.21.15.193:0/2573987683 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f43a4072900 0x7f43a41e4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:47.890 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.887+0000 7f43ab3fa640 1 -- 172.21.15.193:0/2573987683 >> 172.21.15.193:0/2573987683 conn(0x7f43a406e1a0 msgr2=0x7f43a406f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:47.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.888+0000 7f43ab3fa640 1 -- 172.21.15.193:0/2573987683 shutdown_connections 2024-07-24T16:23:47.891 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:47.888+0000 7f43ab3fa640 1 -- 172.21.15.193:0/2573987683 wait complete. 2024-07-24T16:23:47.900 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 89ea8990-47fc-4de8-a658-e0bd98fb34a8 2 2024-07-24T16:23:48.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.000+0000 7f19ed9c3640 1 -- 172.21.15.193:0/2440438895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19e80cfe80 msgr2=0x7f19e8161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.000+0000 7f19ed9c3640 1 --2- 172.21.15.193:0/2440438895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19e80cfe80 0x7f19e8161f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f19e0005fd0 tx=0x7f19e002abc0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.003 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.000+0000 7f19ed9c3640 1 -- 172.21.15.193:0/2440438895 shutdown_connections 2024-07-24T16:23:48.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.000+0000 7f19ed9c3640 1 --2- 172.21.15.193:0/2440438895 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19e80cfe80 0x7f19e8161f20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.000+0000 7f19ed9c3640 1 -- 172.21.15.193:0/2440438895 >> 172.21.15.193:0/2440438895 conn(0x7f19e809cd30 msgr2=0x7f19e80d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:48.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.000+0000 7f19ed9c3640 1 -- 172.21.15.193:0/2440438895 shutdown_connections 2024-07-24T16:23:48.004 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.000+0000 7f19ed9c3640 1 -- 172.21.15.193:0/2440438895 wait complete. 2024-07-24T16:23:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.002+0000 7f19ed9c3640 1 Processor -- start 2024-07-24T16:23:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.002+0000 7f19ed9c3640 1 -- start start 2024-07-24T16:23:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.002+0000 7f19ed9c3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19e80b2ae0 0x7f19e8156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.002+0000 7f19ed9c3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19e80cfe80 0x7f19e80b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.002+0000 7f19ed9c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19e815d950 0x7f19e80b6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.002+0000 7f19ed9c3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f19e80d0460 con 0x7f19e80b2ae0 2024-07-24T16:23:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.002+0000 7f19ed9c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f19e80d02e0 con 0x7f19e815d950 2024-07-24T16:23:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.002+0000 7f19ed9c3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f19e80d05e0 con 0x7f19e80cfe80 2024-07-24T16:23:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19e77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19e815d950 0x7f19e80b6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19e67fc640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19e80cfe80 0x7f19e80b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19e77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19e815d950 0x7f19e80b6b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:58836/0 (socket says 172.21.15.193:58836) 2024-07-24T16:23:48.007 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19e77fe640 1 -- 172.21.15.193:0/91386638 learned_addr learned my addr 172.21.15.193:0/91386638 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-07-24T16:23:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19e6ffd640 1 --2- 172.21.15.193:0/91386638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19e80b2ae0 0x7f19e8156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19e67fc640 1 -- 172.21.15.193:0/91386638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19e815d950 msgr2=0x7f19e80b6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19e67fc640 1 --2- 172.21.15.193:0/91386638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19e815d950 0x7f19e80b6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19e67fc640 1 -- 172.21.15.193:0/91386638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19e80b2ae0 msgr2=0x7f19e8156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19e67fc640 1 --2- 172.21.15.193:0/91386638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19e80b2ae0 0x7f19e8156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19e67fc640 1 -- 172.21.15.193:0/91386638 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e80d2390 con 0x7f19e80cfe80 2024-07-24T16:23:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19e77fe640 1 --2- 172.21.15.193:0/91386638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19e815d950 0x7f19e80b6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:23:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19e6ffd640 1 --2- 172.21.15.193:0/91386638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19e80b2ae0 0x7f19e8156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:23:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19e67fc640 1 --2- 172.21.15.193:0/91386638 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19e80cfe80 0x7f19e80b4eb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00c430 tx=0x7f19dc00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19cffff640 1 -- 172.21.15.193:0/91386638 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc017070 con 0x7f19e80cfe80 2024-07-24T16:23:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19cffff640 1 -- 172.21.15.193:0/91386638 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f19dc0053c0 con 0x7f19e80cfe80 2024-07-24T16:23:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19cffff640 1 -- 172.21.15.193:0/91386638 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc003850 con 0x7f19e80cfe80 2024-07-24T16:23:48.008 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19ed9c3640 1 -- 172.21.15.193:0/91386638 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e80b5570 con 0x7f19e80cfe80 2024-07-24T16:23:48.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.003+0000 7f19ed9c3640 1 -- 172.21.15.193:0/91386638 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e80b5b30 con 0x7f19e80cfe80 2024-07-24T16:23:48.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.004+0000 7f19cffff640 1 -- 172.21.15.193:0/91386638 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f19dc01a070 con 0x7f19e80cfe80 2024-07-24T16:23:48.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.004+0000 7f19cffff640 1 -- 172.21.15.193:0/91386638 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f19dc011c70 con 0x7f19e80cfe80 2024-07-24T16:23:48.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.004+0000 7f19ed9c3640 1 -- 172.21.15.193:0/91386638 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e80d0a70 con 0x7f19e80cfe80 2024-07-24T16:23:48.009 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.006+0000 7f19cffff640 1 -- 172.21.15.193:0/91386638 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f19dc021070 con 0x7f19e80cfe80 2024-07-24T16:23:48.081 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.078+0000 7f19ed9c3640 1 -- 172.21.15.193:0/91386638 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd new", "uuid": "89ea8990-47fc-4de8-a658-e0bd98fb34a8", "id": 2} v 0) -- 0x7f19e806da80 con 0x7f19e80cfe80 2024-07-24T16:23:48.084 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.082+0000 7f19cffff640 1 -- 172.21.15.193:0/91386638 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "89ea8990-47fc-4de8-a658-e0bd98fb34a8", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f19dc011590 con 0x7f19e80cfe80 2024-07-24T16:23:48.084 INFO:teuthology.orchestra.run.smithi193.stdout:2 2024-07-24T16:23:48.085 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.083+0000 7f19ed9c3640 1 -- 172.21.15.193:0/91386638 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19e80cfe80 msgr2=0x7f19e80b4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.083+0000 7f19ed9c3640 1 --2- 172.21.15.193:0/91386638 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19e80cfe80 0x7f19e80b4eb0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00c430 tx=0x7f19dc00c8f0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.083+0000 7f19ed9c3640 1 -- 172.21.15.193:0/91386638 shutdown_connections 2024-07-24T16:23:48.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.083+0000 7f19ed9c3640 1 --2- 172.21.15.193:0/91386638 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19e815d950 0x7f19e80b6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.083+0000 7f19ed9c3640 1 --2- 172.21.15.193:0/91386638 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19e80cfe80 0x7f19e80b4eb0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.083+0000 7f19ed9c3640 1 --2- 172.21.15.193:0/91386638 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f19e80b2ae0 0x7f19e8156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.083+0000 7f19ed9c3640 1 -- 172.21.15.193:0/91386638 >> 172.21.15.193:0/91386638 conn(0x7f19e809cd30 msgr2=0x7f19e815cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:48.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.083+0000 7f19ed9c3640 1 -- 172.21.15.193:0/91386638 shutdown_connections 2024-07-24T16:23:48.086 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.083+0000 7f19ed9c3640 1 -- 172.21.15.193:0/91386638 wait complete. 2024-07-24T16:23:48.095 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 439171fb-b1e7-44f0-8ff9-87de8d7d925a 3 2024-07-24T16:23:48.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.196+0000 7f4dbba24640 1 -- 172.21.15.193:0/1805990057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4db40b62b0 msgr2=0x7f4db415f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.196+0000 7f4dbba24640 1 --2- 172.21.15.193:0/1805990057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4db40b62b0 0x7f4db415f0f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4da4005fd0 tx=0x7f4da402a5f0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.199 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.196+0000 7f4dbba24640 1 -- 172.21.15.193:0/1805990057 shutdown_connections 2024-07-24T16:23:48.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.196+0000 7f4dbba24640 1 --2- 172.21.15.193:0/1805990057 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4db40b62b0 0x7f4db415f0f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.197+0000 7f4dbba24640 1 -- 172.21.15.193:0/1805990057 >> 172.21.15.193:0/1805990057 conn(0x7f4db4072a80 msgr2=0x7f4db4072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:48.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.197+0000 7f4dbba24640 1 -- 172.21.15.193:0/1805990057 shutdown_connections 2024-07-24T16:23:48.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.197+0000 7f4dbba24640 1 -- 172.21.15.193:0/1805990057 wait complete. 2024-07-24T16:23:48.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.198+0000 7f4dbba24640 1 Processor -- start 2024-07-24T16:23:48.200 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.198+0000 7f4dbba24640 1 -- start start 2024-07-24T16:23:48.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.198+0000 7f4dbba24640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4db4070fc0 0x7f4db41f5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.202 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.198+0000 7f4dbba24640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4db40b62b0 0x7f4db40aa860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4dbba24640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4db415b490 0x7f4db40cc760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4dbba24640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4db40b0160 con 0x7f4db40b62b0 2024-07-24T16:23:48.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4dbba24640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4db40affe0 con 0x7f4db415b490 2024-07-24T16:23:48.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4dbba24640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4db406cd00 con 0x7f4db4070fc0 2024-07-24T16:23:48.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4db97c0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4db4070fc0 0x7f4db41f5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4db9fc1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4db415b490 0x7f4db40cc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4db97c0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4db4070fc0 0x7f4db41f5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.193:54938/0 (socket says 172.21.15.193:54938) 2024-07-24T16:23:48.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4db9fc1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4db415b490 0x7f4db40cc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.193:58860/0 (socket says 172.21.15.193:58860) 2024-07-24T16:23:48.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4db97c0640 1 -- 172.21.15.193:0/1216402580 learned_addr learned my addr 172.21.15.193:0/1216402580 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-07-24T16:23:48.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4db8fbf640 1 --2- 172.21.15.193:0/1216402580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4db40b62b0 0x7f4db40aa860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4db97c0640 1 -- 172.21.15.193:0/1216402580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4db415b490 msgr2=0x7f4db40cc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.203 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4db97c0640 1 --2- 172.21.15.193:0/1216402580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4db415b490 0x7f4db40cc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4db97c0640 1 -- 172.21.15.193:0/1216402580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4db40b62b0 msgr2=0x7f4db40aa860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4db97c0640 1 --2- 172.21.15.193:0/1216402580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4db40b62b0 0x7f4db40aa860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4db97c0640 1 -- 172.21.15.193:0/1216402580 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db41f63b0 con 0x7f4db4070fc0 2024-07-24T16:23:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4db9fc1640 1 --2- 172.21.15.193:0/1216402580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4db415b490 0x7f4db40cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:23:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4db97c0640 1 --2- 172.21.15.193:0/1216402580 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4db4070fc0 0x7f4db41f5e70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4db000c3a0 tx=0x7f4db000c860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4da9ffb640 1 -- 172.21.15.193:0/1216402580 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0017070 con 0x7f4db4070fc0 2024-07-24T16:23:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4da9ffb640 1 -- 172.21.15.193:0/1216402580 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4db00053c0 con 0x7f4db4070fc0 2024-07-24T16:23:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4da9ffb640 1 -- 172.21.15.193:0/1216402580 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4db0003850 con 0x7f4db4070fc0 2024-07-24T16:23:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4dbba24640 1 -- 172.21.15.193:0/1216402580 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db40a97e0 con 0x7f4db4070fc0 2024-07-24T16:23:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.199+0000 7f4da9ffb640 1 -- 172.21.15.193:0/1216402580 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4db001a070 con 0x7f4db4070fc0 2024-07-24T16:23:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.200+0000 7f4dbba24640 1 -- 172.21.15.193:0/1216402580 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db40a9da0 con 0x7f4db4070fc0 2024-07-24T16:23:48.204 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.200+0000 7f4da9ffb640 1 -- 172.21.15.193:0/1216402580 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f4db0011d80 con 0x7f4db4070fc0 2024-07-24T16:23:48.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.201+0000 7f4dbba24640 1 -- 172.21.15.193:0/1216402580 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4db406d120 con 0x7f4db4070fc0 2024-07-24T16:23:48.205 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.202+0000 7f4da9ffb640 1 -- 172.21.15.193:0/1216402580 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f4db0022020 con 0x7f4db4070fc0 2024-07-24T16:23:48.277 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.275+0000 7f4dbba24640 1 -- 172.21.15.193:0/1216402580 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd new", "uuid": "439171fb-b1e7-44f0-8ff9-87de8d7d925a", "id": 3} v 0) -- 0x7f4db4070d80 con 0x7f4db4070fc0 2024-07-24T16:23:48.280 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.278+0000 7f4da9ffb640 1 -- 172.21.15.193:0/1216402580 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "439171fb-b1e7-44f0-8ff9-87de8d7d925a", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f4db41f63b0 con 0x7f4db4070fc0 2024-07-24T16:23:48.281 INFO:teuthology.orchestra.run.smithi193.stdout:3 2024-07-24T16:23:48.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.279+0000 7f4dbba24640 1 -- 172.21.15.193:0/1216402580 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4db4070fc0 msgr2=0x7f4db41f5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.279+0000 7f4dbba24640 1 --2- 172.21.15.193:0/1216402580 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4db4070fc0 0x7f4db41f5e70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4db000c3a0 tx=0x7f4db000c860 comp rx=0 tx=0).stop 2024-07-24T16:23:48.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.279+0000 7f4dbba24640 1 -- 172.21.15.193:0/1216402580 shutdown_connections 2024-07-24T16:23:48.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.279+0000 7f4dbba24640 1 --2- 172.21.15.193:0/1216402580 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4db415b490 0x7f4db40cc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.279+0000 7f4dbba24640 1 --2- 172.21.15.193:0/1216402580 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4db40b62b0 0x7f4db40aa860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.279+0000 7f4dbba24640 1 --2- 172.21.15.193:0/1216402580 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4db4070fc0 0x7f4db41f5e70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.282 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.279+0000 7f4dbba24640 1 -- 172.21.15.193:0/1216402580 >> 172.21.15.193:0/1216402580 conn(0x7f4db4072a80 msgr2=0x7f4db40cd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:48.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.279+0000 7f4dbba24640 1 -- 172.21.15.193:0/1216402580 shutdown_connections 2024-07-24T16:23:48.283 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.279+0000 7f4dbba24640 1 -- 172.21.15.193:0/1216402580 wait complete. 2024-07-24T16:23:48.292 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 74a17e41-c387-4c27-bc9a-ea8a28cc434f 4 2024-07-24T16:23:48.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.392+0000 7f8bdd641640 1 -- 172.21.15.193:0/289997854 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bd80b0c40 msgr2=0x7f8bd815fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.392+0000 7f8bdd641640 1 --2- 172.21.15.193:0/289997854 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bd80b0c40 0x7f8bd815fa20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f8bc8005fd0 tx=0x7f8bc802a5d0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.392+0000 7f8bdd641640 1 -- 172.21.15.193:0/289997854 shutdown_connections 2024-07-24T16:23:48.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.392+0000 7f8bdd641640 1 --2- 172.21.15.193:0/289997854 >> v2:172.21.15.159:3300/0 conn(0x7f8bd815ba20 0x7f8bd80cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.392+0000 7f8bdd641640 1 --2- 172.21.15.193:0/289997854 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bd80b0c40 0x7f8bd815fa20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.395 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.392+0000 7f8bdd641640 1 -- 172.21.15.193:0/289997854 >> 172.21.15.193:0/289997854 conn(0x7f8bd806fd50 msgr2=0x7f8bd8070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:48.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.393+0000 7f8bdd641640 1 -- 172.21.15.193:0/289997854 shutdown_connections 2024-07-24T16:23:48.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.393+0000 7f8bdd641640 1 -- 172.21.15.193:0/289997854 wait complete. 2024-07-24T16:23:48.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.394+0000 7f8bdd641640 1 Processor -- start 2024-07-24T16:23:48.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.394+0000 7f8bdd641640 1 -- start start 2024-07-24T16:23:48.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bdd641640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bd8073c10 0x7f8bd814ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bdd641640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bd80b0c40 0x7f8bd8154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.398 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bdd641640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bd815ba20 0x7f8bd814e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bdd641640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd80d1e60 con 0x7f8bd8073c10 2024-07-24T16:23:48.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bdd641640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8bd80d1ce0 con 0x7f8bd80b0c40 2024-07-24T16:23:48.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bdd641640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8bd80d1fe0 con 0x7f8bd815ba20 2024-07-24T16:23:48.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bd77fe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bd815ba20 0x7f8bd814e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bce7fc640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bd80b0c40 0x7f8bd8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bd77fe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bd815ba20 0x7f8bd814e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.193:54954/0 (socket says 172.21.15.193:54954) 2024-07-24T16:23:48.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bd77fe640 1 -- 172.21.15.193:0/2143769258 learned_addr learned my addr 172.21.15.193:0/2143769258 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-07-24T16:23:48.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bd6ffd640 1 --2- 172.21.15.193:0/2143769258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bd8073c10 0x7f8bd814ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bd77fe640 1 -- 172.21.15.193:0/2143769258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bd80b0c40 msgr2=0x7f8bd8154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bd77fe640 1 --2- 172.21.15.193:0/2143769258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bd80b0c40 0x7f8bd8154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bd77fe640 1 -- 172.21.15.193:0/2143769258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bd8073c10 msgr2=0x7f8bd814ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bd77fe640 1 --2- 172.21.15.193:0/2143769258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bd8073c10 0x7f8bd814ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.399 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bd77fe640 1 -- 172.21.15.193:0/2143769258 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bd814f2e0 con 0x7f8bd815ba20 2024-07-24T16:23:48.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bd77fe640 1 --2- 172.21.15.193:0/2143769258 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bd815ba20 0x7f8bd814e990 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000c7a0 tx=0x7f8bd000cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:48.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bcffff640 1 -- 172.21.15.193:0/2143769258 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd0003b70 con 0x7f8bd815ba20 2024-07-24T16:23:48.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bcffff640 1 -- 172.21.15.193:0/2143769258 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bd0003d10 con 0x7f8bd815ba20 2024-07-24T16:23:48.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bcffff640 1 -- 172.21.15.193:0/2143769258 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd000aab0 con 0x7f8bd815ba20 2024-07-24T16:23:48.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bdd641640 1 -- 172.21.15.193:0/2143769258 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bd8153d30 con 0x7f8bd815ba20 2024-07-24T16:23:48.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.395+0000 7f8bdd641640 1 -- 172.21.15.193:0/2143769258 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bd81542f0 con 0x7f8bd815ba20 2024-07-24T16:23:48.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.396+0000 7f8bcffff640 1 -- 172.21.15.193:0/2143769258 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8bd000ac50 con 0x7f8bd815ba20 2024-07-24T16:23:48.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.396+0000 7f8bcffff640 1 -- 172.21.15.193:0/2143769258 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f8bd0012b10 con 0x7f8bd815ba20 2024-07-24T16:23:48.400 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.397+0000 7f8bdd641640 1 -- 172.21.15.193:0/2143769258 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bd815fa20 con 0x7f8bd815ba20 2024-07-24T16:23:48.401 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.398+0000 7f8bcffff640 1 -- 172.21.15.193:0/2143769258 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f8bd0012600 con 0x7f8bd815ba20 2024-07-24T16:23:48.484 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.481+0000 7f8bdd641640 1 -- 172.21.15.193:0/2143769258 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd new", "uuid": "74a17e41-c387-4c27-bc9a-ea8a28cc434f", "id": 4} v 0) -- 0x7f8bd81544c0 con 0x7f8bd815ba20 2024-07-24T16:23:48.487 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.485+0000 7f8bcffff640 1 -- 172.21.15.193:0/2143769258 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "74a17e41-c387-4c27-bc9a-ea8a28cc434f", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f8bd00127e0 con 0x7f8bd815ba20 2024-07-24T16:23:48.487 INFO:teuthology.orchestra.run.smithi193.stdout:4 2024-07-24T16:23:48.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.486+0000 7f8bdd641640 1 -- 172.21.15.193:0/2143769258 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bd815ba20 msgr2=0x7f8bd814e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.486+0000 7f8bdd641640 1 --2- 172.21.15.193:0/2143769258 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bd815ba20 0x7f8bd814e990 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8bd000c7a0 tx=0x7f8bd000cc60 comp rx=0 tx=0).stop 2024-07-24T16:23:48.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.486+0000 7f8bdd641640 1 -- 172.21.15.193:0/2143769258 shutdown_connections 2024-07-24T16:23:48.488 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.486+0000 7f8bdd641640 1 --2- 172.21.15.193:0/2143769258 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8bd815ba20 0x7f8bd814e990 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.486+0000 7f8bdd641640 1 --2- 172.21.15.193:0/2143769258 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8bd80b0c40 0x7f8bd8154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.486+0000 7f8bdd641640 1 --2- 172.21.15.193:0/2143769258 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8bd8073c10 0x7f8bd814ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.486+0000 7f8bdd641640 1 -- 172.21.15.193:0/2143769258 >> 172.21.15.193:0/2143769258 conn(0x7f8bd806fd50 msgr2=0x7f8bd80b5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:48.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.486+0000 7f8bdd641640 1 -- 172.21.15.193:0/2143769258 shutdown_connections 2024-07-24T16:23:48.489 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.486+0000 7f8bdd641640 1 -- 172.21.15.193:0/2143769258 wait complete. 2024-07-24T16:23:48.498 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new c4e80816-7542-4b1a-83f2-928e806045f9 5 2024-07-24T16:23:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.598+0000 7f158c2b8640 1 -- 172.21.15.193:0/2725641868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15840ce940 msgr2=0x7f158406ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.598+0000 7f158c2b8640 1 --2- 172.21.15.193:0/2725641868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15840ce940 0x7f158406ebc0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f15840b1950 tx=0x7f157c02aa30 comp rx=0 tx=0).stop 2024-07-24T16:23:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.598+0000 7f158c2b8640 1 -- 172.21.15.193:0/2725641868 shutdown_connections 2024-07-24T16:23:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.598+0000 7f158c2b8640 1 --2- 172.21.15.193:0/2725641868 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f15840ce940 0x7f158406ebc0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.598+0000 7f158c2b8640 1 --2- 172.21.15.193:0/2725641868 >> v2:172.21.15.159:3300/0 conn(0x7f15840b5fb0 0x7f15840ce400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.598+0000 7f158c2b8640 1 -- 172.21.15.193:0/2725641868 >> 172.21.15.193:0/2725641868 conn(0x7f1584071140 msgr2=0x7f158406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:48.601 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.598+0000 7f158c2b8640 1 -- 172.21.15.193:0/2725641868 shutdown_connections 2024-07-24T16:23:48.602 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.598+0000 7f158c2b8640 1 -- 172.21.15.193:0/2725641868 wait complete. 2024-07-24T16:23:48.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.599+0000 7f158c2b8640 1 Processor -- start 2024-07-24T16:23:48.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.599+0000 7f158c2b8640 1 -- start start 2024-07-24T16:23:48.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f158c2b8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15840b5fb0 0x7f15841469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f158c2b8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15840ce940 0x7f158414c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f158c2b8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158415a220 0x7f1584155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f158c2b8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f158406f280 con 0x7f15840b5fb0 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f158c2b8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f158406f100 con 0x7f158415a220 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f158c2b8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f158406f400 con 0x7f15840ce940 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f1589853640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15840ce940 0x7f158414c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f158a855640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158415a220 0x7f1584155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f1589853640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15840ce940 0x7f158414c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.193:54964/0 (socket says 172.21.15.193:54964) 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f1589853640 1 -- 172.21.15.193:0/697460373 learned_addr learned my addr 172.21.15.193:0/697460373 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f158a054640 1 --2- 172.21.15.193:0/697460373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15840b5fb0 0x7f15841469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f1589853640 1 -- 172.21.15.193:0/697460373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158415a220 msgr2=0x7f1584155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f1589853640 1 --2- 172.21.15.193:0/697460373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158415a220 0x7f1584155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f1589853640 1 -- 172.21.15.193:0/697460373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15840b5fb0 msgr2=0x7f15841469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f1589853640 1 --2- 172.21.15.193:0/697460373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15840b5fb0 0x7f15841469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f1589853640 1 -- 172.21.15.193:0/697460373 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158414c880 con 0x7f15840ce940 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.600+0000 7f158a855640 1 --2- 172.21.15.193:0/697460373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158415a220 0x7f1584155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:23:48.605 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.601+0000 7f1589853640 1 --2- 172.21.15.193:0/697460373 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15840ce940 0x7f158414c340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f157800d950 tx=0x7f157800de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:48.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.601+0000 7f1576ffd640 1 -- 172.21.15.193:0/697460373 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578017070 con 0x7f15840ce940 2024-07-24T16:23:48.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.601+0000 7f1576ffd640 1 -- 172.21.15.193:0/697460373 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1578009d20 con 0x7f15840ce940 2024-07-24T16:23:48.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.601+0000 7f158c2b8640 1 -- 172.21.15.193:0/697460373 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158414e1e0 con 0x7f15840ce940 2024-07-24T16:23:48.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.601+0000 7f1576ffd640 1 -- 172.21.15.193:0/697460373 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15780106c0 con 0x7f15840ce940 2024-07-24T16:23:48.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.601+0000 7f158c2b8640 1 -- 172.21.15.193:0/697460373 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f15841f7630 con 0x7f15840ce940 2024-07-24T16:23:48.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.601+0000 7f1576ffd640 1 -- 172.21.15.193:0/697460373 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1578010860 con 0x7f15840ce940 2024-07-24T16:23:48.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.601+0000 7f1576ffd640 1 -- 172.21.15.193:0/697460373 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f157801ba90 con 0x7f15840ce940 2024-07-24T16:23:48.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.602+0000 7f158c2b8640 1 -- 172.21.15.193:0/697460373 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15841f7170 con 0x7f15840ce940 2024-07-24T16:23:48.606 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.604+0000 7f1576ffd640 1 -- 172.21.15.193:0/697460373 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f15841f7170 con 0x7f15840ce940 2024-07-24T16:23:48.678 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.676+0000 7f158c2b8640 1 -- 172.21.15.193:0/697460373 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c4e80816-7542-4b1a-83f2-928e806045f9", "id": 5} v 0) -- 0x7f158415dc00 con 0x7f15840ce940 2024-07-24T16:23:48.682 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.680+0000 7f1576ffd640 1 -- 172.21.15.193:0/697460373 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4e80816-7542-4b1a-83f2-928e806045f9", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f1578010d30 con 0x7f15840ce940 2024-07-24T16:23:48.682 INFO:teuthology.orchestra.run.smithi193.stdout:5 2024-07-24T16:23:48.683 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.681+0000 7f158c2b8640 1 -- 172.21.15.193:0/697460373 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15840ce940 msgr2=0x7f158414c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.681+0000 7f158c2b8640 1 --2- 172.21.15.193:0/697460373 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15840ce940 0x7f158414c340 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f157800d950 tx=0x7f157800de10 comp rx=0 tx=0).stop 2024-07-24T16:23:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.681+0000 7f158c2b8640 1 -- 172.21.15.193:0/697460373 shutdown_connections 2024-07-24T16:23:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.681+0000 7f158c2b8640 1 --2- 172.21.15.193:0/697460373 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f158415a220 0x7f1584155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.681+0000 7f158c2b8640 1 --2- 172.21.15.193:0/697460373 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f15840ce940 0x7f158414c340 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.681+0000 7f158c2b8640 1 --2- 172.21.15.193:0/697460373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f15840b5fb0 0x7f15841469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.681+0000 7f158c2b8640 1 -- 172.21.15.193:0/697460373 >> 172.21.15.193:0/697460373 conn(0x7f1584071140 msgr2=0x7f15840b5880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.681+0000 7f158c2b8640 1 -- 172.21.15.193:0/697460373 shutdown_connections 2024-07-24T16:23:48.684 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.681+0000 7f158c2b8640 1 -- 172.21.15.193:0/697460373 wait complete. 2024-07-24T16:23:48.693 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new fe1fd78a-24b4-45a0-a6dc-46f605e582f5 6 2024-07-24T16:23:48.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.794+0000 7fb737cbe640 1 -- 172.21.15.193:0/278779480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb73015b300 msgr2=0x7fb73006fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.794+0000 7fb737cbe640 1 --2- 172.21.15.193:0/278779480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb73015b300 0x7fb73006fdc0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb72c009860 tx=0x7fb72c02a540 comp rx=0 tx=0).stop 2024-07-24T16:23:48.797 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.794+0000 7fb737cbe640 1 -- 172.21.15.193:0/278779480 shutdown_connections 2024-07-24T16:23:48.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.794+0000 7fb737cbe640 1 --2- 172.21.15.193:0/278779480 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb730070300 0x7fb73006c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.794+0000 7fb737cbe640 1 --2- 172.21.15.193:0/278779480 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb73015b300 0x7fb73006fdc0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.794+0000 7fb737cbe640 1 -- 172.21.15.193:0/278779480 >> 172.21.15.193:0/278779480 conn(0x7fb730068ca0 msgr2=0x7fb73006d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:48.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.794+0000 7fb737cbe640 1 -- 172.21.15.193:0/278779480 shutdown_connections 2024-07-24T16:23:48.798 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.794+0000 7fb737cbe640 1 -- 172.21.15.193:0/278779480 wait complete. 2024-07-24T16:23:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.795+0000 7fb737cbe640 1 Processor -- start 2024-07-24T16:23:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.795+0000 7fb737cbe640 1 -- start start 2024-07-24T16:23:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.796+0000 7fb737cbe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb73006caa0 0x7fb7300c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.796+0000 7fb737cbe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb730070300 0x7fb7301f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.796+0000 7fb737cbe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb73015b300 0x7fb7301f5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.796+0000 7fb737cbe640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb7300c64b0 con 0x7fb73006caa0 2024-07-24T16:23:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.796+0000 7fb737cbe640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb7300c6330 con 0x7fb73015b300 2024-07-24T16:23:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.796+0000 7fb737cbe640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb7300cfa90 con 0x7fb730070300 2024-07-24T16:23:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.796+0000 7fb735259640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb730070300 0x7fb7301f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.801 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.796+0000 7fb73625b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb73015b300 0x7fb7301f5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.796+0000 7fb735259640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb730070300 0x7fb7301f5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.193:54972/0 (socket says 172.21.15.193:54972) 2024-07-24T16:23:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.796+0000 7fb735259640 1 -- 172.21.15.193:0/3602254409 learned_addr learned my addr 172.21.15.193:0/3602254409 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-07-24T16:23:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.796+0000 7fb735a5a640 1 --2- 172.21.15.193:0/3602254409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb73006caa0 0x7fb7300c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb73625b640 1 -- 172.21.15.193:0/3602254409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb730070300 msgr2=0x7fb7301f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb73625b640 1 --2- 172.21.15.193:0/3602254409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb730070300 0x7fb7301f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb73625b640 1 -- 172.21.15.193:0/3602254409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb73006caa0 msgr2=0x7fb7300c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb73625b640 1 --2- 172.21.15.193:0/3602254409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb73006caa0 0x7fb7300c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb73625b640 1 -- 172.21.15.193:0/3602254409 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb73014d6f0 con 0x7fb73015b300 2024-07-24T16:23:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb735259640 1 --2- 172.21.15.193:0/3602254409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb730070300 0x7fb7301f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:23:48.802 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb73625b640 1 --2- 172.21.15.193:0/3602254409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb73015b300 0x7fb7301f5ea0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb72800c730 tx=0x7fb72800cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:48.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb7227fc640 1 -- 172.21.15.193:0/3602254409 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb728003b70 con 0x7fb73015b300 2024-07-24T16:23:48.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb7227fc640 1 -- 172.21.15.193:0/3602254409 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb728003d10 con 0x7fb73015b300 2024-07-24T16:23:48.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb737cbe640 1 -- 172.21.15.193:0/3602254409 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb73014d9d0 con 0x7fb73015b300 2024-07-24T16:23:48.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb7227fc640 1 -- 172.21.15.193:0/3602254409 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb72800aab0 con 0x7fb73015b300 2024-07-24T16:23:48.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb737cbe640 1 -- 172.21.15.193:0/3602254409 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb73014df90 con 0x7fb73015b300 2024-07-24T16:23:48.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb7227fc640 1 -- 172.21.15.193:0/3602254409 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb72800ac50 con 0x7fb73015b300 2024-07-24T16:23:48.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.797+0000 7fb7227fc640 1 -- 172.21.15.193:0/3602254409 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fb728012b00 con 0x7fb73015b300 2024-07-24T16:23:48.803 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.798+0000 7fb737cbe640 1 -- 172.21.15.193:0/3602254409 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7300cff50 con 0x7fb73015b300 2024-07-24T16:23:48.804 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.800+0000 7fb7227fc640 1 -- 172.21.15.193:0/3602254409 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7fb728012510 con 0x7fb73015b300 2024-07-24T16:23:48.875 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.873+0000 7fb737cbe640 1 -- 172.21.15.193:0/3602254409 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fe1fd78a-24b4-45a0-a6dc-46f605e582f5", "id": 6} v 0) -- 0x7fb73014e160 con 0x7fb73015b300 2024-07-24T16:23:48.879 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.876+0000 7fb7227fc640 1 -- 172.21.15.193:0/3602254409 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fe1fd78a-24b4-45a0-a6dc-46f605e582f5", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fb7280126f0 con 0x7fb73015b300 2024-07-24T16:23:48.879 INFO:teuthology.orchestra.run.smithi193.stdout:6 2024-07-24T16:23:48.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.877+0000 7fb737cbe640 1 -- 172.21.15.193:0/3602254409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb73015b300 msgr2=0x7fb7301f5ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.877+0000 7fb737cbe640 1 --2- 172.21.15.193:0/3602254409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb73015b300 0x7fb7301f5ea0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb72800c730 tx=0x7fb72800cbf0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.878+0000 7fb737cbe640 1 -- 172.21.15.193:0/3602254409 shutdown_connections 2024-07-24T16:23:48.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.878+0000 7fb737cbe640 1 --2- 172.21.15.193:0/3602254409 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb73015b300 0x7fb7301f5ea0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.880 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.878+0000 7fb737cbe640 1 --2- 172.21.15.193:0/3602254409 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb730070300 0x7fb7301f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.878+0000 7fb737cbe640 1 --2- 172.21.15.193:0/3602254409 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb73006caa0 0x7fb7300c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.878+0000 7fb737cbe640 1 -- 172.21.15.193:0/3602254409 >> 172.21.15.193:0/3602254409 conn(0x7fb730068ca0 msgr2=0x7fb7300c5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:48.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.878+0000 7fb737cbe640 1 -- 172.21.15.193:0/3602254409 shutdown_connections 2024-07-24T16:23:48.881 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.878+0000 7fb737cbe640 1 -- 172.21.15.193:0/3602254409 wait complete. 2024-07-24T16:23:48.890 DEBUG:teuthology.orchestra.run.smithi193:> sudo ceph --cluster ceph osd new 7c98fae9-9940-4fca-86d0-6e3c0971b77e 7 2024-07-24T16:23:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.990+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/2842416389 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b640b5260 msgr2=0x7f9b640b3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.990+0000 7f9b6bbe8640 1 --2- 172.21.15.193:0/2842416389 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b640b5260 0x7f9b640b3890 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9b5c005fd0 tx=0x7f9b5c02aa90 comp rx=0 tx=0).stop 2024-07-24T16:23:48.993 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.991+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/2842416389 shutdown_connections 2024-07-24T16:23:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.991+0000 7f9b6bbe8640 1 --2- 172.21.15.193:0/2842416389 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b640b5260 0x7f9b640b3890 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.991+0000 7f9b6bbe8640 1 --2- 172.21.15.193:0/2842416389 >> v2:172.21.15.159:3300/0 conn(0x7f9b64155b00 0x7f9b640b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.991+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/2842416389 >> 172.21.15.193:0/2842416389 conn(0x7f9b6406fd30 msgr2=0x7f9b64070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.991+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/2842416389 shutdown_connections 2024-07-24T16:23:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.991+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/2842416389 wait complete. 2024-07-24T16:23:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.992+0000 7f9b6bbe8640 1 Processor -- start 2024-07-24T16:23:48.994 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.992+0000 7f9b6bbe8640 1 -- start start 2024-07-24T16:23:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b6bbe8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b640b5260 0x7f9b641f42a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b6bbe8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b640b5d30 0x7f9b640afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b6bbe8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b64155b00 0x7f9b640ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b6bbe8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9b640d1b40 con 0x7f9b640b5d30 2024-07-24T16:23:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b6bbe8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9b640d19c0 con 0x7f9b64155b00 2024-07-24T16:23:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b6bbe8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9b640d1cc0 con 0x7f9b640b5260 2024-07-24T16:23:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b69984640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b640b5260 0x7f9b641f42a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b69984640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b640b5260 0x7f9b641f42a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.193:54992/0 (socket says 172.21.15.193:54992) 2024-07-24T16:23:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b69984640 1 -- 172.21.15.193:0/4008782204 learned_addr learned my addr 172.21.15.193:0/4008782204 (peer_addr_for_me v2:172.21.15.193:0/0) 2024-07-24T16:23:48.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b6a185640 1 --2- 172.21.15.193:0/4008782204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b64155b00 0x7f9b640ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b69183640 1 --2- 172.21.15.193:0/4008782204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b640b5d30 0x7f9b640afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b69984640 1 -- 172.21.15.193:0/4008782204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b64155b00 msgr2=0x7f9b640ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b69984640 1 --2- 172.21.15.193:0/4008782204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b64155b00 0x7f9b640ae5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b69984640 1 -- 172.21.15.193:0/4008782204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b640b5d30 msgr2=0x7f9b640afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b69984640 1 --2- 172.21.15.193:0/4008782204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b640b5d30 0x7f9b640afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b69984640 1 -- 172.21.15.193:0/4008782204 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b641f51e0 con 0x7f9b640b5260 2024-07-24T16:23:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b69183640 1 --2- 172.21.15.193:0/4008782204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b640b5d30 0x7f9b640afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:23:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b6a185640 1 --2- 172.21.15.193:0/4008782204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b64155b00 0x7f9b640ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:23:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.993+0000 7f9b69984640 1 --2- 172.21.15.193:0/4008782204 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b640b5260 0x7f9b641f42a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000e7c0 tx=0x7f9b6000ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.994+0000 7f9b567fc640 1 -- 172.21.15.193:0/4008782204 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b6000ccc0 con 0x7f9b640b5260 2024-07-24T16:23:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.994+0000 7f9b567fc640 1 -- 172.21.15.193:0/4008782204 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b60010430 con 0x7f9b640b5260 2024-07-24T16:23:48.998 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.994+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/4008782204 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b641f4940 con 0x7f9b640b5260 2024-07-24T16:23:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.994+0000 7f9b567fc640 1 -- 172.21.15.193:0/4008782204 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b60010860 con 0x7f9b640b5260 2024-07-24T16:23:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.994+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/4008782204 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b641f4f00 con 0x7f9b640b5260 2024-07-24T16:23:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.994+0000 7f9b567fc640 1 -- 172.21.15.193:0/4008782204 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9b60010a00 con 0x7f9b640b5260 2024-07-24T16:23:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.994+0000 7f9b567fc640 1 -- 172.21.15.193:0/4008782204 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f9b60018c40 con 0x7f9b640b5260 2024-07-24T16:23:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.995+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/4008782204 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b640d21e0 con 0x7f9b640b5260 2024-07-24T16:23:48.999 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:48.997+0000 7f9b567fc640 1 -- 172.21.15.193:0/4008782204 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f9b60018420 con 0x7f9b640b5260 2024-07-24T16:23:49.071 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:49.069+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/4008782204 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7c98fae9-9940-4fca-86d0-6e3c0971b77e", "id": 7} v 0) -- 0x7f9b640cdd80 con 0x7f9b640b5260 2024-07-24T16:23:49.074 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:49.072+0000 7f9b567fc640 1 -- 172.21.15.193:0/4008782204 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c98fae9-9940-4fca-86d0-6e3c0971b77e", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f9b60018600 con 0x7f9b640b5260 2024-07-24T16:23:49.075 INFO:teuthology.orchestra.run.smithi193.stdout:7 2024-07-24T16:23:49.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:49.073+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/4008782204 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b640b5260 msgr2=0x7f9b641f42a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:49.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:49.073+0000 7f9b6bbe8640 1 --2- 172.21.15.193:0/4008782204 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b640b5260 0x7f9b641f42a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9b6000e7c0 tx=0x7f9b6000ec80 comp rx=0 tx=0).stop 2024-07-24T16:23:49.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:49.073+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/4008782204 shutdown_connections 2024-07-24T16:23:49.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:49.073+0000 7f9b6bbe8640 1 --2- 172.21.15.193:0/4008782204 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9b64155b00 0x7f9b640ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:49.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:49.073+0000 7f9b6bbe8640 1 --2- 172.21.15.193:0/4008782204 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9b640b5d30 0x7f9b640afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:49.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:49.073+0000 7f9b6bbe8640 1 --2- 172.21.15.193:0/4008782204 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9b640b5260 0x7f9b641f42a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:49.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:49.073+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/4008782204 >> 172.21.15.193:0/4008782204 conn(0x7f9b6406fd30 msgr2=0x7f9b64070110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:49.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:49.073+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/4008782204 shutdown_connections 2024-07-24T16:23:49.076 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:23:49.073+0000 7f9b6bbe8640 1 -- 172.21.15.193:0/4008782204 wait complete. 2024-07-24T16:23:49.086 INFO:tasks.ceph.osd.0:Restarting daemon 2024-07-24T16:23:49.086 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-07-24T16:23:49.088 INFO:tasks.ceph.osd.0:Started 2024-07-24T16:23:49.089 INFO:tasks.ceph.osd.1:Restarting daemon 2024-07-24T16:23:49.089 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-07-24T16:23:49.091 INFO:tasks.ceph.osd.1:Started 2024-07-24T16:23:49.091 INFO:tasks.ceph.osd.2:Restarting daemon 2024-07-24T16:23:49.091 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-07-24T16:23:49.093 INFO:tasks.ceph.osd.2:Started 2024-07-24T16:23:49.093 INFO:tasks.ceph.osd.3:Restarting daemon 2024-07-24T16:23:49.093 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-07-24T16:23:49.095 INFO:tasks.ceph.osd.3:Started 2024-07-24T16:23:49.095 INFO:tasks.ceph.osd.4:Restarting daemon 2024-07-24T16:23:49.095 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-07-24T16:23:49.098 INFO:tasks.ceph.osd.4:Started 2024-07-24T16:23:49.098 INFO:tasks.ceph.osd.5:Restarting daemon 2024-07-24T16:23:49.099 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-07-24T16:23:49.101 INFO:tasks.ceph.osd.5:Started 2024-07-24T16:23:49.101 INFO:tasks.ceph.osd.6:Restarting daemon 2024-07-24T16:23:49.101 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-07-24T16:23:49.103 INFO:tasks.ceph.osd.6:Started 2024-07-24T16:23:49.103 INFO:tasks.ceph.osd.7:Restarting daemon 2024-07-24T16:23:49.103 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-07-24T16:23:49.106 INFO:tasks.ceph.osd.7:Started 2024-07-24T16:23:49.106 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:23:49.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.240+0000 7f4cc5939640 1 -- 172.21.15.159:0/16049347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cac0052e0 msgr2=0x7f4cac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:49.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.240+0000 7f4cc5939640 1 --2- 172.21.15.159:0/16049347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cac0052e0 0x7f4cac00b9c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8006fd0 tx=0x7f4cac005830 comp rx=0 tx=0).stop 2024-07-24T16:23:49.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.240+0000 7f4cc5939640 1 -- 172.21.15.159:0/16049347 shutdown_connections 2024-07-24T16:23:49.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.240+0000 7f4cc5939640 1 --2- 172.21.15.159:0/16049347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cac0052e0 0x7f4cac00b9c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:49.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.240+0000 7f4cc5939640 1 -- 172.21.15.159:0/16049347 >> 172.21.15.159:0/16049347 conn(0x7f4cc00d3810 msgr2=0x7f4cc00d3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:49.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.240+0000 7f4cc5939640 1 -- 172.21.15.159:0/16049347 shutdown_connections 2024-07-24T16:23:49.243 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.240+0000 7f4cc5939640 1 -- 172.21.15.159:0/16049347 wait complete. 2024-07-24T16:23:49.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.241+0000 7f4cc5939640 1 Processor -- start 2024-07-24T16:23:49.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.241+0000 7f4cc5939640 1 -- start start 2024-07-24T16:23:49.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cc5939640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4cac0052e0 0x7f4cc0157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:49.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cc5939640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4cc01f50a0 0x7f4cc00b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:49.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cc5939640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc00ace20 0x7f4cc00ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:49.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cc5939640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc00b5a00 con 0x7f4cc00ace20 2024-07-24T16:23:49.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cc5939640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc00b5880 con 0x7f4cac0052e0 2024-07-24T16:23:49.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cc5939640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc00b5b80 con 0x7f4cc01f50a0 2024-07-24T16:23:49.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cbf7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc00ace20 0x7f4cc00ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:49.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cbf7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc00ace20 0x7f4cc00ad2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58808/0 (socket says 172.21.15.159:58808) 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cbf7fe640 1 -- 172.21.15.159:0/1569149240 learned_addr learned my addr 172.21.15.159:0/1569149240 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cb7fff640 1 --2- 172.21.15.159:0/1569149240 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4cc01f50a0 0x7f4cc00b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cbeffd640 1 --2- 172.21.15.159:0/1569149240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4cac0052e0 0x7f4cc0157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cbf7fe640 1 -- 172.21.15.159:0/1569149240 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4cc01f50a0 msgr2=0x7f4cc00b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cbf7fe640 1 --2- 172.21.15.159:0/1569149240 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4cc01f50a0 0x7f4cc00b4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cbf7fe640 1 -- 172.21.15.159:0/1569149240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4cac0052e0 msgr2=0x7f4cc0157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cbf7fe640 1 --2- 172.21.15.159:0/1569149240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4cac0052e0 0x7f4cc0157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cbf7fe640 1 -- 172.21.15.159:0/1569149240 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc0156f20 con 0x7f4cc00ace20 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cbf7fe640 1 --2- 172.21.15.159:0/1569149240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc00ace20 0x7f4cc00ad2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8000f80 tx=0x7f4cb8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.242+0000 7f4cbcff9640 1 -- 172.21.15.159:0/1569149240 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb802b7c0 con 0x7f4cc00ace20 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.243+0000 7f4cbcff9640 1 -- 172.21.15.159:0/1569149240 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cb802b980 con 0x7f4cc00ace20 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.243+0000 7f4cc5939640 1 -- 172.21.15.159:0/1569149240 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc0157200 con 0x7f4cc00ace20 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.243+0000 7f4cbcff9640 1 -- 172.21.15.159:0/1569149240 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb802bdd0 con 0x7f4cc00ace20 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.243+0000 7f4cc5939640 1 -- 172.21.15.159:0/1569149240 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc01577c0 con 0x7f4cc00ace20 2024-07-24T16:23:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.243+0000 7f4cbcff9640 1 -- 172.21.15.159:0/1569149240 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4cb803c030 con 0x7f4cc00ace20 2024-07-24T16:23:49.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.243+0000 7f4cbcff9640 1 -- 172.21.15.159:0/1569149240 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f4cb803e410 con 0x7f4cc00ace20 2024-07-24T16:23:49.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.244+0000 7f4cc5939640 1 -- 172.21.15.159:0/1569149240 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc00508d0 con 0x7f4cc00ace20 2024-07-24T16:23:49.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.246+0000 7f4cbcff9640 1 -- 172.21.15.159:0/1569149240 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f4cc00508d0 con 0x7f4cc00ace20 2024-07-24T16:23:49.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.308+0000 7f4cc5939640 1 -- 172.21.15.159:0/1569149240 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4cc00ce360 con 0x7f4cc00ace20 2024-07-24T16:23:49.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.308+0000 7f4cbcff9640 1 -- 172.21.15.159:0/1569149240 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f4cb80065c0 con 0x7f4cc00ace20 2024-07-24T16:23:49.311 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:49.311 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":10,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:23:49.071285+0000","last_up_change":"0.000000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:23:49.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.309+0000 7f4cc5939640 1 -- 172.21.15.159:0/1569149240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc00ace20 msgr2=0x7f4cc00ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:49.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.309+0000 7f4cc5939640 1 --2- 172.21.15.159:0/1569149240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc00ace20 0x7f4cc00ad2b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8000f80 tx=0x7f4cb8003ba0 comp rx=0 tx=0).stop 2024-07-24T16:23:49.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.309+0000 7f4cc5939640 1 -- 172.21.15.159:0/1569149240 shutdown_connections 2024-07-24T16:23:49.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.309+0000 7f4cc5939640 1 --2- 172.21.15.159:0/1569149240 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4cc00ace20 0x7f4cc00ad2b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:49.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.309+0000 7f4cc5939640 1 --2- 172.21.15.159:0/1569149240 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4cc01f50a0 0x7f4cc00b4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:49.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.309+0000 7f4cc5939640 1 --2- 172.21.15.159:0/1569149240 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4cac0052e0 0x7f4cc0157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:49.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.309+0000 7f4cc5939640 1 -- 172.21.15.159:0/1569149240 >> 172.21.15.159:0/1569149240 conn(0x7f4cc00d3810 msgr2=0x7f4cc00b6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:49.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.309+0000 7f4cc5939640 1 -- 172.21.15.159:0/1569149240 shutdown_connections 2024-07-24T16:23:49.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:49.309+0000 7f4cc5939640 1 -- 172.21.15.159:0/1569149240 wait complete. 2024-07-24T16:23:49.322 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-07-24T16:23:49.322 INFO:tasks.ceph:Waiting for OSDs to come up 2024-07-24T16:23:49.698 INFO:tasks.ceph.osd.3.smithi159.stderr:2024-07-24T16:23:49.695+0000 7f337c501640 -1 Falling back to public interface 2024-07-24T16:23:49.710 INFO:tasks.ceph.osd.1.smithi159.stderr:2024-07-24T16:23:49.707+0000 7f90cee1c640 -1 Falling back to public interface 2024-07-24T16:23:49.710 INFO:tasks.ceph.osd.0.smithi159.stderr:2024-07-24T16:23:49.707+0000 7fb76c663640 -1 Falling back to public interface 2024-07-24T16:23:49.711 INFO:tasks.ceph.osd.2.smithi159.stderr:2024-07-24T16:23:49.707+0000 7fa711a18640 -1 Falling back to public interface 2024-07-24T16:23:49.711 INFO:tasks.ceph.osd.2.smithi159.stderr:2024-07-24T16:23:49.708+0000 7fa710399640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6813/0: (98) Address already in use 2024-07-24T16:23:49.711 INFO:tasks.ceph.osd.1.smithi159.stderr:2024-07-24T16:23:49.708+0000 7f90cd7b9640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6816/0: (98) Address already in use 2024-07-24T16:23:49.712 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-07-24T16:23:49.710+0000 7f24c7588640 -1 Falling back to public interface 2024-07-24T16:23:49.720 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-07-24T16:23:49.717+0000 7ff6bfe0e640 -1 Falling back to public interface 2024-07-24T16:23:49.720 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-07-24T16:23:49.718+0000 7f49b7fb1640 -1 Falling back to public interface 2024-07-24T16:23:49.724 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-07-24T16:23:49.722+0000 7fb6b0820640 -1 Falling back to public interface 2024-07-24T16:23:50.129 DEBUG:teuthology.orchestra.run.smithi159:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-07-24T16:23:50.226 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.223+0000 7f0f717bb640 1 -- 172.21.15.159:0/3686115188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c0b3800 msgr2=0x7f0f6c0b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:50.226 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.223+0000 7f0f717bb640 1 --2- 172.21.15.159:0/3686115188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c0b3800 0x7f0f6c0b3cb0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c06e180 tx=0x7f0f6402a8f0 comp rx=0 tx=0).stop 2024-07-24T16:23:50.226 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.223+0000 7f0f717bb640 1 -- 172.21.15.159:0/3686115188 shutdown_connections 2024-07-24T16:23:50.226 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.223+0000 7f0f717bb640 1 --2- 172.21.15.159:0/3686115188 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c0b3800 0x7f0f6c0b3cb0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:50.226 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.223+0000 7f0f717bb640 1 --2- 172.21.15.159:0/3686115188 >> v2:172.21.15.193:3300/0 conn(0x7f0f6c15ebf0 0x7f0f6c06c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:50.226 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.223+0000 7f0f717bb640 1 --2- 172.21.15.159:0/3686115188 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f6c15e810 0x7f0f6c06c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:50.226 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.223+0000 7f0f717bb640 1 -- 172.21.15.159:0/3686115188 >> 172.21.15.159:0/3686115188 conn(0x7f0f6c06d2a0 msgr2=0x7f0f6c06d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:50.226 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.223+0000 7f0f717bb640 1 -- 172.21.15.159:0/3686115188 shutdown_connections 2024-07-24T16:23:50.226 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.223+0000 7f0f717bb640 1 -- 172.21.15.159:0/3686115188 wait complete. 2024-07-24T16:23:50.229 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.224+0000 7f0f717bb640 1 Processor -- start 2024-07-24T16:23:50.229 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.224+0000 7f0f717bb640 1 -- start start 2024-07-24T16:23:50.229 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f717bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c0b3800 0x7f0f6c146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:50.229 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f717bb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f6c15e810 0x7f0f6c0b0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:50.229 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f717bb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f6c15ebf0 0x7f0f6c0b08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:50.229 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f717bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c15f4c0 con 0x7f0f6c0b3800 2024-07-24T16:23:50.229 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f717bb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6c15f340 con 0x7f0f6c15e810 2024-07-24T16:23:50.230 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f717bb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6c15f640 con 0x7f0f6c15ebf0 2024-07-24T16:23:50.230 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f6affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c0b3800 0x7f0f6c146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:50.230 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f6affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c0b3800 0x7f0f6c146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:58828/0 (socket says 172.21.15.159:58828) 2024-07-24T16:23:50.230 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f6affd640 1 -- 172.21.15.159:0/3647009142 learned_addr learned my addr 172.21.15.159:0/3647009142 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:50.230 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f63fff640 1 --2- 172.21.15.159:0/3647009142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f6c15e810 0x7f0f6c0b0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:50.230 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f6b7fe640 1 --2- 172.21.15.159:0/3647009142 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f6c15ebf0 0x7f0f6c0b08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:50.230 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f6affd640 1 -- 172.21.15.159:0/3647009142 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f6c15ebf0 msgr2=0x7f0f6c0b08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:50.230 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f6affd640 1 --2- 172.21.15.159:0/3647009142 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f6c15ebf0 0x7f0f6c0b08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:50.230 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f6affd640 1 -- 172.21.15.159:0/3647009142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f6c15e810 msgr2=0x7f0f6c0b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:50.230 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f6affd640 1 --2- 172.21.15.159:0/3647009142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f6c15e810 0x7f0f6c0b0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:50.230 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f6affd640 1 -- 172.21.15.159:0/3647009142 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f6c147470 con 0x7f0f6c0b3800 2024-07-24T16:23:50.230 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f6affd640 1 --2- 172.21.15.159:0/3647009142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c0b3800 0x7f0f6c146b70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00e9f0 tx=0x7f0f5c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:50.231 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f637fe640 1 -- 172.21.15.159:0/3647009142 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c00cd80 con 0x7f0f6c0b3800 2024-07-24T16:23:50.231 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.225+0000 7f0f637fe640 1 -- 172.21.15.159:0/3647009142 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f5c005020 con 0x7f0f6c0b3800 2024-07-24T16:23:50.231 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.226+0000 7f0f637fe640 1 -- 172.21.15.159:0/3647009142 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c005450 con 0x7f0f6c0b3800 2024-07-24T16:23:50.231 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.226+0000 7f0f717bb640 1 -- 172.21.15.159:0/3647009142 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f6c147750 con 0x7f0f6c0b3800 2024-07-24T16:23:50.231 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.226+0000 7f0f717bb640 1 -- 172.21.15.159:0/3647009142 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6c147d10 con 0x7f0f6c0b3800 2024-07-24T16:23:50.231 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.226+0000 7f0f637fe640 1 -- 172.21.15.159:0/3647009142 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0f5c004b30 con 0x7f0f6c0b3800 2024-07-24T16:23:50.231 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.226+0000 7f0f637fe640 1 -- 172.21.15.159:0/3647009142 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f0f5c004e20 con 0x7f0f6c0b3800 2024-07-24T16:23:50.231 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.227+0000 7f0f717bb640 1 -- 172.21.15.159:0/3647009142 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f6c0b3cb0 con 0x7f0f6c0b3800 2024-07-24T16:23:50.232 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.228+0000 7f0f637fe640 1 -- 172.21.15.159:0/3647009142 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73745 (secure 0 0 0) 0x7f0f5c0055f0 con 0x7f0f6c0b3800 2024-07-24T16:23:50.294 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.291+0000 7f0f717bb640 1 -- 172.21.15.159:0/3647009142 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0f6c06d710 con 0x7f0f6c0b3800 2024-07-24T16:23:50.294 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.292+0000 7f0f637fe640 1 -- 172.21.15.159:0/3647009142 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f0f5c027030 con 0x7f0f6c0b3800 2024-07-24T16:23:50.294 INFO:teuthology.misc.health.smithi159.stdout: 2024-07-24T16:23:50.294 INFO:teuthology.misc.health.smithi159.stdout:{"epoch":10,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:23:49.071285+0000","last_up_change":"0.000000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:23:50.295 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.293+0000 7f0f717bb640 1 -- 172.21.15.159:0/3647009142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c0b3800 msgr2=0x7f0f6c146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:50.295 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.293+0000 7f0f717bb640 1 --2- 172.21.15.159:0/3647009142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c0b3800 0x7f0f6c146b70 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c00e9f0 tx=0x7f0f5c00edf0 comp rx=0 tx=0).stop 2024-07-24T16:23:50.296 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.293+0000 7f0f717bb640 1 -- 172.21.15.159:0/3647009142 shutdown_connections 2024-07-24T16:23:50.296 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.293+0000 7f0f717bb640 1 --2- 172.21.15.159:0/3647009142 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0f6c15ebf0 0x7f0f6c0b08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:50.296 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.293+0000 7f0f717bb640 1 --2- 172.21.15.159:0/3647009142 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0f6c15e810 0x7f0f6c0b0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:50.296 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.293+0000 7f0f717bb640 1 --2- 172.21.15.159:0/3647009142 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0f6c0b3800 0x7f0f6c146b70 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:50.296 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.293+0000 7f0f717bb640 1 -- 172.21.15.159:0/3647009142 >> 172.21.15.159:0/3647009142 conn(0x7f0f6c06d2a0 msgr2=0x7f0f6c0b1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:50.296 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.293+0000 7f0f717bb640 1 -- 172.21.15.159:0/3647009142 shutdown_connections 2024-07-24T16:23:50.296 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:50.293+0000 7f0f717bb640 1 -- 172.21.15.159:0/3647009142 wait complete. 2024-07-24T16:23:50.304 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-07-24T16:23:51.366 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:23:51.363+0000 7f68986db640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-07-24T16:23:51.370 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:23:51.368+0000 7f68986db640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-07-24T16:23:53.159 INFO:tasks.ceph.osd.3.smithi159.stderr:2024-07-24T16:23:53.157+0000 7f337c501640 -1 osd.3 0 log_to_monitors true 2024-07-24T16:23:53.180 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-07-24T16:23:53.177+0000 7ff6bfe0e640 -1 osd.7 0 log_to_monitors true 2024-07-24T16:23:53.214 INFO:tasks.ceph.osd.1.smithi159.stderr:2024-07-24T16:23:53.211+0000 7f90cee1c640 -1 osd.1 0 log_to_monitors true 2024-07-24T16:23:53.219 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-07-24T16:23:53.216+0000 7f49b7fb1640 -1 osd.6 0 log_to_monitors true 2024-07-24T16:23:53.224 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-07-24T16:23:53.222+0000 7f24c7588640 -1 osd.5 0 log_to_monitors true 2024-07-24T16:23:53.224 INFO:tasks.ceph.osd.2.smithi159.stderr:2024-07-24T16:23:53.222+0000 7fa711a18640 -1 osd.2 0 log_to_monitors true 2024-07-24T16:23:53.226 INFO:tasks.ceph.osd.0.smithi159.stderr:2024-07-24T16:23:53.224+0000 7fb76c663640 -1 osd.0 0 log_to_monitors true 2024-07-24T16:23:53.255 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-07-24T16:23:53.253+0000 7fb6b0820640 -1 osd.4 0 log_to_monitors true 2024-07-24T16:23:56.294 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-07-24T16:23:56.292+0000 7f49b3f47640 -1 osd.6 0 waiting for initial osdmap 2024-07-24T16:23:56.310 INFO:tasks.ceph.osd.6.smithi193.stderr:2024-07-24T16:23:56.308+0000 7f49abd66640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T16:23:56.366 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-07-24T16:23:56.363+0000 7fb6ac117640 -1 osd.4 0 waiting for initial osdmap 2024-07-24T16:23:56.379 INFO:tasks.ceph.osd.4.smithi193.stderr:2024-07-24T16:23:56.377+0000 7fb6a3f36640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T16:23:56.441 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-07-24T16:23:56.439+0000 7ff6bbff3640 -1 osd.7 0 waiting for initial osdmap 2024-07-24T16:23:56.455 INFO:tasks.ceph.osd.7.smithi193.stderr:2024-07-24T16:23:56.453+0000 7ff6b35fe640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T16:23:56.493 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-07-24T16:23:56.491+0000 7f24c351e640 -1 osd.5 0 waiting for initial osdmap 2024-07-24T16:23:56.503 INFO:tasks.ceph.osd.0.smithi159.stderr:2024-07-24T16:23:56.499+0000 7fb7685f9640 -1 osd.0 0 waiting for initial osdmap 2024-07-24T16:23:56.508 INFO:tasks.ceph.osd.5.smithi193.stderr:2024-07-24T16:23:56.506+0000 7f24bb33d640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T16:23:56.508 INFO:tasks.ceph.osd.3.smithi159.stderr:2024-07-24T16:23:56.506+0000 7f3378497640 -1 osd.3 0 waiting for initial osdmap 2024-07-24T16:23:56.510 INFO:tasks.ceph.osd.1.smithi159.stderr:2024-07-24T16:23:56.508+0000 7f90ca7a0640 -1 osd.1 0 waiting for initial osdmap 2024-07-24T16:23:56.515 INFO:tasks.ceph.osd.0.smithi159.stderr:2024-07-24T16:23:56.513+0000 7fb760418640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T16:23:56.517 INFO:tasks.ceph.osd.2.smithi159.stderr:2024-07-24T16:23:56.515+0000 7fa70db94640 -1 osd.2 0 waiting for initial osdmap 2024-07-24T16:23:56.520 INFO:tasks.ceph.osd.3.smithi159.stderr:2024-07-24T16:23:56.518+0000 7f33702b6640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T16:23:56.524 INFO:tasks.ceph.osd.1.smithi159.stderr:2024-07-24T16:23:56.522+0000 7f90c25bf640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T16:23:56.529 INFO:tasks.ceph.osd.2.smithi159.stderr:2024-07-24T16:23:56.527+0000 7fa70519f640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-07-24T16:23:57.110 DEBUG:teuthology.orchestra.run.smithi159:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-07-24T16:23:57.207 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.205+0000 7fe12d85e640 1 -- 172.21.15.159:0/1690992373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe114004d40 msgr2=0x7fe1140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:57.208 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.205+0000 7fe12d85e640 1 --2- 172.21.15.159:0/1690992373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe114004d40 0x7fe1140051c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe12000bb20 tx=0x7fe114005830 comp rx=0 tx=0).stop 2024-07-24T16:23:57.208 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.205+0000 7fe1277fe640 1 -- 172.21.15.159:0/1690992373 reap_dead start 2024-07-24T16:23:57.208 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.205+0000 7fe12d85e640 1 -- 172.21.15.159:0/1690992373 shutdown_connections 2024-07-24T16:23:57.208 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.205+0000 7fe12d85e640 1 -- 172.21.15.159:0/1690992373 >> 172.21.15.159:0/1690992373 conn(0x7fe1280b52d0 msgr2=0x7fe1280b56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:57.208 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.205+0000 7fe12d85e640 1 -- 172.21.15.159:0/1690992373 shutdown_connections 2024-07-24T16:23:57.208 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.205+0000 7fe12d85e640 1 -- 172.21.15.159:0/1690992373 wait complete. 2024-07-24T16:23:57.208 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.206+0000 7fe12d85e640 1 Processor -- start 2024-07-24T16:23:57.208 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.206+0000 7fe12d85e640 1 -- start start 2024-07-24T16:23:57.211 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe12d85e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe114004d40 0x7fe1280ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:57.211 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe12d85e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe12815c2a0 0x7fe12815c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:57.211 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe12d85e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe12815ce70 0x7fe1281e7a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:57.211 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe12d85e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe1280d1e40 con 0x7fe12815c2a0 2024-07-24T16:23:57.211 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe12d85e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe1280b2ed0 con 0x7fe114004d40 2024-07-24T16:23:57.211 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe12d85e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe1280d1fc0 con 0x7fe12815ce70 2024-07-24T16:23:57.211 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe1267fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe12815c2a0 0x7fe12815c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:57.211 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe1267fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe12815c2a0 0x7fe12815c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44736/0 (socket says 172.21.15.159:44736) 2024-07-24T16:23:57.212 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe1267fc640 1 -- 172.21.15.159:0/1209447418 learned_addr learned my addr 172.21.15.159:0/1209447418 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:57.212 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe126ffd640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe114004d40 0x7fe1280ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:57.212 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe1277fe640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe12815ce70 0x7fe1281e7a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:57.212 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe1267fc640 1 -- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe12815ce70 msgr2=0x7fe1281e7a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:57.212 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe1267fc640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe12815ce70 0x7fe1281e7a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.212 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe1267fc640 1 -- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe114004d40 msgr2=0x7fe1280ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:57.212 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe1267fc640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe114004d40 0x7fe1280ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.212 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe1267fc640 1 -- 172.21.15.159:0/1209447418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1280ccec0 con 0x7fe12815c2a0 2024-07-24T16:23:57.212 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe1267fc640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe12815c2a0 0x7fe12815c930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe11000b630 tx=0x7fe11000baf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:57.212 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe11ffff640 1 -- 172.21.15.159:0/1209447418 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe110010b10 con 0x7fe12815c2a0 2024-07-24T16:23:57.212 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe11ffff640 1 -- 172.21.15.159:0/1209447418 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe110015070 con 0x7fe12815c2a0 2024-07-24T16:23:57.212 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.207+0000 7fe12d85e640 1 -- 172.21.15.159:0/1209447418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe12815c720 con 0x7fe12815c2a0 2024-07-24T16:23:57.212 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.208+0000 7fe11ffff640 1 -- 172.21.15.159:0/1209447418 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe11001a470 con 0x7fe12815c2a0 2024-07-24T16:23:57.213 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.208+0000 7fe12d85e640 1 -- 172.21.15.159:0/1209447418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1280cd1c0 con 0x7fe12815c2a0 2024-07-24T16:23:57.213 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.209+0000 7fe12d85e640 1 -- 172.21.15.159:0/1209447418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1280d10f0 con 0x7fe12815c2a0 2024-07-24T16:23:57.213 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.209+0000 7fe11ffff640 1 -- 172.21.15.159:0/1209447418 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) ==== 99083+0+0 (secure 0 0 0) 0x7fe11001a610 con 0x7fe12815c2a0 2024-07-24T16:23:57.213 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.209+0000 7fe11ffff640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe108076fb0 0x7fe108079470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:57.214 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.210+0000 7fe11ffff640 1 -- 172.21.15.159:0/1209447418 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fe1100985f0 con 0x7fe12815c2a0 2024-07-24T16:23:57.214 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.210+0000 7fe126ffd640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe108076fb0 0x7fe108079470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:57.214 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.210+0000 7fe126ffd640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe108076fb0 0x7fe108079470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe118001390 tx=0x7fe118002070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:57.216 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.214+0000 7fe11ffff640 1 -- 172.21.15.159:0/1209447418 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fe1280ccec0 con 0x7fe12815c2a0 2024-07-24T16:23:57.410 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.407+0000 7fe12d85e640 1 -- 172.21.15.159:0/1209447418 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe128160600 con 0x7fe12815c2a0 2024-07-24T16:23:57.410 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.407+0000 7fe11ffff640 1 -- 172.21.15.159:0/1209447418 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10945 (secure 0 0 0) 0x7fe1100620a0 con 0x7fe12815c2a0 2024-07-24T16:23:57.410 INFO:teuthology.misc.health.smithi159.stdout: 2024-07-24T16:23:57.410 INFO:teuthology.misc.health.smithi159.stdout:{"epoch":13,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:23:57.295150+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:23:57.412 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.409+0000 7fe12d85e640 1 -- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe108076fb0 msgr2=0x7fe108079470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:57.413 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.409+0000 7fe12d85e640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe108076fb0 0x7fe108079470 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe118001390 tx=0x7fe118002070 comp rx=0 tx=0).stop 2024-07-24T16:23:57.413 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.409+0000 7fe12d85e640 1 -- 172.21.15.159:0/1209447418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe12815c2a0 msgr2=0x7fe12815c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:57.413 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.409+0000 7fe12d85e640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe12815c2a0 0x7fe12815c930 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe11000b630 tx=0x7fe11000baf0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.413 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.409+0000 7fe12d85e640 1 -- 172.21.15.159:0/1209447418 shutdown_connections 2024-07-24T16:23:57.413 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.409+0000 7fe12d85e640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe108076fb0 0x7fe108079470 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.413 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.409+0000 7fe12d85e640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe12815ce70 0x7fe1281e7a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.413 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.409+0000 7fe12d85e640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe12815c2a0 0x7fe12815c930 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.413 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.409+0000 7fe12d85e640 1 --2- 172.21.15.159:0/1209447418 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe114004d40 0x7fe1280ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.413 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.409+0000 7fe12d85e640 1 -- 172.21.15.159:0/1209447418 >> 172.21.15.159:0/1209447418 conn(0x7fe1280b52d0 msgr2=0x7fe1280b7190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:57.413 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.410+0000 7fe12d85e640 1 -- 172.21.15.159:0/1209447418 shutdown_connections 2024-07-24T16:23:57.413 INFO:teuthology.misc.health.smithi159.stderr:2024-07-24T16:23:57.410+0000 7fe12d85e640 1 -- 172.21.15.159:0/1209447418 wait complete. 2024-07-24T16:23:57.421 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-07-24T16:23:57.422 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-07-24T16:23:57.422 INFO:tasks.ceph.mds.a:Restarting daemon 2024-07-24T16:23:57.422 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-07-24T16:23:57.424 INFO:tasks.ceph.mds.a:Started 2024-07-24T16:23:57.425 INFO:tasks.ceph.mds.c:Restarting daemon 2024-07-24T16:23:57.425 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-07-24T16:23:57.427 INFO:tasks.ceph.mds.c:Started 2024-07-24T16:23:57.427 INFO:tasks.ceph.mds.b:Restarting daemon 2024-07-24T16:23:57.427 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-07-24T16:23:57.429 INFO:tasks.ceph.mds.b:Started 2024-07-24T16:23:57.430 INFO:tasks.ceph.mds.d:Restarting daemon 2024-07-24T16:23:57.430 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-07-24T16:23:57.432 INFO:tasks.ceph.mds.d:Started 2024-07-24T16:23:57.432 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-07-24T16:23:57.433 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:23:57.499 INFO:tasks.ceph.mds.a.smithi159.stdout:starting mds.a at 2024-07-24T16:23:57.500 INFO:tasks.ceph.mds.c.smithi159.stdout:starting mds.c at 2024-07-24T16:23:57.515 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-07-24T16:23:57.515 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-07-24T16:23:57.515 INFO:tasks.ceph.mds.d.smithi193.stderr:2024-07-24T16:23:57.513+0000 7f4933547640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-07-24T16:23:57.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.539+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/2790630862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c740d0fc0 msgr2=0x7f8c74071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:57.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.539+0000 7f8c7a1bb640 1 --2- 172.21.15.159:0/2790630862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c740d0fc0 0x7f8c74071ca0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8c740d15c0 tx=0x7f8c6802a410 comp rx=0 tx=0).stop 2024-07-24T16:23:57.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.539+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/2790630862 shutdown_connections 2024-07-24T16:23:57.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.539+0000 7f8c7a1bb640 1 --2- 172.21.15.159:0/2790630862 >> v2:172.21.15.193:3300/0 conn(0x7f8c740721e0 0x7f8c74073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.539+0000 7f8c7a1bb640 1 --2- 172.21.15.159:0/2790630862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c740d0fc0 0x7f8c74071ca0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.539+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/2790630862 >> 172.21.15.159:0/2790630862 conn(0x7f8c740b33c0 msgr2=0x7f8c740b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:57.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.539+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/2790630862 shutdown_connections 2024-07-24T16:23:57.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.539+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/2790630862 wait complete. 2024-07-24T16:23:57.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.540+0000 7f8c7a1bb640 1 Processor -- start 2024-07-24T16:23:57.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.541+0000 7f8c7a1bb640 1 -- start start 2024-07-24T16:23:57.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.541+0000 7f8c7a1bb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c740721e0 0x7f8c740ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:57.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.541+0000 7f8c7a1bb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c740b66e0 0x7f8c740ae580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:57.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.541+0000 7f8c7a1bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c740d0fc0 0x7f8c741488c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:57.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.541+0000 7f8c7a1bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8c74074470 con 0x7f8c740d0fc0 2024-07-24T16:23:57.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.541+0000 7f8c7a1bb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c740742f0 con 0x7f8c740721e0 2024-07-24T16:23:57.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.541+0000 7f8c7a1bb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8c740b6c00 con 0x7f8c740b66e0 2024-07-24T16:23:57.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.541+0000 7f8c73fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c740d0fc0 0x7f8c741488c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:57.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.541+0000 7f8c73fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c740d0fc0 0x7f8c741488c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44786/0 (socket says 172.21.15.159:44786) 2024-07-24T16:23:57.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c737fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c740721e0 0x7f8c740ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:57.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c73fff640 1 -- 172.21.15.159:0/686499103 learned_addr learned my addr 172.21.15.159:0/686499103 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:57.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c72ffd640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c740b66e0 0x7f8c740ae580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:57.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c73fff640 1 -- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c740b66e0 msgr2=0x7f8c740ae580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:57.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c73fff640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c740b66e0 0x7f8c740ae580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c73fff640 1 -- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c740721e0 msgr2=0x7f8c740ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:57.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c73fff640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c740721e0 0x7f8c740ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c73fff640 1 -- 172.21.15.159:0/686499103 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7406dce0 con 0x7f8c740d0fc0 2024-07-24T16:23:57.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c737fe640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c740721e0 0x7f8c740ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:23:57.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c73fff640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c740d0fc0 0x7f8c741488c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00ead0 tx=0x7f8c6c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:57.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c5bfff640 1 -- 172.21.15.159:0/686499103 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00cde0 con 0x7f8c740d0fc0 2024-07-24T16:23:57.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c5bfff640 1 -- 172.21.15.159:0/686499103 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c6c004c10 con 0x7f8c740d0fc0 2024-07-24T16:23:57.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/686499103 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c7406dfc0 con 0x7f8c740d0fc0 2024-07-24T16:23:57.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.542+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/686499103 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c7406e580 con 0x7f8c740d0fc0 2024-07-24T16:23:57.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.543+0000 7f8c5bfff640 1 -- 172.21.15.159:0/686499103 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c00cde0 con 0x7f8c740d0fc0 2024-07-24T16:23:57.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.543+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/686499103 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c740cedc0 con 0x7f8c740d0fc0 2024-07-24T16:23:57.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.544+0000 7f8c5bfff640 1 -- 172.21.15.159:0/686499103 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) ==== 99083+0+0 (secure 0 0 0) 0x7f8c6c024480 con 0x7f8c740d0fc0 2024-07-24T16:23:57.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.544+0000 7f8c5bfff640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c60077380 0x7f8c60079840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:57.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.545+0000 7f8c5bfff640 1 -- 172.21.15.159:0/686499103 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f8c6c00cbe0 con 0x7f8c740d0fc0 2024-07-24T16:23:57.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.545+0000 7f8c737fe640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c60077380 0x7f8c60079840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:57.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.545+0000 7f8c737fe640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c60077380 0x7f8c60079840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8c64001bb0 tx=0x7f8c64007e90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:57.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.548+0000 7f8c5bfff640 1 -- 172.21.15.159:0/686499103 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f8c740cedc0 con 0x7f8c740d0fc0 2024-07-24T16:23:57.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.768+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/686499103 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c74155ed0 con 0x7f8c740d0fc0 2024-07-24T16:23:57.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.769+0000 7f8c5bfff640 1 -- 172.21.15.159:0/686499103 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1437 (secure 0 0 0) 0x7f8c74155ed0 con 0x7f8c740d0fc0 2024-07-24T16:23:57.772 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:23:57.772 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":2,"btime":"2024-07-24T16:23:57:502264+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3191234203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3191234203},{"type":"v1","addr":"172.21.15.159:6833","nonce":3191234203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-07-24T16:23:57.772 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 2 2024-07-24T16:23:57.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.771+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c60077380 msgr2=0x7f8c60079840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:57.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.771+0000 7f8c7a1bb640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c60077380 0x7f8c60079840 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8c64001bb0 tx=0x7f8c64007e90 comp rx=0 tx=0).stop 2024-07-24T16:23:57.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.771+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/686499103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c740d0fc0 msgr2=0x7f8c741488c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:57.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.771+0000 7f8c7a1bb640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c740d0fc0 0x7f8c741488c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c00ead0 tx=0x7f8c6c00ef90 comp rx=0 tx=0).stop 2024-07-24T16:23:57.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.771+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/686499103 shutdown_connections 2024-07-24T16:23:57.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.771+0000 7f8c7a1bb640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c60077380 0x7f8c60079840 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.771+0000 7f8c7a1bb640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c740d0fc0 0x7f8c741488c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.771+0000 7f8c7a1bb640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c740b66e0 0x7f8c740ae580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.771+0000 7f8c7a1bb640 1 --2- 172.21.15.159:0/686499103 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c740721e0 0x7f8c740ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:57.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.771+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/686499103 >> 172.21.15.159:0/686499103 conn(0x7f8c740b33c0 msgr2=0x7f8c7415aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:57.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.771+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/686499103 shutdown_connections 2024-07-24T16:23:57.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:57.771+0000 7f8c7a1bb640 1 -- 172.21.15.159:0/686499103 wait complete. 2024-07-24T16:23:59.784 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:23:59.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.898+0000 7fbd4c06c640 1 -- 172.21.15.159:0/108924783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd44157130 msgr2=0x7fbd440cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:59.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.898+0000 7fbd4c06c640 1 --2- 172.21.15.159:0/108924783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd44157130 0x7fbd440cf500 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbd4000a940 tx=0x7fbd4002b7b0 comp rx=0 tx=0).stop 2024-07-24T16:23:59.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.898+0000 7fbd4c06c640 1 -- 172.21.15.159:0/108924783 shutdown_connections 2024-07-24T16:23:59.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.898+0000 7fbd4c06c640 1 --2- 172.21.15.159:0/108924783 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd44157130 0x7fbd440cf500 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:59.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.898+0000 7fbd4c06c640 1 -- 172.21.15.159:0/108924783 >> 172.21.15.159:0/108924783 conn(0x7fbd4406c560 msgr2=0x7fbd4406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:23:59.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.898+0000 7fbd4c06c640 1 -- 172.21.15.159:0/108924783 shutdown_connections 2024-07-24T16:23:59.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.898+0000 7fbd4c06c640 1 -- 172.21.15.159:0/108924783 wait complete. 2024-07-24T16:23:59.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.899+0000 7fbd4c06c640 1 Processor -- start 2024-07-24T16:23:59.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.899+0000 7fbd4c06c640 1 -- start start 2024-07-24T16:23:59.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd4c06c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd4406e360 0x7fbd440ccf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:59.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd4c06c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd44157130 0x7fbd4413a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:59.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd4c06c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbd44157510 0x7fbd440cb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:59.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd4c06c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbd440cfbc0 con 0x7fbd4406e360 2024-07-24T16:23:59.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd4c06c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbd440cfa40 con 0x7fbd44157130 2024-07-24T16:23:59.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd4c06c640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbd440cfd40 con 0x7fbd44157510 2024-07-24T16:23:59.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd49e08640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd4406e360 0x7fbd440ccf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:59.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd49e08640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd4406e360 0x7fbd440ccf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44812/0 (socket says 172.21.15.159:44812) 2024-07-24T16:23:59.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd49e08640 1 -- 172.21.15.159:0/2143475932 learned_addr learned my addr 172.21.15.159:0/2143475932 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:23:59.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd49607640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd44157130 0x7fbd4413a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:59.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd4a609640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbd44157510 0x7fbd440cb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:59.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd49e08640 1 -- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbd44157510 msgr2=0x7fbd440cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:59.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd49e08640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbd44157510 0x7fbd440cb6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:59.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd49e08640 1 -- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd44157130 msgr2=0x7fbd4413a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:23:59.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd49e08640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd44157130 0x7fbd4413a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:23:59.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd49e08640 1 -- 172.21.15.159:0/2143475932 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd4413ae00 con 0x7fbd4406e360 2024-07-24T16:23:59.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd49e08640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd4406e360 0x7fbd440ccf10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd40000c00 tx=0x7fbd40004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:59.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.900+0000 7fbd3a7fc640 1 -- 172.21.15.159:0/2143475932 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40003a00 con 0x7fbd4406e360 2024-07-24T16:23:59.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.901+0000 7fbd3a7fc640 1 -- 172.21.15.159:0/2143475932 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbd40003c90 con 0x7fbd4406e360 2024-07-24T16:23:59.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.901+0000 7fbd4c06c640 1 -- 172.21.15.159:0/2143475932 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd440cd5b0 con 0x7fbd4406e360 2024-07-24T16:23:59.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.901+0000 7fbd3a7fc640 1 -- 172.21.15.159:0/2143475932 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4003c670 con 0x7fbd4406e360 2024-07-24T16:23:59.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.901+0000 7fbd4c06c640 1 -- 172.21.15.159:0/2143475932 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd440cdb70 con 0x7fbd4406e360 2024-07-24T16:23:59.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.902+0000 7fbd4c06c640 1 -- 172.21.15.159:0/2143475932 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd440cf500 con 0x7fbd4406e360 2024-07-24T16:23:59.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.902+0000 7fbd3a7fc640 1 -- 172.21.15.159:0/2143475932 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) ==== 99083+0+0 (secure 0 0 0) 0x7fbd4003c810 con 0x7fbd4406e360 2024-07-24T16:23:59.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.902+0000 7fbd3a7fc640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbd28076f80 0x7fbd28079440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:23:59.907 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.903+0000 7fbd3a7fc640 1 -- 172.21.15.159:0/2143475932 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7fbd400b9c00 con 0x7fbd4406e360 2024-07-24T16:23:59.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.903+0000 7fbd49607640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbd28076f80 0x7fbd28079440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:23:59.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.903+0000 7fbd49607640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbd28076f80 0x7fbd28079440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b2820 tx=0x7fbd34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:23:59.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:23:59.907+0000 7fbd3a7fc640 1 -- 172.21.15.159:0/2143475932 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fbd40040030 con 0x7fbd4406e360 2024-07-24T16:24:00.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.124+0000 7fbd4c06c640 1 -- 172.21.15.159:0/2143475932 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd440b4810 con 0x7fbd4406e360 2024-07-24T16:24:00.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.125+0000 7fbd3a7fc640 1 -- 172.21.15.159:0/2143475932 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3918 (secure 0 0 0) 0x7fbd400832d0 con 0x7fbd4406e360 2024-07-24T16:24:00.128 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:00.129 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":3,"btime":"2024-07-24T16:23:58:503441+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1307622320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1307622320},{"type":"v1","addr":"172.21.15.193:6837","nonce":1307622320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3191234203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3191234203},{"type":"v1","addr":"172.21.15.159:6833","nonce":3191234203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4336,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4102467909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":4102467909},{"type":"v1","addr":"172.21.15.159:6835","nonce":4102467909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4348,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1274628948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1274628948},{"type":"v1","addr":"172.21.15.193:6836","nonce":1274628948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-07-24T16:24:00.129 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 3 2024-07-24T16:24:00.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.127+0000 7fbd4c06c640 1 -- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbd28076f80 msgr2=0x7fbd28079440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:00.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.127+0000 7fbd4c06c640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbd28076f80 0x7fbd28079440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fbd440b2820 tx=0x7fbd34009040 comp rx=0 tx=0).stop 2024-07-24T16:24:00.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.127+0000 7fbd4c06c640 1 -- 172.21.15.159:0/2143475932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd4406e360 msgr2=0x7fbd440ccf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:00.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.127+0000 7fbd4c06c640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd4406e360 0x7fbd440ccf10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fbd40000c00 tx=0x7fbd40004430 comp rx=0 tx=0).stop 2024-07-24T16:24:00.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.127+0000 7fbd4c06c640 1 -- 172.21.15.159:0/2143475932 shutdown_connections 2024-07-24T16:24:00.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.127+0000 7fbd4c06c640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbd28076f80 0x7fbd28079440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.127+0000 7fbd4c06c640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbd44157510 0x7fbd440cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.127+0000 7fbd4c06c640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbd44157130 0x7fbd4413a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.127+0000 7fbd4c06c640 1 --2- 172.21.15.159:0/2143475932 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbd4406e360 0x7fbd440ccf10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.127+0000 7fbd4c06c640 1 -- 172.21.15.159:0/2143475932 >> 172.21.15.159:0/2143475932 conn(0x7fbd4406c560 msgr2=0x7fbd44073260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:00.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.127+0000 7fbd4c06c640 1 -- 172.21.15.159:0/2143475932 shutdown_connections 2024-07-24T16:24:00.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.127+0000 7fbd4c06c640 1 -- 172.21.15.159:0/2143475932 wait complete. 2024-07-24T16:24:00.140 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-07-24T16:24:00.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.241+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2470724261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1e00b0b60 msgr2=0x7ff1e00cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:00.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.241+0000 7ff1e4ce9640 1 --2- 172.21.15.159:0/2470724261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1e00b0b60 0x7ff1e00cf770 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ff1e008c710 tx=0x7ff1d802aa30 comp rx=0 tx=0).stop 2024-07-24T16:24:00.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.241+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2470724261 shutdown_connections 2024-07-24T16:24:00.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.241+0000 7ff1e4ce9640 1 --2- 172.21.15.159:0/2470724261 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1e00b0b60 0x7ff1e00cf770 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.241+0000 7ff1e4ce9640 1 --2- 172.21.15.159:0/2470724261 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1e00b2ae0 0x7ff1e00b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.241+0000 7ff1e4ce9640 1 --2- 172.21.15.159:0/2470724261 >> v2:172.21.15.193:3300/0 conn(0x7ff1e015d950 0x7ff1e0161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.241+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2470724261 >> 172.21.15.159:0/2470724261 conn(0x7ff1e009cd30 msgr2=0x7ff1e00d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:00.244 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.241+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2470724261 shutdown_connections 2024-07-24T16:24:00.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.241+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2470724261 wait complete. 2024-07-24T16:24:00.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.242+0000 7ff1e4ce9640 1 Processor -- start 2024-07-24T16:24:00.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.242+0000 7ff1e4ce9640 1 -- start start 2024-07-24T16:24:00.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1e4ce9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1e00b0b60 0x7ff1e00cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:00.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1e4ce9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1e00b2ae0 0x7ff1e006d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:00.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1e4ce9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1e015d950 0x7ff1e0151ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:00.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1e4ce9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e00d0040 con 0x7ff1e015d950 2024-07-24T16:24:00.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1e4ce9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff1e00cfec0 con 0x7ff1e00b0b60 2024-07-24T16:24:00.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1e4ce9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff1e00d02e0 con 0x7ff1e00b2ae0 2024-07-24T16:24:00.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1ded9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1e015d950 0x7ff1e0151ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:00.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1ded9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1e015d950 0x7ff1e0151ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44826/0 (socket says 172.21.15.159:44826) 2024-07-24T16:24:00.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1ded9d640 1 -- 172.21.15.159:0/2144805980 learned_addr learned my addr 172.21.15.159:0/2144805980 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:00.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1de59c640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1e00b0b60 0x7ff1e00cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:00.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1d7fff640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1e00b2ae0 0x7ff1e006d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:00.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1ded9d640 1 -- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1e00b2ae0 msgr2=0x7ff1e006d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:00.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1ded9d640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1e00b2ae0 0x7ff1e006d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1ded9d640 1 -- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1e00b0b60 msgr2=0x7ff1e00cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:00.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1ded9d640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1e00b0b60 0x7ff1e00cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1ded9d640 1 -- 172.21.15.159:0/2144805980 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1e00cb0a0 con 0x7ff1e015d950 2024-07-24T16:24:00.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.243+0000 7ff1ded9d640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1e015d950 0x7ff1e0151ae0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8005fd0 tx=0x7ff1d8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:00.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.244+0000 7ff1d6ffd640 1 -- 172.21.15.159:0/2144805980 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8046070 con 0x7ff1e015d950 2024-07-24T16:24:00.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.244+0000 7ff1d6ffd640 1 -- 172.21.15.159:0/2144805980 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff1d80042d0 con 0x7ff1e015d950 2024-07-24T16:24:00.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.244+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2144805980 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1e00cdc30 con 0x7ff1e015d950 2024-07-24T16:24:00.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.244+0000 7ff1d6ffd640 1 -- 172.21.15.159:0/2144805980 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1d8033050 con 0x7ff1e015d950 2024-07-24T16:24:00.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.244+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2144805980 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1e00b4a30 con 0x7ff1e015d950 2024-07-24T16:24:00.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.245+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2144805980 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1e00b4c30 con 0x7ff1e015d950 2024-07-24T16:24:00.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.245+0000 7ff1d6ffd640 1 -- 172.21.15.159:0/2144805980 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) ==== 99083+0+0 (secure 0 0 0) 0x7ff1d8049070 con 0x7ff1e015d950 2024-07-24T16:24:00.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.246+0000 7ff1d6ffd640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff1c0076f80 0x7ff1c0079440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:00.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.246+0000 7ff1d6ffd640 1 -- 172.21.15.159:0/2144805980 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 4846+0+0 (secure 0 0 0) 0x7ff1d80b92f0 con 0x7ff1e015d950 2024-07-24T16:24:00.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.246+0000 7ff1de59c640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff1c0076f80 0x7ff1c0079440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:00.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.246+0000 7ff1de59c640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff1c0076f80 0x7ff1c0079440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0005fd0 tx=0x7ff1d000a250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:00.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.250+0000 7ff1d6ffd640 1 -- 172.21.15.159:0/2144805980 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7ff1e00b4c30 con 0x7ff1e015d950 2024-07-24T16:24:00.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.434+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2144805980 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ff1e00b0620 con 0x7ff1e015d950 2024-07-24T16:24:00.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.434+0000 7ff1d6ffd640 1 -- 172.21.15.159:0/2144805980 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7ff1d8082400 con 0x7ff1e015d950 2024-07-24T16:24:00.437 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:00.437 INFO:teuthology.orchestra.run.smithi159.stdout:[ 2024-07-24T16:24:00.438 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:00.438 INFO:teuthology.orchestra.run.smithi159.stdout: "poolnum": 1, 2024-07-24T16:24:00.438 INFO:teuthology.orchestra.run.smithi159.stdout: "poolname": ".mgr" 2024-07-24T16:24:00.438 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:00.438 INFO:teuthology.orchestra.run.smithi159.stdout:] 2024-07-24T16:24:00.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.436+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff1c0076f80 msgr2=0x7ff1c0079440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:00.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.436+0000 7ff1e4ce9640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff1c0076f80 0x7ff1c0079440 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0005fd0 tx=0x7ff1d000a250 comp rx=0 tx=0).stop 2024-07-24T16:24:00.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.436+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2144805980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1e015d950 msgr2=0x7ff1e0151ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:00.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.436+0000 7ff1e4ce9640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1e015d950 0x7ff1e0151ae0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8005fd0 tx=0x7ff1d8003f10 comp rx=0 tx=0).stop 2024-07-24T16:24:00.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.436+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2144805980 shutdown_connections 2024-07-24T16:24:00.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.436+0000 7ff1e4ce9640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff1c0076f80 0x7ff1c0079440 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.436+0000 7ff1e4ce9640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff1e015d950 0x7ff1e0151ae0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.436+0000 7ff1e4ce9640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff1e00b2ae0 0x7ff1e006d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.436+0000 7ff1e4ce9640 1 --2- 172.21.15.159:0/2144805980 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff1e00b0b60 0x7ff1e00cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.436+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2144805980 >> 172.21.15.159:0/2144805980 conn(0x7ff1e009cd30 msgr2=0x7ff1e015ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:00.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.436+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2144805980 shutdown_connections 2024-07-24T16:24:00.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.436+0000 7ff1e4ce9640 1 -- 172.21.15.159:0/2144805980 wait complete. 2024-07-24T16:24:00.450 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-07-24T16:24:00.450 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-07-24T16:24:00.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.553+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/6275002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0004d90 msgr2=0x7fb4e0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:00.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.553+0000 7fb4fa0cb640 1 --2- 172.21.15.159:0/6275002 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4e0004d90 0x7fb4e0005210 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec005fd0 tx=0x7fb4e0005830 comp rx=0 tx=0).stop 2024-07-24T16:24:00.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.553+0000 7fb4f3fff640 1 -- 172.21.15.159:0/6275002 reap_dead start 2024-07-24T16:24:00.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.553+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/6275002 shutdown_connections 2024-07-24T16:24:00.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.553+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/6275002 >> 172.21.15.159:0/6275002 conn(0x7fb4f406c560 msgr2=0x7fb4f406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:00.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.553+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/6275002 shutdown_connections 2024-07-24T16:24:00.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.553+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/6275002 wait complete. 2024-07-24T16:24:00.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.555+0000 7fb4fa0cb640 1 Processor -- start 2024-07-24T16:24:00.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.555+0000 7fb4fa0cb640 1 -- start start 2024-07-24T16:24:00.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.555+0000 7fb4fa0cb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4e0004d90 0x7fb4f40ac6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:00.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.555+0000 7fb4fa0cb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4f40adf20 0x7fb4f41532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:00.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.555+0000 7fb4fa0cb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4f4155750 0x7fb4f40b0b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:00.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4fa0cb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f40cdbd0 con 0x7fb4f4155750 2024-07-24T16:24:00.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4fa0cb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f40cdd50 con 0x7fb4f40adf20 2024-07-24T16:24:00.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4fa0cb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb4f40cded0 con 0x7fb4e0004d90 2024-07-24T16:24:00.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4f3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4f4155750 0x7fb4f40b0b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:00.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4f3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4f4155750 0x7fb4f40b0b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44838/0 (socket says 172.21.15.159:44838) 2024-07-24T16:24:00.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4f3fff640 1 -- 172.21.15.159:0/2426566056 learned_addr learned my addr 172.21.15.159:0/2426566056 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:00.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4eaffd640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4f40adf20 0x7fb4f41532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:00.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4f37fe640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4e0004d90 0x7fb4f40ac6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:00.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4f3fff640 1 -- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4e0004d90 msgr2=0x7fb4f40ac6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:00.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4f3fff640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4e0004d90 0x7fb4f40ac6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4f3fff640 1 -- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4f40adf20 msgr2=0x7fb4f41532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:00.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4f3fff640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4f40adf20 0x7fb4f41532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:00.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4f3fff640 1 -- 172.21.15.159:0/2426566056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f40acc20 con 0x7fb4f4155750 2024-07-24T16:24:00.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4f3fff640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4f4155750 0x7fb4f40b0b30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec002230 tx=0x7fb4ec02bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:00.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4f0ff9640 1 -- 172.21.15.159:0/2426566056 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec043070 con 0x7fb4f4155750 2024-07-24T16:24:00.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4f0ff9640 1 -- 172.21.15.159:0/2426566056 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4ec003970 con 0x7fb4f4155750 2024-07-24T16:24:00.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/2426566056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f40ae3b0 con 0x7fb4f4155750 2024-07-24T16:24:00.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4f0ff9640 1 -- 172.21.15.159:0/2426566056 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4ec038040 con 0x7fb4f4155750 2024-07-24T16:24:00.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.556+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/2426566056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f4155230 con 0x7fb4f4155750 2024-07-24T16:24:00.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.557+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/2426566056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f40ce430 con 0x7fb4f4155750 2024-07-24T16:24:00.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.558+0000 7fb4f0ff9640 1 -- 172.21.15.159:0/2426566056 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) ==== 99083+0+0 (secure 0 0 0) 0x7fb4ec046070 con 0x7fb4f4155750 2024-07-24T16:24:00.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.558+0000 7fb4f0ff9640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb4d4076fb0 0x7fb4d4079470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:00.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.558+0000 7fb4f0ff9640 1 -- 172.21.15.159:0/2426566056 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb4ec0b7f60 con 0x7fb4f4155750 2024-07-24T16:24:00.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.559+0000 7fb4f37fe640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb4d4076fb0 0x7fb4d4079470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:00.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.559+0000 7fb4f37fe640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb4d4076fb0 0x7fb4d4079470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4000c00 tx=0x7fb4e4006b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:00.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.563+0000 7fb4f0ff9640 1 -- 172.21.15.159:0/2426566056 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fb4ec080fd0 con 0x7fb4f4155750 2024-07-24T16:24:00.755 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:00.753+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/2426566056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb4f40b4280 con 0x7fb4f4155750 2024-07-24T16:24:01.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.387+0000 7fb4f0ff9640 1 -- 172.21.15.159:0/2426566056 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7fb4ec085520 con 0x7fb4f4155750 2024-07-24T16:24:01.390 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_metadata' created 2024-07-24T16:24:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.390+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb4d4076fb0 msgr2=0x7fb4d4079470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.390+0000 7fb4fa0cb640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb4d4076fb0 0x7fb4d4079470 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4000c00 tx=0x7fb4e4006b70 comp rx=0 tx=0).stop 2024-07-24T16:24:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.390+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/2426566056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4f4155750 msgr2=0x7fb4f40b0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.390+0000 7fb4fa0cb640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4f4155750 0x7fb4f40b0b30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb4ec002230 tx=0x7fb4ec02bf90 comp rx=0 tx=0).stop 2024-07-24T16:24:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.390+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/2426566056 shutdown_connections 2024-07-24T16:24:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.390+0000 7fb4fa0cb640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb4d4076fb0 0x7fb4d4079470 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.390+0000 7fb4fa0cb640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4f4155750 0x7fb4f40b0b30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.390+0000 7fb4fa0cb640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4f40adf20 0x7fb4f41532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.390+0000 7fb4fa0cb640 1 --2- 172.21.15.159:0/2426566056 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4e0004d90 0x7fb4f40ac6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:01.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.390+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/2426566056 >> 172.21.15.159:0/2426566056 conn(0x7fb4f406c560 msgr2=0x7fb4f40af2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:01.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.390+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/2426566056 shutdown_connections 2024-07-24T16:24:01.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.390+0000 7fb4fa0cb640 1 -- 172.21.15.159:0/2426566056 wait complete. 2024-07-24T16:24:01.406 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-07-24T16:24:01.516 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.514+0000 7fcdd77ec640 1 -- 172.21.15.159:0/362262247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdd00ce310 msgr2=0x7fcdd006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:01.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.514+0000 7fcdd77ec640 1 --2- 172.21.15.159:0/362262247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdd00ce310 0x7fcdd006c940 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0009830 tx=0x7fcdc002a5c0 comp rx=0 tx=0).stop 2024-07-24T16:24:01.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.514+0000 7fcdd77ec640 1 -- 172.21.15.159:0/362262247 shutdown_connections 2024-07-24T16:24:01.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.514+0000 7fcdd77ec640 1 --2- 172.21.15.159:0/362262247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdd00ce310 0x7fcdd006c940 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:01.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.514+0000 7fcdd77ec640 1 -- 172.21.15.159:0/362262247 >> 172.21.15.159:0/362262247 conn(0x7fcdd00b2230 msgr2=0x7fcdd00b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:01.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.514+0000 7fcdd77ec640 1 -- 172.21.15.159:0/362262247 shutdown_connections 2024-07-24T16:24:01.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.514+0000 7fcdd77ec640 1 -- 172.21.15.159:0/362262247 wait complete. 2024-07-24T16:24:01.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.515+0000 7fcdd77ec640 1 Processor -- start 2024-07-24T16:24:01.517 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.515+0000 7fcdd77ec640 1 -- start start 2024-07-24T16:24:01.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd77ec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdd006c560 0x7fcdd014eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd77ec640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdd0070610 0x7fcdd0150b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd77ec640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcdd00ce310 0x7fcdd015d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd77ec640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd00712d0 con 0x7fcdd006c560 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd77ec640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcdd0071150 con 0x7fcdd0070610 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd77ec640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcdd0071450 con 0x7fcdd00ce310 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd5588640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdd006c560 0x7fcdd014eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd5588640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdd006c560 0x7fcdd014eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43618/0 (socket says 172.21.15.159:43618) 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd5588640 1 -- 172.21.15.159:0/2349719848 learned_addr learned my addr 172.21.15.159:0/2349719848 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd4d87640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdd0070610 0x7fcdd0150b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd5d89640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcdd00ce310 0x7fcdd015d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd5588640 1 -- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcdd00ce310 msgr2=0x7fcdd015d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd5588640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcdd00ce310 0x7fcdd015d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd5588640 1 -- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdd0070610 msgr2=0x7fcdd0150b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:01.520 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd5588640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdd0070610 0x7fcdd0150b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd5588640 1 -- 172.21.15.159:0/2349719848 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdd01e65b0 con 0x7fcdd006c560 2024-07-24T16:24:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd5588640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdd006c560 0x7fcdd014eb80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00c400 tx=0x7fcdcc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdc5ffb640 1 -- 172.21.15.159:0/2349719848 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc017070 con 0x7fcdd006c560 2024-07-24T16:24:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdc5ffb640 1 -- 172.21.15.159:0/2349719848 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcdcc0053c0 con 0x7fcdd006c560 2024-07-24T16:24:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdd77ec640 1 -- 172.21.15.159:0/2349719848 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdd01e6890 con 0x7fcdd006c560 2024-07-24T16:24:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.516+0000 7fcdc5ffb640 1 -- 172.21.15.159:0/2349719848 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc003850 con 0x7fcdd006c560 2024-07-24T16:24:01.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.517+0000 7fcdd77ec640 1 -- 172.21.15.159:0/2349719848 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdd01e6e50 con 0x7fcdd006c560 2024-07-24T16:24:01.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.518+0000 7fcdd77ec640 1 -- 172.21.15.159:0/2349719848 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdd006c940 con 0x7fcdd006c560 2024-07-24T16:24:01.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.518+0000 7fcdc5ffb640 1 -- 172.21.15.159:0/2349719848 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 4) ==== 99083+0+0 (secure 0 0 0) 0x7fcdcc01a070 con 0x7fcdd006c560 2024-07-24T16:24:01.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.519+0000 7fcdc5ffb640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcdb4076f80 0x7fcdb4079440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:01.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.519+0000 7fcdc5ffb640 1 -- 172.21.15.159:0/2349719848 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fcdcc0978f0 con 0x7fcdd006c560 2024-07-24T16:24:01.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.519+0000 7fcdd4d87640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcdb4076f80 0x7fcdb4079440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:01.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.519+0000 7fcdd4d87640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcdb4076f80 0x7fcdb4079440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0034000 tx=0x7fcdc0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:01.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.523+0000 7fcdc5ffb640 1 -- 172.21.15.159:0/2349719848 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fcdcc060880 con 0x7fcdd006c560 2024-07-24T16:24:01.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:01.704+0000 7fcdd77ec640 1 -- 172.21.15.159:0/2349719848 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fcdd00cd090 con 0x7fcdd006c560 2024-07-24T16:24:02.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.394+0000 7fcdc5ffb640 1 -- 172.21.15.159:0/2349719848 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7fcdcc069110 con 0x7fcdd006c560 2024-07-24T16:24:02.397 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_data' created 2024-07-24T16:24:02.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.397+0000 7fcdd77ec640 1 -- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcdb4076f80 msgr2=0x7fcdb4079440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:02.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.397+0000 7fcdd77ec640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcdb4076f80 0x7fcdb4079440 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcdc0034000 tx=0x7fcdc0004730 comp rx=0 tx=0).stop 2024-07-24T16:24:02.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.397+0000 7fcdd77ec640 1 -- 172.21.15.159:0/2349719848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdd006c560 msgr2=0x7fcdd014eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:02.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.397+0000 7fcdd77ec640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdd006c560 0x7fcdd014eb80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc00c400 tx=0x7fcdcc00c8c0 comp rx=0 tx=0).stop 2024-07-24T16:24:02.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.397+0000 7fcdd77ec640 1 -- 172.21.15.159:0/2349719848 shutdown_connections 2024-07-24T16:24:02.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.397+0000 7fcdd77ec640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcdb4076f80 0x7fcdb4079440 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:02.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.397+0000 7fcdd77ec640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcdd00ce310 0x7fcdd015d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:02.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.397+0000 7fcdd77ec640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdd0070610 0x7fcdd0150b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:02.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.397+0000 7fcdd77ec640 1 --2- 172.21.15.159:0/2349719848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdd006c560 0x7fcdd014eb80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:02.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.397+0000 7fcdd77ec640 1 -- 172.21.15.159:0/2349719848 >> 172.21.15.159:0/2349719848 conn(0x7fcdd00b2230 msgr2=0x7fcdd00b0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:02.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.397+0000 7fcdd77ec640 1 -- 172.21.15.159:0/2349719848 shutdown_connections 2024-07-24T16:24:02.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.397+0000 7fcdd77ec640 1 -- 172.21.15.159:0/2349719848 wait complete. 2024-07-24T16:24:02.426 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-07-24T16:24:02.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.530+0000 7f83eb2fd640 1 -- 172.21.15.159:0/27502549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e40707c0 msgr2=0x7f83e4071590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:02.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.530+0000 7f83eb2fd640 1 --2- 172.21.15.159:0/27502549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e40707c0 0x7f83e4071590 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f83d8009860 tx=0x7f83d802a4b0 comp rx=0 tx=0).stop 2024-07-24T16:24:02.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.530+0000 7f83eb2fd640 1 -- 172.21.15.159:0/27502549 shutdown_connections 2024-07-24T16:24:02.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.530+0000 7f83eb2fd640 1 --2- 172.21.15.159:0/27502549 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83e40cf1f0 0x7f83e4071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:02.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.530+0000 7f83eb2fd640 1 --2- 172.21.15.159:0/27502549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e40707c0 0x7f83e4071590 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:02.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.530+0000 7f83eb2fd640 1 -- 172.21.15.159:0/27502549 >> 172.21.15.159:0/27502549 conn(0x7f83e40b36f0 msgr2=0x7f83e40b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:02.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.530+0000 7f83eb2fd640 1 -- 172.21.15.159:0/27502549 shutdown_connections 2024-07-24T16:24:02.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.530+0000 7f83eb2fd640 1 -- 172.21.15.159:0/27502549 wait complete. 2024-07-24T16:24:02.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.531+0000 7f83eb2fd640 1 Processor -- start 2024-07-24T16:24:02.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.531+0000 7f83eb2fd640 1 -- start start 2024-07-24T16:24:02.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.532+0000 7f83eb2fd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e40707c0 0x7f83e406d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:02.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.532+0000 7f83eb2fd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83e40cee10 0x7f83e415a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:02.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.532+0000 7f83eb2fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83e40cf1f0 0x7f83e406ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:02.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.532+0000 7f83eb2fd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f83e40b59b0 con 0x7f83e40707c0 2024-07-24T16:24:02.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.532+0000 7f83eb2fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f83e40b5830 con 0x7f83e40cf1f0 2024-07-24T16:24:02.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.532+0000 7f83eb2fd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f83e40b5b30 con 0x7f83e40cee10 2024-07-24T16:24:02.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.532+0000 7f83e9099640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e40707c0 0x7f83e406d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:02.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.532+0000 7f83e9099640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e40707c0 0x7f83e406d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43638/0 (socket says 172.21.15.159:43638) 2024-07-24T16:24:02.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.532+0000 7f83e9099640 1 -- 172.21.15.159:0/4004407944 learned_addr learned my addr 172.21.15.159:0/4004407944 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:02.536 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.532+0000 7f83e8898640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83e40cee10 0x7f83e415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:02.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.532+0000 7f83e989a640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83e40cf1f0 0x7f83e406ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:02.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.532+0000 7f83e9099640 1 -- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83e40cee10 msgr2=0x7f83e415a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:02.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.533+0000 7f83e9099640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83e40cee10 0x7f83e415a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:02.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.533+0000 7f83e9099640 1 -- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83e40cf1f0 msgr2=0x7f83e406ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:02.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.533+0000 7f83e9099640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83e40cf1f0 0x7f83e406ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:02.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.533+0000 7f83e9099640 1 -- 172.21.15.159:0/4004407944 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e41f76c0 con 0x7f83e40707c0 2024-07-24T16:24:02.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.533+0000 7f83e8898640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83e40cee10 0x7f83e415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:02.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.533+0000 7f83e9099640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e40707c0 0x7f83e406d630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f83d400cbd0 tx=0x7f83d400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:02.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.533+0000 7f83e1ffb640 1 -- 172.21.15.159:0/4004407944 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4016020 con 0x7f83e40707c0 2024-07-24T16:24:02.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.533+0000 7f83e1ffb640 1 -- 172.21.15.159:0/4004407944 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83d400ae30 con 0x7f83e40707c0 2024-07-24T16:24:02.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.533+0000 7f83eb2fd640 1 -- 172.21.15.159:0/4004407944 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e41f79a0 con 0x7f83e40707c0 2024-07-24T16:24:02.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.533+0000 7f83e1ffb640 1 -- 172.21.15.159:0/4004407944 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83d4012660 con 0x7f83e40707c0 2024-07-24T16:24:02.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.533+0000 7f83eb2fd640 1 -- 172.21.15.159:0/4004407944 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e41f7f60 con 0x7f83e40707c0 2024-07-24T16:24:02.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.534+0000 7f83eb2fd640 1 -- 172.21.15.159:0/4004407944 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e40b6050 con 0x7f83e40707c0 2024-07-24T16:24:02.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.535+0000 7f83e1ffb640 1 -- 172.21.15.159:0/4004407944 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f83d4019020 con 0x7f83e40707c0 2024-07-24T16:24:02.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.535+0000 7f83e1ffb640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f83d0077010 0x7f83d00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:02.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.535+0000 7f83e1ffb640 1 -- 172.21.15.159:0/4004407944 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7f83d4098fd0 con 0x7f83e40707c0 2024-07-24T16:24:02.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.535+0000 7f83e8898640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f83d0077010 0x7f83d00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:02.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.536+0000 7f83e8898640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f83d0077010 0x7f83d00794d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f83d8034000 tx=0x7f83d8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:02.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.539+0000 7f83e1ffb640 1 -- 172.21.15.159:0/4004407944 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f83d4020030 con 0x7f83e40707c0 2024-07-24T16:24:02.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:02.760+0000 7f83eb2fd640 1 -- 172.21.15.159:0/4004407944 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f83e4152410 con 0x7f83e40707c0 2024-07-24T16:24:03.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.396+0000 7f83e1ffb640 1 -- 172.21.15.159:0/4004407944 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f83d4062230 con 0x7f83e40707c0 2024-07-24T16:24:03.398 INFO:teuthology.orchestra.run.smithi159.stderr:new fs with metadata pool 2 and data pool 3 2024-07-24T16:24:03.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.399+0000 7f83eb2fd640 1 -- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f83d0077010 msgr2=0x7f83d00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:03.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.399+0000 7f83eb2fd640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f83d0077010 0x7f83d00794d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f83d8034000 tx=0x7f83d8004730 comp rx=0 tx=0).stop 2024-07-24T16:24:03.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.399+0000 7f83eb2fd640 1 -- 172.21.15.159:0/4004407944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e40707c0 msgr2=0x7f83e406d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:03.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.399+0000 7f83eb2fd640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e40707c0 0x7f83e406d630 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f83d400cbd0 tx=0x7f83d400a430 comp rx=0 tx=0).stop 2024-07-24T16:24:03.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.400+0000 7f83eb2fd640 1 -- 172.21.15.159:0/4004407944 shutdown_connections 2024-07-24T16:24:03.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.400+0000 7f83eb2fd640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f83d0077010 0x7f83d00794d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:03.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.400+0000 7f83eb2fd640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83e40cf1f0 0x7f83e406ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:03.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.400+0000 7f83eb2fd640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83e40cee10 0x7f83e415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:03.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.400+0000 7f83eb2fd640 1 --2- 172.21.15.159:0/4004407944 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83e40707c0 0x7f83e406d630 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:03.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.400+0000 7f83eb2fd640 1 -- 172.21.15.159:0/4004407944 >> 172.21.15.159:0/4004407944 conn(0x7f83e40b36f0 msgr2=0x7f83e4071380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:03.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.400+0000 7f83eb2fd640 1 -- 172.21.15.159:0/4004407944 shutdown_connections 2024-07-24T16:24:03.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.400+0000 7f83eb2fd640 1 -- 172.21.15.159:0/4004407944 wait complete. 2024-07-24T16:24:03.426 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-07-24T16:24:03.426 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-07-24T16:24:03.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.537+0000 7f5f9e332640 1 -- 172.21.15.159:0/2120886396 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f9815ae90 msgr2=0x7f5f98073100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:03.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.537+0000 7f5f9e332640 1 --2- 172.21.15.159:0/2120886396 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f9815ae90 0x7f5f98073100 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009be0 tx=0x7f5f9002a840 comp rx=0 tx=0).stop 2024-07-24T16:24:03.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.537+0000 7f5f9e332640 1 -- 172.21.15.159:0/2120886396 shutdown_connections 2024-07-24T16:24:03.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.537+0000 7f5f9e332640 1 --2- 172.21.15.159:0/2120886396 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f9815ae90 0x7f5f98073100 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:03.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.537+0000 7f5f9e332640 1 --2- 172.21.15.159:0/2120886396 >> v2:172.21.15.193:3300/0 conn(0x7f5f980b5200 0x7f5f9815a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:03.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.537+0000 7f5f9e332640 1 -- 172.21.15.159:0/2120886396 >> 172.21.15.159:0/2120886396 conn(0x7f5f9806da90 msgr2=0x7f5f9806dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:03.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.537+0000 7f5f9e332640 1 -- 172.21.15.159:0/2120886396 shutdown_connections 2024-07-24T16:24:03.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.537+0000 7f5f9e332640 1 -- 172.21.15.159:0/2120886396 wait complete. 2024-07-24T16:24:03.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.538+0000 7f5f9e332640 1 Processor -- start 2024-07-24T16:24:03.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.538+0000 7f5f9e332640 1 -- start start 2024-07-24T16:24:03.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f9e332640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f980b5200 0x7f5f980af010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:03.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f9e332640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f981546f0 0x7f5f9815a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:03.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f9e332640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f9815ae90 0x7f5f9806c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:03.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f9e332640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9806ecd0 con 0x7f5f980b5200 2024-07-24T16:24:03.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f9e332640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9806eb50 con 0x7f5f981546f0 2024-07-24T16:24:03.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f9e332640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5f9806ee50 con 0x7f5f9815ae90 2024-07-24T16:24:03.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f97fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f980b5200 0x7f5f980af010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:03.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f97fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f980b5200 0x7f5f980af010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43654/0 (socket says 172.21.15.159:43654) 2024-07-24T16:24:03.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f97fff640 1 -- 172.21.15.159:0/594819226 learned_addr learned my addr 172.21.15.159:0/594819226 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:03.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f9c8cf640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f9815ae90 0x7f5f9806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:03.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f977fe640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f981546f0 0x7f5f9815a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:03.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f97fff640 1 -- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f9815ae90 msgr2=0x7f5f9806c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:03.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f97fff640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f9815ae90 0x7f5f9806c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:03.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f97fff640 1 -- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f981546f0 msgr2=0x7f5f9815a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:03.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f97fff640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f981546f0 0x7f5f9815a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:03.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.539+0000 7f5f97fff640 1 -- 172.21.15.159:0/594819226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f980af550 con 0x7f5f980b5200 2024-07-24T16:24:03.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.540+0000 7f5f97fff640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f980b5200 0x7f5f980af010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00c450 tx=0x7f5f8c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:03.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.540+0000 7f5f94ff9640 1 -- 172.21.15.159:0/594819226 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c016020 con 0x7f5f980b5200 2024-07-24T16:24:03.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.540+0000 7f5f9e332640 1 -- 172.21.15.159:0/594819226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f98158d80 con 0x7f5f980b5200 2024-07-24T16:24:03.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.540+0000 7f5f94ff9640 1 -- 172.21.15.159:0/594819226 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f8c012920 con 0x7f5f980b5200 2024-07-24T16:24:03.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.540+0000 7f5f94ff9640 1 -- 172.21.15.159:0/594819226 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c012d70 con 0x7f5f980b5200 2024-07-24T16:24:03.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.540+0000 7f5f9e332640 1 -- 172.21.15.159:0/594819226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f98159340 con 0x7f5f980b5200 2024-07-24T16:24:03.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.541+0000 7f5f9e332640 1 -- 172.21.15.159:0/594819226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f98073100 con 0x7f5f980b5200 2024-07-24T16:24:03.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.541+0000 7f5f94ff9640 1 -- 172.21.15.159:0/594819226 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5f8c019020 con 0x7f5f980b5200 2024-07-24T16:24:03.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.542+0000 7f5f94ff9640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5f84077010 0x7f5f840794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:03.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.542+0000 7f5f94ff9640 1 -- 172.21.15.159:0/594819226 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7f5f8c0984c0 con 0x7f5f980b5200 2024-07-24T16:24:03.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.542+0000 7f5f977fe640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5f84077010 0x7f5f840794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:03.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.542+0000 7f5f977fe640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5f84077010 0x7f5f840794d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5f880095f0 tx=0x7f5f88005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:03.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.546+0000 7f5f94ff9640 1 -- 172.21.15.159:0/594819226 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f5f8c020030 con 0x7f5f980b5200 2024-07-24T16:24:03.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:03.737+0000 7f5f9e332640 1 -- 172.21.15.159:0/594819226 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f5f98071200 con 0x7f5f980b5200 2024-07-24T16:24:04.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.397+0000 7f5f94ff9640 1 -- 172.21.15.159:0/594819226 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7f5f8c061110 con 0x7f5f980b5200 2024-07-24T16:24:04.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.400+0000 7f5f9e332640 1 -- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5f84077010 msgr2=0x7f5f840794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:04.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.400+0000 7f5f9e332640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5f84077010 0x7f5f840794d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f5f880095f0 tx=0x7f5f88005f90 comp rx=0 tx=0).stop 2024-07-24T16:24:04.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.400+0000 7f5f9e332640 1 -- 172.21.15.159:0/594819226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f980b5200 msgr2=0x7f5f980af010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:04.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.400+0000 7f5f9e332640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f980b5200 0x7f5f980af010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00c450 tx=0x7f5f8c00c910 comp rx=0 tx=0).stop 2024-07-24T16:24:04.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.400+0000 7f5f9e332640 1 -- 172.21.15.159:0/594819226 shutdown_connections 2024-07-24T16:24:04.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.400+0000 7f5f9e332640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5f84077010 0x7f5f840794d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:04.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.400+0000 7f5f9e332640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f9815ae90 0x7f5f9806c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:04.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.400+0000 7f5f9e332640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f981546f0 0x7f5f9815a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:04.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.400+0000 7f5f9e332640 1 --2- 172.21.15.159:0/594819226 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f980b5200 0x7f5f980af010 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:04.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.400+0000 7f5f9e332640 1 -- 172.21.15.159:0/594819226 >> 172.21.15.159:0/594819226 conn(0x7f5f9806da90 msgr2=0x7f5f9815d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:04.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.400+0000 7f5f9e332640 1 -- 172.21.15.159:0/594819226 shutdown_connections 2024-07-24T16:24:04.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.400+0000 7f5f9e332640 1 -- 172.21.15.159:0/594819226 wait complete. 2024-07-24T16:24:04.414 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-07-24T16:24:04.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.522+0000 7f52cb455640 1 -- 172.21.15.159:0/860423248 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52c40b2d20 msgr2=0x7f52c406f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:04.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.522+0000 7f52cb455640 1 --2- 172.21.15.159:0/860423248 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52c40b2d20 0x7f52c406f950 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009830 tx=0x7f52bc02a540 comp rx=0 tx=0).stop 2024-07-24T16:24:04.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.522+0000 7f52cb455640 1 -- 172.21.15.159:0/860423248 shutdown_connections 2024-07-24T16:24:04.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.522+0000 7f52cb455640 1 --2- 172.21.15.159:0/860423248 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52c40b2d20 0x7f52c406f950 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:04.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.522+0000 7f52cb455640 1 -- 172.21.15.159:0/860423248 >> 172.21.15.159:0/860423248 conn(0x7f52c4068d00 msgr2=0x7f52c406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:04.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.523+0000 7f52cb455640 1 -- 172.21.15.159:0/860423248 shutdown_connections 2024-07-24T16:24:04.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.523+0000 7f52cb455640 1 -- 172.21.15.159:0/860423248 wait complete. 2024-07-24T16:24:04.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.524+0000 7f52cb455640 1 Processor -- start 2024-07-24T16:24:04.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.524+0000 7f52cb455640 1 -- start start 2024-07-24T16:24:04.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.524+0000 7f52cb455640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52c40b28d0 0x7f52c41f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:04.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.524+0000 7f52cb455640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52c40b2d20 0x7f52c414fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:04.528 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.524+0000 7f52cb455640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52c415a2d0 0x7f52c40c6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:04.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.524+0000 7f52cb455640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f52c40cdb60 con 0x7f52c40b28d0 2024-07-24T16:24:04.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.524+0000 7f52cb455640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f52c406fe90 con 0x7f52c415a2d0 2024-07-24T16:24:04.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.524+0000 7f52cb455640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f52c4070010 con 0x7f52c40b2d20 2024-07-24T16:24:04.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c91f1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52c40b28d0 0x7f52c41f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:04.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c91f1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52c40b28d0 0x7f52c41f2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43662/0 (socket says 172.21.15.159:43662) 2024-07-24T16:24:04.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c91f1640 1 -- 172.21.15.159:0/3760480882 learned_addr learned my addr 172.21.15.159:0/3760480882 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:04.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c89f0640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52c40b2d20 0x7f52c414fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:04.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c99f2640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52c415a2d0 0x7f52c40c6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:04.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c91f1640 1 -- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52c40b2d20 msgr2=0x7f52c414fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:04.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c91f1640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52c40b2d20 0x7f52c414fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:04.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c91f1640 1 -- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52c415a2d0 msgr2=0x7f52c40c6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:04.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c91f1640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52c415a2d0 0x7f52c40c6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:04.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c91f1640 1 -- 172.21.15.159:0/3760480882 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c4152300 con 0x7f52c40b28d0 2024-07-24T16:24:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c91f1640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52c40b28d0 0x7f52c41f2050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f52b400c770 tx=0x7f52b400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c1ffb640 1 -- 172.21.15.159:0/3760480882 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4003b70 con 0x7f52c40b28d0 2024-07-24T16:24:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c1ffb640 1 -- 172.21.15.159:0/3760480882 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52b4003d10 con 0x7f52c40b28d0 2024-07-24T16:24:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52cb455640 1 -- 172.21.15.159:0/3760480882 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c41f26b0 con 0x7f52c40b28d0 2024-07-24T16:24:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52c1ffb640 1 -- 172.21.15.159:0/3760480882 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b400aab0 con 0x7f52c40b28d0 2024-07-24T16:24:04.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.525+0000 7f52cb455640 1 -- 172.21.15.159:0/3760480882 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c41f2c70 con 0x7f52c40b28d0 2024-07-24T16:24:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.526+0000 7f52cb455640 1 -- 172.21.15.159:0/3760480882 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c41524d0 con 0x7f52c40b28d0 2024-07-24T16:24:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.527+0000 7f52c1ffb640 1 -- 172.21.15.159:0/3760480882 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f52b400ac50 con 0x7f52c40b28d0 2024-07-24T16:24:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.528+0000 7f52c1ffb640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f52b0077010 0x7f52b00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.528+0000 7f52c1ffb640 1 -- 172.21.15.159:0/3760480882 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f52b4098730 con 0x7f52c40b28d0 2024-07-24T16:24:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.528+0000 7f52c89f0640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f52b0077010 0x7f52b00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:04.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.528+0000 7f52c89f0640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f52b0077010 0x7f52b00794d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f52c4159ab0 tx=0x7f52b80016d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:04.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.532+0000 7f52c1ffb640 1 -- 172.21.15.159:0/3760480882 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f52b4061240 con 0x7f52c40b28d0 2024-07-24T16:24:04.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:04.717+0000 7f52cb455640 1 -- 172.21.15.159:0/3760480882 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f52c40c5870 con 0x7f52c40b28d0 2024-07-24T16:24:06.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.421+0000 7f52c1ffb640 1 -- 172.21.15.159:0/3760480882 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f52c40c5870 con 0x7f52c40b28d0 2024-07-24T16:24:06.424 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_data_ec' created 2024-07-24T16:24:06.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.424+0000 7f52cb455640 1 -- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f52b0077010 msgr2=0x7f52b00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:06.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.424+0000 7f52cb455640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f52b0077010 0x7f52b00794d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f52c4159ab0 tx=0x7f52b80016d0 comp rx=0 tx=0).stop 2024-07-24T16:24:06.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.424+0000 7f52cb455640 1 -- 172.21.15.159:0/3760480882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52c40b28d0 msgr2=0x7f52c41f2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:06.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.424+0000 7f52cb455640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52c40b28d0 0x7f52c41f2050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f52b400c770 tx=0x7f52b400cc30 comp rx=0 tx=0).stop 2024-07-24T16:24:06.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.425+0000 7f52cb455640 1 -- 172.21.15.159:0/3760480882 shutdown_connections 2024-07-24T16:24:06.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.425+0000 7f52cb455640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f52b0077010 0x7f52b00794d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:06.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.425+0000 7f52cb455640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52c415a2d0 0x7f52c40c6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:06.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.425+0000 7f52cb455640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f52c40b2d20 0x7f52c414fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:06.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.425+0000 7f52cb455640 1 --2- 172.21.15.159:0/3760480882 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f52c40b28d0 0x7f52c41f2050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:06.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.425+0000 7f52cb455640 1 -- 172.21.15.159:0/3760480882 >> 172.21.15.159:0/3760480882 conn(0x7f52c4068d00 msgr2=0x7f52c40b3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:06.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.425+0000 7f52cb455640 1 -- 172.21.15.159:0/3760480882 shutdown_connections 2024-07-24T16:24:06.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.425+0000 7f52cb455640 1 -- 172.21.15.159:0/3760480882 wait complete. 2024-07-24T16:24:06.447 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-07-24T16:24:06.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.557+0000 7f1a761f0640 1 -- 172.21.15.159:0/4023071089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a700b4650 msgr2=0x7f1a700ccae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.557+0000 7f1a761f0640 1 --2- 172.21.15.159:0/4023071089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a700b4650 0x7f1a700ccae0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1a70072160 tx=0x7f1a6402a5f0 comp rx=0 tx=0).stop 2024-07-24T16:24:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.557+0000 7f1a761f0640 1 -- 172.21.15.159:0/4023071089 shutdown_connections 2024-07-24T16:24:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.557+0000 7f1a761f0640 1 --2- 172.21.15.159:0/4023071089 >> v2:172.21.15.193:3300/0 conn(0x7f1a700cd020 0x7f1a7015b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.557+0000 7f1a761f0640 1 --2- 172.21.15.159:0/4023071089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a700b4650 0x7f1a700ccae0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.557+0000 7f1a761f0640 1 -- 172.21.15.159:0/4023071089 >> 172.21.15.159:0/4023071089 conn(0x7f1a7006d4a0 msgr2=0x7f1a7006d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.557+0000 7f1a761f0640 1 -- 172.21.15.159:0/4023071089 shutdown_connections 2024-07-24T16:24:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.557+0000 7f1a761f0640 1 -- 172.21.15.159:0/4023071089 wait complete. 2024-07-24T16:24:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.558+0000 7f1a761f0640 1 Processor -- start 2024-07-24T16:24:06.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.558+0000 7f1a761f0640 1 -- start start 2024-07-24T16:24:06.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a761f0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1a700b4650 0x7f1a70153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:06.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a761f0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a700cd020 0x7f1a7014ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:06.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a761f0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a70158fd0 0x7f1a7014f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:06.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a761f0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7015c230 con 0x7f1a70158fd0 2024-07-24T16:24:06.563 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a761f0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1a7015c0b0 con 0x7f1a700cd020 2024-07-24T16:24:06.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a761f0640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1a7015c3b0 con 0x7f1a700b4650 2024-07-24T16:24:06.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a6ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a70158fd0 0x7f1a7014f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:06.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a6ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a70158fd0 0x7f1a7014f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43684/0 (socket says 172.21.15.159:43684) 2024-07-24T16:24:06.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a6ffff640 1 -- 172.21.15.159:0/751843324 learned_addr learned my addr 172.21.15.159:0/751843324 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:06.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a6effd640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a700cd020 0x7f1a7014ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:06.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a6f7fe640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1a700b4650 0x7f1a70153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:06.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a6ffff640 1 -- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1a700b4650 msgr2=0x7f1a70153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:06.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a6ffff640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1a700b4650 0x7f1a70153630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:06.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a6ffff640 1 -- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a700cd020 msgr2=0x7f1a7014ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:06.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a6ffff640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a700cd020 0x7f1a7014ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:06.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a6ffff640 1 -- 172.21.15.159:0/751843324 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a70152590 con 0x7f1a70158fd0 2024-07-24T16:24:06.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.559+0000 7f1a6ffff640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a70158fd0 0x7f1a7014f670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009fd0 tx=0x7f1a6800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:06.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.560+0000 7f1a57fff640 1 -- 172.21.15.159:0/751843324 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68011830 con 0x7f1a70158fd0 2024-07-24T16:24:06.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.560+0000 7f1a57fff640 1 -- 172.21.15.159:0/751843324 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a68016070 con 0x7f1a70158fd0 2024-07-24T16:24:06.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.560+0000 7f1a761f0640 1 -- 172.21.15.159:0/751843324 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a70152870 con 0x7f1a70158fd0 2024-07-24T16:24:06.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.560+0000 7f1a57fff640 1 -- 172.21.15.159:0/751843324 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a68011d40 con 0x7f1a70158fd0 2024-07-24T16:24:06.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.560+0000 7f1a761f0640 1 -- 172.21.15.159:0/751843324 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a70152e30 con 0x7f1a70158fd0 2024-07-24T16:24:06.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.561+0000 7f1a761f0640 1 -- 172.21.15.159:0/751843324 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a70068c00 con 0x7f1a70158fd0 2024-07-24T16:24:06.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.561+0000 7f1a57fff640 1 -- 172.21.15.159:0/751843324 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1a6801b460 con 0x7f1a70158fd0 2024-07-24T16:24:06.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.562+0000 7f1a57fff640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1a5c077010 0x7f1a5c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:06.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.562+0000 7f1a57fff640 1 -- 172.21.15.159:0/751843324 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f1a68098940 con 0x7f1a70158fd0 2024-07-24T16:24:06.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.562+0000 7f1a6f7fe640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1a5c077010 0x7f1a5c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:06.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.563+0000 7f1a6f7fe640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1a5c077010 0x7f1a5c0794d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a600012e0 tx=0x7f1a60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:06.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.566+0000 7f1a57fff640 1 -- 172.21.15.159:0/751843324 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f1a70068c00 con 0x7f1a70158fd0 2024-07-24T16:24:06.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:06.749+0000 7f1a761f0640 1 -- 172.21.15.159:0/751843324 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f1a701598e0 con 0x7f1a70158fd0 2024-07-24T16:24:07.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.423+0000 7f1a57fff640 1 -- 172.21.15.159:0/751843324 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f1a68061940 con 0x7f1a70158fd0 2024-07-24T16:24:07.425 INFO:teuthology.orchestra.run.smithi159.stderr:set pool 4 allow_ec_overwrites to true 2024-07-24T16:24:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.426+0000 7f1a761f0640 1 -- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1a5c077010 msgr2=0x7f1a5c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.426+0000 7f1a761f0640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1a5c077010 0x7f1a5c0794d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f1a600012e0 tx=0x7f1a60009040 comp rx=0 tx=0).stop 2024-07-24T16:24:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.426+0000 7f1a761f0640 1 -- 172.21.15.159:0/751843324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a70158fd0 msgr2=0x7f1a7014f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.426+0000 7f1a761f0640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a70158fd0 0x7f1a7014f670 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1a68009fd0 tx=0x7f1a6800b8e0 comp rx=0 tx=0).stop 2024-07-24T16:24:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.426+0000 7f1a761f0640 1 -- 172.21.15.159:0/751843324 shutdown_connections 2024-07-24T16:24:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.426+0000 7f1a761f0640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1a5c077010 0x7f1a5c0794d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.426+0000 7f1a761f0640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1a70158fd0 0x7f1a7014f670 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.426+0000 7f1a761f0640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1a700cd020 0x7f1a7014ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.426+0000 7f1a761f0640 1 --2- 172.21.15.159:0/751843324 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1a700b4650 0x7f1a70153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:07.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.426+0000 7f1a761f0640 1 -- 172.21.15.159:0/751843324 >> 172.21.15.159:0/751843324 conn(0x7f1a7006d4a0 msgr2=0x7f1a700b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:07.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.426+0000 7f1a761f0640 1 -- 172.21.15.159:0/751843324 shutdown_connections 2024-07-24T16:24:07.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.426+0000 7f1a761f0640 1 -- 172.21.15.159:0/751843324 wait complete. 2024-07-24T16:24:07.454 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-07-24T16:24:07.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.563+0000 7f12c4065640 1 -- 172.21.15.159:0/1126203184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12bc073260 msgr2=0x7f12bc070070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:07.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.563+0000 7f12c4065640 1 --2- 172.21.15.159:0/1126203184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12bc073260 0x7f12bc070070 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f12bc074310 tx=0x7f12b402a820 comp rx=0 tx=0).stop 2024-07-24T16:24:07.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.563+0000 7f12c4065640 1 -- 172.21.15.159:0/1126203184 shutdown_connections 2024-07-24T16:24:07.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.563+0000 7f12c4065640 1 --2- 172.21.15.159:0/1126203184 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12bc073260 0x7f12bc070070 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:07.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.563+0000 7f12c4065640 1 --2- 172.21.15.159:0/1126203184 >> v2:172.21.15.193:3300/0 conn(0x7f12bc15a330 0x7f12bc0cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:07.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.563+0000 7f12c4065640 1 -- 172.21.15.159:0/1126203184 >> 172.21.15.159:0/1126203184 conn(0x7f12bc0b2230 msgr2=0x7f12bc0b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:07.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.563+0000 7f12c4065640 1 -- 172.21.15.159:0/1126203184 shutdown_connections 2024-07-24T16:24:07.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.563+0000 7f12c4065640 1 -- 172.21.15.159:0/1126203184 wait complete. 2024-07-24T16:24:07.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.564+0000 7f12c4065640 1 Processor -- start 2024-07-24T16:24:07.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.564+0000 7f12c4065640 1 -- start start 2024-07-24T16:24:07.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c4065640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12bc073260 0x7f12bc14b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:07.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c4065640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12bc0b4e70 0x7f12bc1f14d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:07.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c4065640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f12bc15a330 0x7f12bc147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:07.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c4065640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc0cd660 con 0x7f12bc073260 2024-07-24T16:24:07.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c4065640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f12bc0cd4e0 con 0x7f12bc0b4e70 2024-07-24T16:24:07.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c4065640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f12bc0cd7e0 con 0x7f12bc15a330 2024-07-24T16:24:07.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c1e01640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12bc073260 0x7f12bc14b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:07.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c1e01640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12bc073260 0x7f12bc14b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43700/0 (socket says 172.21.15.159:43700) 2024-07-24T16:24:07.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c1e01640 1 -- 172.21.15.159:0/3810400506 learned_addr learned my addr 172.21.15.159:0/3810400506 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:07.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c1600640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12bc0b4e70 0x7f12bc1f14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:07.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c2602640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f12bc15a330 0x7f12bc147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:07.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c1e01640 1 -- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f12bc15a330 msgr2=0x7f12bc147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:07.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c1e01640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f12bc15a330 0x7f12bc147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:07.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c1e01640 1 -- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12bc0b4e70 msgr2=0x7f12bc1f14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:07.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c1e01640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12bc0b4e70 0x7f12bc1f14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:07.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c1e01640 1 -- 172.21.15.159:0/3810400506 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12bc0af000 con 0x7f12bc073260 2024-07-24T16:24:07.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c1e01640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12bc073260 0x7f12bc14b6a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00e790 tx=0x7f12ac00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:07.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12ba7fc640 1 -- 172.21.15.159:0/3810400506 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac00eea0 con 0x7f12bc073260 2024-07-24T16:24:07.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12ba7fc640 1 -- 172.21.15.159:0/3810400506 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12ac00cdb0 con 0x7f12bc073260 2024-07-24T16:24:07.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.565+0000 7f12c4065640 1 -- 172.21.15.159:0/3810400506 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12bc0af2e0 con 0x7f12bc073260 2024-07-24T16:24:07.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.566+0000 7f12ba7fc640 1 -- 172.21.15.159:0/3810400506 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12ac010690 con 0x7f12bc073260 2024-07-24T16:24:07.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.566+0000 7f12c4065640 1 -- 172.21.15.159:0/3810400506 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12bc0af8a0 con 0x7f12bc073260 2024-07-24T16:24:07.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.566+0000 7f12c4065640 1 -- 172.21.15.159:0/3810400506 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12bc0cdc90 con 0x7f12bc073260 2024-07-24T16:24:07.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.567+0000 7f12ba7fc640 1 -- 172.21.15.159:0/3810400506 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f12ac010830 con 0x7f12bc073260 2024-07-24T16:24:07.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.567+0000 7f12ba7fc640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f12a8077010 0x7f12a80794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:07.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.568+0000 7f12ba7fc640 1 -- 172.21.15.159:0/3810400506 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f12ac0994f0 con 0x7f12bc073260 2024-07-24T16:24:07.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.568+0000 7f12c1600640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f12a8077010 0x7f12a80794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:07.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.568+0000 7f12c1600640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f12a8077010 0x7f12a80794d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12b0007fd0 tx=0x7f12b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:07.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.572+0000 7f12ba7fc640 1 -- 172.21.15.159:0/3810400506 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f12ac061e10 con 0x7f12bc073260 2024-07-24T16:24:07.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:07.800+0000 7f12c4065640 1 -- 172.21.15.159:0/3810400506 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f12bc0ccc80 con 0x7f12bc073260 2024-07-24T16:24:08.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.444+0000 7f12ba7fc640 1 -- 172.21.15.159:0/3810400506 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) ==== 137+0+0 (secure 0 0 0) 0x7f12ac066360 con 0x7f12bc073260 2024-07-24T16:24:08.447 INFO:teuthology.orchestra.run.smithi159.stderr:added data pool 4 to fsmap 2024-07-24T16:24:08.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.448+0000 7f12c4065640 1 -- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f12a8077010 msgr2=0x7f12a80794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:08.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.448+0000 7f12c4065640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f12a8077010 0x7f12a80794d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f12b0007fd0 tx=0x7f12b0009040 comp rx=0 tx=0).stop 2024-07-24T16:24:08.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.448+0000 7f12c4065640 1 -- 172.21.15.159:0/3810400506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12bc073260 msgr2=0x7f12bc14b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:08.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.448+0000 7f12c4065640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12bc073260 0x7f12bc14b6a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f12ac00e790 tx=0x7f12ac00ec50 comp rx=0 tx=0).stop 2024-07-24T16:24:08.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.448+0000 7f12c4065640 1 -- 172.21.15.159:0/3810400506 shutdown_connections 2024-07-24T16:24:08.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.448+0000 7f12c4065640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f12a8077010 0x7f12a80794d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.448+0000 7f12c4065640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f12bc15a330 0x7f12bc147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.448+0000 7f12c4065640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12bc0b4e70 0x7f12bc1f14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.448+0000 7f12c4065640 1 --2- 172.21.15.159:0/3810400506 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12bc073260 0x7f12bc14b6a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.448+0000 7f12c4065640 1 -- 172.21.15.159:0/3810400506 >> 172.21.15.159:0/3810400506 conn(0x7f12bc0b2230 msgr2=0x7f12bc072b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:08.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.448+0000 7f12c4065640 1 -- 172.21.15.159:0/3810400506 shutdown_connections 2024-07-24T16:24:08.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.448+0000 7f12c4065640 1 -- 172.21.15.159:0/3810400506 wait complete. 2024-07-24T16:24:08.462 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:24:08.514 INFO:tasks.ceph.mds.b.smithi193.stderr:2024-07-24T16:24:08.511+0000 7f3e05a55640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-24T16:24:08.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.563+0000 7fe96469a640 1 -- 172.21.15.159:0/1598844991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe95c06cc70 msgr2=0x7fe95c06eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:08.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.563+0000 7fe96469a640 1 --2- 172.21.15.159:0/1598844991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe95c06cc70 0x7fe95c06eba0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe954009830 tx=0x7fe95402a510 comp rx=0 tx=0).stop 2024-07-24T16:24:08.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.563+0000 7fe96469a640 1 -- 172.21.15.159:0/1598844991 shutdown_connections 2024-07-24T16:24:08.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.563+0000 7fe96469a640 1 --2- 172.21.15.159:0/1598844991 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe95c072a80 0x7fe95c15f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.563+0000 7fe96469a640 1 --2- 172.21.15.159:0/1598844991 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe95c06cc70 0x7fe95c06eba0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.563+0000 7fe96469a640 1 -- 172.21.15.159:0/1598844991 >> 172.21.15.159:0/1598844991 conn(0x7fe95c071140 msgr2=0x7fe95c06d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:08.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.563+0000 7fe96469a640 1 -- 172.21.15.159:0/1598844991 shutdown_connections 2024-07-24T16:24:08.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.563+0000 7fe96469a640 1 -- 172.21.15.159:0/1598844991 wait complete. 2024-07-24T16:24:08.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.564+0000 7fe96469a640 1 Processor -- start 2024-07-24T16:24:08.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.564+0000 7fe96469a640 1 -- start start 2024-07-24T16:24:08.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe96469a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe95c06cc70 0x7fe95c151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:08.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe96469a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe95c15b3e0 0x7fe95c1f1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:08.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe96469a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe95c1566e0 0x7fe95c15dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:08.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe96469a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c06f4b0 con 0x7fe95c06cc70 2024-07-24T16:24:08.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe96469a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c06f330 con 0x7fe95c15b3e0 2024-07-24T16:24:08.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe96469a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe95c06f630 con 0x7fe95c1566e0 2024-07-24T16:24:08.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe962436640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe95c06cc70 0x7fe95c151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:08.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe962436640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe95c06cc70 0x7fe95c151ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43722/0 (socket says 172.21.15.159:43722) 2024-07-24T16:24:08.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe962436640 1 -- 172.21.15.159:0/2786690827 learned_addr learned my addr 172.21.15.159:0/2786690827 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:08.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe961c35640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe95c15b3e0 0x7fe95c1f1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:08.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe962c37640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe95c1566e0 0x7fe95c15dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:08.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe962436640 1 -- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe95c1566e0 msgr2=0x7fe95c15dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:08.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe962436640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe95c1566e0 0x7fe95c15dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe962436640 1 -- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe95c15b3e0 msgr2=0x7fe95c1f1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:08.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe962436640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe95c15b3e0 0x7fe95c1f1580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.565+0000 7fe962436640 1 -- 172.21.15.159:0/2786690827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95c157050 con 0x7fe95c06cc70 2024-07-24T16:24:08.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.566+0000 7fe962436640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe95c06cc70 0x7fe95c151ed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00c7a0 tx=0x7fe94c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:08.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.566+0000 7fe95affd640 1 -- 172.21.15.159:0/2786690827 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c017070 con 0x7fe95c06cc70 2024-07-24T16:24:08.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.566+0000 7fe95affd640 1 -- 172.21.15.159:0/2786690827 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe94c005070 con 0x7fe95c06cc70 2024-07-24T16:24:08.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.566+0000 7fe95affd640 1 -- 172.21.15.159:0/2786690827 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94c0054a0 con 0x7fe95c06cc70 2024-07-24T16:24:08.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.566+0000 7fe96469a640 1 -- 172.21.15.159:0/2786690827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95c14f870 con 0x7fe95c06cc70 2024-07-24T16:24:08.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.566+0000 7fe96469a640 1 -- 172.21.15.159:0/2786690827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95c14ed90 con 0x7fe95c06cc70 2024-07-24T16:24:08.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.567+0000 7fe96469a640 1 -- 172.21.15.159:0/2786690827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe95c0c6090 con 0x7fe95c06cc70 2024-07-24T16:24:08.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.567+0000 7fe95affd640 1 -- 172.21.15.159:0/2786690827 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe94c01a070 con 0x7fe95c06cc70 2024-07-24T16:24:08.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.568+0000 7fe95affd640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe948077010 0x7fe9480794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:08.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.568+0000 7fe95affd640 1 -- 172.21.15.159:0/2786690827 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe94c098430 con 0x7fe95c06cc70 2024-07-24T16:24:08.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.568+0000 7fe961c35640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe948077010 0x7fe9480794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:08.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.568+0000 7fe961c35640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe948077010 0x7fe9480794d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe95c1564a0 tx=0x7fe950005c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:08.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.572+0000 7fe95affd640 1 -- 172.21.15.159:0/2786690827 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fe95c0c6090 con 0x7fe95c06cc70 2024-07-24T16:24:08.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.793+0000 7fe96469a640 1 -- 172.21.15.159:0/2786690827 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe95c06eba0 con 0x7fe95c06cc70 2024-07-24T16:24:08.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.794+0000 7fe95affd640 1 -- 172.21.15.159:0/2786690827 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5231 (secure 0 0 0) 0x7fe94c0612e0 con 0x7fe95c06cc70 2024-07-24T16:24:08.797 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:08.797 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":7,"btime":"2024-07-24T16:24:08:434627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1307622320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1307622320},{"type":"v1","addr":"172.21.15.193:6837","nonce":1307622320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3191234203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3191234203},{"type":"v1","addr":"172.21.15.159:6833","nonce":3191234203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4336,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4102467909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":4102467909},{"type":"v1","addr":"172.21.15.159:6835","nonce":4102467909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:02.762268+0000","modified":"2024-07-24T16:24:07.801905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4348":{"gid":4348,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1274628948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1274628948},{"type":"v1","addr":"172.21.15.193:6836","nonce":1274628948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4348,"qdb_cluster":[4348]},"id":1}]} 2024-07-24T16:24:08.797 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 7 2024-07-24T16:24:08.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.796+0000 7fe96469a640 1 -- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe948077010 msgr2=0x7fe9480794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:08.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.796+0000 7fe96469a640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe948077010 0x7fe9480794d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe95c1564a0 tx=0x7fe950005c60 comp rx=0 tx=0).stop 2024-07-24T16:24:08.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.796+0000 7fe96469a640 1 -- 172.21.15.159:0/2786690827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe95c06cc70 msgr2=0x7fe95c151ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:08.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.796+0000 7fe96469a640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe95c06cc70 0x7fe95c151ed0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe94c00c7a0 tx=0x7fe94c00cc60 comp rx=0 tx=0).stop 2024-07-24T16:24:08.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.796+0000 7fe96469a640 1 -- 172.21.15.159:0/2786690827 shutdown_connections 2024-07-24T16:24:08.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.796+0000 7fe96469a640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe948077010 0x7fe9480794d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.799 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.796+0000 7fe96469a640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe95c1566e0 0x7fe95c15dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.796+0000 7fe96469a640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe95c15b3e0 0x7fe95c1f1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.796+0000 7fe96469a640 1 --2- 172.21.15.159:0/2786690827 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe95c06cc70 0x7fe95c151ed0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.796+0000 7fe96469a640 1 -- 172.21.15.159:0/2786690827 >> 172.21.15.159:0/2786690827 conn(0x7fe95c071140 msgr2=0x7fe95c0b4320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:08.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.796+0000 7fe96469a640 1 -- 172.21.15.159:0/2786690827 shutdown_connections 2024-07-24T16:24:08.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.796+0000 7fe96469a640 1 -- 172.21.15.159:0/2786690827 wait complete. 2024-07-24T16:24:08.809 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:08.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.910+0000 7f51c89bb640 1 -- 172.21.15.159:0/3157339597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51b0004800 msgr2=0x7f51b0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:08.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.910+0000 7f51c89bb640 1 --2- 172.21.15.159:0/3157339597 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51b0004800 0x7f51b0004c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00c260 tx=0x7f51b0005830 comp rx=0 tx=0).stop 2024-07-24T16:24:08.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.910+0000 7f51c2d9d640 1 -- 172.21.15.159:0/3157339597 reap_dead start 2024-07-24T16:24:08.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.910+0000 7f51c89bb640 1 -- 172.21.15.159:0/3157339597 shutdown_connections 2024-07-24T16:24:08.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.910+0000 7f51c89bb640 1 -- 172.21.15.159:0/3157339597 >> 172.21.15.159:0/3157339597 conn(0x7f51c406c560 msgr2=0x7f51c406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:08.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.910+0000 7f51c89bb640 1 -- 172.21.15.159:0/3157339597 shutdown_connections 2024-07-24T16:24:08.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.910+0000 7f51c89bb640 1 -- 172.21.15.159:0/3157339597 wait complete. 2024-07-24T16:24:08.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.912+0000 7f51c89bb640 1 Processor -- start 2024-07-24T16:24:08.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.912+0000 7f51c89bb640 1 -- start start 2024-07-24T16:24:08.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.912+0000 7f51c89bb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51b0004800 0x7f51c414d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:08.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.912+0000 7f51c89bb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f51c414e000 0x7f51c40b0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:08.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.912+0000 7f51c89bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40b1160 0x7f51c41f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:08.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.912+0000 7f51c89bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f51c415b110 con 0x7f51c40b1160 2024-07-24T16:24:08.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.912+0000 7f51c89bb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f51c415af90 con 0x7f51b0004800 2024-07-24T16:24:08.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.912+0000 7f51c89bb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f51c4071a00 con 0x7f51c414e000 2024-07-24T16:24:08.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51c2d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40b1160 0x7f51c41f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:08.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51c2d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40b1160 0x7f51c41f43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43750/0 (socket says 172.21.15.159:43750) 2024-07-24T16:24:08.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51c2d9d640 1 -- 172.21.15.159:0/817410042 learned_addr learned my addr 172.21.15.159:0/817410042 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:08.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51b9d9b640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f51c414e000 0x7f51c40b0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:08.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51c259c640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51b0004800 0x7f51c414d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:08.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51c2d9d640 1 -- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f51c414e000 msgr2=0x7f51c40b0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:08.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51c2d9d640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f51c414e000 0x7f51c40b0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51c2d9d640 1 -- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51b0004800 msgr2=0x7f51c414d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:08.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51c2d9d640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51b0004800 0x7f51c414d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:08.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51c2d9d640 1 -- 172.21.15.159:0/817410042 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c40ae330 con 0x7f51c40b1160 2024-07-24T16:24:08.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51c259c640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51b0004800 0x7f51c414d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:08.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51c2d9d640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40b1160 0x7f51c41f43f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51c40d0430 tx=0x7f51bc010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:08.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51bb7fe640 1 -- 172.21.15.159:0/817410042 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc00ee70 con 0x7f51c40b1160 2024-07-24T16:24:08.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51bb7fe640 1 -- 172.21.15.159:0/817410042 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51bc015070 con 0x7f51c40b1160 2024-07-24T16:24:08.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51c89bb640 1 -- 172.21.15.159:0/817410042 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c40ada90 con 0x7f51c40b1160 2024-07-24T16:24:08.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51bb7fe640 1 -- 172.21.15.159:0/817410042 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc003d00 con 0x7f51c40b1160 2024-07-24T16:24:08.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.913+0000 7f51c89bb640 1 -- 172.21.15.159:0/817410042 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c40ae050 con 0x7f51c40b1160 2024-07-24T16:24:08.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.914+0000 7f51c89bb640 1 -- 172.21.15.159:0/817410042 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51c406db00 con 0x7f51c40b1160 2024-07-24T16:24:08.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.915+0000 7f51bb7fe640 1 -- 172.21.15.159:0/817410042 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f51bc004030 con 0x7f51c40b1160 2024-07-24T16:24:08.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.915+0000 7f51bb7fe640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f51a4077010 0x7f51a40794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:08.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.915+0000 7f51bb7fe640 1 -- 172.21.15.159:0/817410042 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f51bc0997a0 con 0x7f51c40b1160 2024-07-24T16:24:08.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.915+0000 7f51c259c640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f51a4077010 0x7f51a40794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:08.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.916+0000 7f51c259c640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f51a4077010 0x7f51a40794d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009af0 tx=0x7f51b4005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:08.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:08.919+0000 7f51bb7fe640 1 -- 172.21.15.159:0/817410042 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f51bc062780 con 0x7f51c40b1160 2024-07-24T16:24:09.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.105+0000 7f51c89bb640 1 -- 172.21.15.159:0/817410042 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51c41e65d0 con 0x7f51c40b1160 2024-07-24T16:24:09.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.106+0000 7f51bb7fe640 1 -- 172.21.15.159:0/817410042 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f51bc062080 con 0x7f51c40b1160 2024-07-24T16:24:09.109 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:09.109 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:07.801757+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:00.757174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:01.708421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-24T16:24:05.423097+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:09.110 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.108+0000 7f51c89bb640 1 -- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f51a4077010 msgr2=0x7f51a40794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.108+0000 7f51c89bb640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f51a4077010 0x7f51a40794d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009af0 tx=0x7f51b4005f90 comp rx=0 tx=0).stop 2024-07-24T16:24:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.108+0000 7f51c89bb640 1 -- 172.21.15.159:0/817410042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40b1160 msgr2=0x7f51c41f43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.108+0000 7f51c89bb640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40b1160 0x7f51c41f43f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f51c40d0430 tx=0x7f51bc010f40 comp rx=0 tx=0).stop 2024-07-24T16:24:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.108+0000 7f51c89bb640 1 -- 172.21.15.159:0/817410042 shutdown_connections 2024-07-24T16:24:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.108+0000 7f51c89bb640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f51a4077010 0x7f51a40794d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.108+0000 7f51c89bb640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40b1160 0x7f51c41f43f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.108+0000 7f51c89bb640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f51c414e000 0x7f51c40b0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.108+0000 7f51c89bb640 1 --2- 172.21.15.159:0/817410042 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51b0004800 0x7f51c414d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.108+0000 7f51c89bb640 1 -- 172.21.15.159:0/817410042 >> 172.21.15.159:0/817410042 conn(0x7f51c406c560 msgr2=0x7f51c414ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.108+0000 7f51c89bb640 1 -- 172.21.15.159:0/817410042 shutdown_connections 2024-07-24T16:24:09.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.108+0000 7f51c89bb640 1 -- 172.21.15.159:0/817410042 wait complete. 2024-07-24T16:24:09.122 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:09.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.222+0000 7f6458dcb640 1 -- 172.21.15.159:0/2886233136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f645406f1c0 msgr2=0x7f645415b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.222+0000 7f6458dcb640 1 --2- 172.21.15.159:0/2886233136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f645406f1c0 0x7f645415b3c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f643c005fd0 tx=0x7f643c02a530 comp rx=0 tx=0).stop 2024-07-24T16:24:09.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.222+0000 7f6458dcb640 1 -- 172.21.15.159:0/2886233136 shutdown_connections 2024-07-24T16:24:09.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.222+0000 7f6458dcb640 1 --2- 172.21.15.159:0/2886233136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f645406f1c0 0x7f645415b3c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.222+0000 7f6458dcb640 1 --2- 172.21.15.159:0/2886233136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6454157d50 0x7f64540cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.222+0000 7f6458dcb640 1 -- 172.21.15.159:0/2886233136 >> 172.21.15.159:0/2886233136 conn(0x7f645406d450 msgr2=0x7f645406d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:09.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.222+0000 7f6458dcb640 1 -- 172.21.15.159:0/2886233136 shutdown_connections 2024-07-24T16:24:09.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.222+0000 7f6458dcb640 1 -- 172.21.15.159:0/2886233136 wait complete. 2024-07-24T16:24:09.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.223+0000 7f6458dcb640 1 Processor -- start 2024-07-24T16:24:09.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.223+0000 7f6458dcb640 1 -- start start 2024-07-24T16:24:09.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.224+0000 7f6458dcb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f645406f1c0 0x7f6454149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:09.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.224+0000 7f6458dcb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f645406fdf0 0x7f64540b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:09.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.224+0000 7f6458dcb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6454157d50 0x7f6454140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:09.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.224+0000 7f6458dcb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f64540705b0 con 0x7f6454157d50 2024-07-24T16:24:09.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.224+0000 7f6458dcb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6454070430 con 0x7f645406fdf0 2024-07-24T16:24:09.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.224+0000 7f6458dcb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6454070730 con 0x7f645406f1c0 2024-07-24T16:24:09.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.224+0000 7f6452d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6454157d50 0x7f6454140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:09.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.224+0000 7f6452d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6454157d50 0x7f6454140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43758/0 (socket says 172.21.15.159:43758) 2024-07-24T16:24:09.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.224+0000 7f6452d9d640 1 -- 172.21.15.159:0/838474667 learned_addr learned my addr 172.21.15.159:0/838474667 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:09.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.224+0000 7f645259c640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f645406f1c0 0x7f6454149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:09.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.224+0000 7f6451d9b640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f645406fdf0 0x7f64540b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:09.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.225+0000 7f6452d9d640 1 -- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f645406f1c0 msgr2=0x7f6454149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.225+0000 7f6452d9d640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f645406f1c0 0x7f6454149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.225+0000 7f6452d9d640 1 -- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f645406fdf0 msgr2=0x7f64540b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.225+0000 7f6452d9d640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f645406fdf0 0x7f64540b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.225+0000 7f6452d9d640 1 -- 172.21.15.159:0/838474667 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6454144e40 con 0x7f6454157d50 2024-07-24T16:24:09.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.225+0000 7f6452d9d640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6454157d50 0x7f6454140df0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f644c00c3c0 tx=0x7f644c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:09.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.225+0000 7f644affd640 1 -- 172.21.15.159:0/838474667 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c017070 con 0x7f6454157d50 2024-07-24T16:24:09.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.225+0000 7f644affd640 1 -- 172.21.15.159:0/838474667 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f644c0035f0 con 0x7f6454157d50 2024-07-24T16:24:09.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.225+0000 7f644affd640 1 -- 172.21.15.159:0/838474667 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644c003a40 con 0x7f6454157d50 2024-07-24T16:24:09.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.225+0000 7f6458dcb640 1 -- 172.21.15.159:0/838474667 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64541f5cc0 con 0x7f6454157d50 2024-07-24T16:24:09.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.225+0000 7f6458dcb640 1 -- 172.21.15.159:0/838474667 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64541f6280 con 0x7f6454157d50 2024-07-24T16:24:09.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.226+0000 7f6458dcb640 1 -- 172.21.15.159:0/838474667 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f645415a9b0 con 0x7f6454157d50 2024-07-24T16:24:09.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.226+0000 7f644affd640 1 -- 172.21.15.159:0/838474667 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f644c01a070 con 0x7f6454157d50 2024-07-24T16:24:09.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.227+0000 7f644affd640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6434077010 0x7f64340794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:09.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.227+0000 7f644affd640 1 -- 172.21.15.159:0/838474667 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f644c097f30 con 0x7f6454157d50 2024-07-24T16:24:09.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.227+0000 7f645259c640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6434077010 0x7f64340794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:09.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.227+0000 7f645259c640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6434077010 0x7f64340794d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f64540b1a90 tx=0x7f644400d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:09.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.231+0000 7f644affd640 1 -- 172.21.15.159:0/838474667 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f645415a9b0 con 0x7f6454157d50 2024-07-24T16:24:09.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.414+0000 7f6458dcb640 1 -- 172.21.15.159:0/838474667 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f645415b3c0 con 0x7f6454157d50 2024-07-24T16:24:09.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.415+0000 7f644affd640 1 -- 172.21.15.159:0/838474667 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f644c060830 con 0x7f6454157d50 2024-07-24T16:24:09.418 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:09.418 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:07.801757+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:00.757174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:01.708421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-24T16:24:05.423097+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:09.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.417+0000 7f6458dcb640 1 -- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6434077010 msgr2=0x7f64340794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.417+0000 7f6458dcb640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6434077010 0x7f64340794d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f64540b1a90 tx=0x7f644400d040 comp rx=0 tx=0).stop 2024-07-24T16:24:09.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.417+0000 7f6458dcb640 1 -- 172.21.15.159:0/838474667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6454157d50 msgr2=0x7f6454140df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.417+0000 7f6458dcb640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6454157d50 0x7f6454140df0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f644c00c3c0 tx=0x7f644c00c880 comp rx=0 tx=0).stop 2024-07-24T16:24:09.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.417+0000 7f6458dcb640 1 -- 172.21.15.159:0/838474667 shutdown_connections 2024-07-24T16:24:09.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.417+0000 7f6458dcb640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6434077010 0x7f64340794d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.417+0000 7f6458dcb640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6454157d50 0x7f6454140df0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.417+0000 7f6458dcb640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f645406fdf0 0x7f64540b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.417+0000 7f6458dcb640 1 --2- 172.21.15.159:0/838474667 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f645406f1c0 0x7f6454149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.417+0000 7f6458dcb640 1 -- 172.21.15.159:0/838474667 >> 172.21.15.159:0/838474667 conn(0x7f645406d450 msgr2=0x7f64540ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:09.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.417+0000 7f6458dcb640 1 -- 172.21.15.159:0/838474667 shutdown_connections 2024-07-24T16:24:09.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.417+0000 7f6458dcb640 1 -- 172.21.15.159:0/838474667 wait complete. 2024-07-24T16:24:09.447 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:24:09.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.547+0000 7f5035806640 1 -- 172.21.15.159:0/2480517685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50300b6660 msgr2=0x7f50300b6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.547+0000 7f5035806640 1 --2- 172.21.15.159:0/2480517685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50300b6660 0x7f50300b6ad0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5018009830 tx=0x7f501802a510 comp rx=0 tx=0).stop 2024-07-24T16:24:09.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.547+0000 7f5035806640 1 -- 172.21.15.159:0/2480517685 shutdown_connections 2024-07-24T16:24:09.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.547+0000 7f5035806640 1 --2- 172.21.15.159:0/2480517685 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50300cef70 0x7f50300cf400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.547+0000 7f5035806640 1 --2- 172.21.15.159:0/2480517685 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f50300b6660 0x7f50300b6ad0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.547+0000 7f5035806640 1 -- 172.21.15.159:0/2480517685 >> 172.21.15.159:0/2480517685 conn(0x7f503008cdf0 msgr2=0x7f50300d3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:09.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.547+0000 7f5035806640 1 -- 172.21.15.159:0/2480517685 shutdown_connections 2024-07-24T16:24:09.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.547+0000 7f5035806640 1 -- 172.21.15.159:0/2480517685 wait complete. 2024-07-24T16:24:09.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.549+0000 7f5035806640 1 Processor -- start 2024-07-24T16:24:09.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.549+0000 7f5035806640 1 -- start start 2024-07-24T16:24:09.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.549+0000 7f5035806640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50300b6660 0x7f5030154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:09.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.549+0000 7f5035806640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50300cef70 0x7f50301f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:09.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.549+0000 7f5035806640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5030160ea0 0x7f50300b0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:09.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.549+0000 7f5035806640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5030161400 con 0x7f5030160ea0 2024-07-24T16:24:09.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.549+0000 7f5035806640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5030161280 con 0x7f50300b6660 2024-07-24T16:24:09.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.549+0000 7f5035806640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f50300cffc0 con 0x7f50300cef70 2024-07-24T16:24:09.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f502f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5030160ea0 0x7f50300b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:09.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f502f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5030160ea0 0x7f50300b0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43764/0 (socket says 172.21.15.159:43764) 2024-07-24T16:24:09.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f502f7fe640 1 -- 172.21.15.159:0/3283587919 learned_addr learned my addr 172.21.15.159:0/3283587919 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:09.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f50267fc640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50300cef70 0x7f50301f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:09.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f502effd640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50300b6660 0x7f5030154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:09.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f502f7fe640 1 -- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50300cef70 msgr2=0x7f50301f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f502f7fe640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50300cef70 0x7f50301f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f502f7fe640 1 -- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50300b6660 msgr2=0x7f5030154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f502f7fe640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50300b6660 0x7f5030154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f502f7fe640 1 -- 172.21.15.159:0/3283587919 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50301f51d0 con 0x7f5030160ea0 2024-07-24T16:24:09.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f502f7fe640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5030160ea0 0x7f50300b0340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f502800eaa0 tx=0x7f502800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:09.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f502cff9640 1 -- 172.21.15.159:0/3283587919 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502800cdb0 con 0x7f5030160ea0 2024-07-24T16:24:09.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f5035806640 1 -- 172.21.15.159:0/3283587919 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50300caa80 con 0x7f5030160ea0 2024-07-24T16:24:09.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f5035806640 1 -- 172.21.15.159:0/3283587919 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50300cb040 con 0x7f5030160ea0 2024-07-24T16:24:09.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f502cff9640 1 -- 172.21.15.159:0/3283587919 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5028004c10 con 0x7f5030160ea0 2024-07-24T16:24:09.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.550+0000 7f502cff9640 1 -- 172.21.15.159:0/3283587919 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f502801f060 con 0x7f5030160ea0 2024-07-24T16:24:09.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.551+0000 7f5035806640 1 -- 172.21.15.159:0/3283587919 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5014005290 con 0x7f5030160ea0 2024-07-24T16:24:09.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.552+0000 7f502cff9640 1 -- 172.21.15.159:0/3283587919 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5028004fc0 con 0x7f5030160ea0 2024-07-24T16:24:09.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.552+0000 7f502cff9640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5010077010 0x7f50100794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:09.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.552+0000 7f502cff9640 1 -- 172.21.15.159:0/3283587919 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f50280993a0 con 0x7f5030160ea0 2024-07-24T16:24:09.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.552+0000 7f502effd640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5010077010 0x7f50100794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:09.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.553+0000 7f502effd640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5010077010 0x7f50100794d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50300c9e10 tx=0x7f5020009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:09.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.556+0000 7f502cff9640 1 -- 172.21.15.159:0/3283587919 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f5028016030 con 0x7f5030160ea0 2024-07-24T16:24:09.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.780+0000 7f5035806640 1 -- 172.21.15.159:0/3283587919 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5014005850 con 0x7f5030160ea0 2024-07-24T16:24:09.783 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.781+0000 7f502cff9640 1 -- 172.21.15.159:0/3283587919 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5231 (secure 0 0 0) 0x7f5028062270 con 0x7f5030160ea0 2024-07-24T16:24:09.784 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:09.784 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":7,"btime":"2024-07-24T16:24:08:434627+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1307622320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1307622320},{"type":"v1","addr":"172.21.15.193:6837","nonce":1307622320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3191234203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3191234203},{"type":"v1","addr":"172.21.15.159:6833","nonce":3191234203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4336,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4102467909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":4102467909},{"type":"v1","addr":"172.21.15.159:6835","nonce":4102467909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:02.762268+0000","modified":"2024-07-24T16:24:07.801905+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4348":{"gid":4348,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1274628948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1274628948},{"type":"v1","addr":"172.21.15.193:6836","nonce":1274628948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4348,"qdb_cluster":[4348]},"id":1}]} 2024-07-24T16:24:09.784 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 7 2024-07-24T16:24:09.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.783+0000 7f5035806640 1 -- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5010077010 msgr2=0x7f50100794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.783+0000 7f5035806640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5010077010 0x7f50100794d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f50300c9e10 tx=0x7f5020009040 comp rx=0 tx=0).stop 2024-07-24T16:24:09.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.783+0000 7f5035806640 1 -- 172.21.15.159:0/3283587919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5030160ea0 msgr2=0x7f50300b0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.783+0000 7f5035806640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5030160ea0 0x7f50300b0340 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f502800eaa0 tx=0x7f502800ef60 comp rx=0 tx=0).stop 2024-07-24T16:24:09.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.783+0000 7f5035806640 1 -- 172.21.15.159:0/3283587919 shutdown_connections 2024-07-24T16:24:09.786 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.783+0000 7f5035806640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5010077010 0x7f50100794d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.783+0000 7f5035806640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5030160ea0 0x7f50300b0340 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.783+0000 7f5035806640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f50300cef70 0x7f50301f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.783+0000 7f5035806640 1 --2- 172.21.15.159:0/3283587919 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f50300b6660 0x7f5030154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.783+0000 7f5035806640 1 -- 172.21.15.159:0/3283587919 >> 172.21.15.159:0/3283587919 conn(0x7f503008cdf0 msgr2=0x7f50300d1570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:09.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.783+0000 7f5035806640 1 -- 172.21.15.159:0/3283587919 shutdown_connections 2024-07-24T16:24:09.787 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.783+0000 7f5035806640 1 -- 172.21.15.159:0/3283587919 wait complete. 2024-07-24T16:24:09.797 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:09.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.897+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3487806607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e9415d680 msgr2=0x7f9e940b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.897+0000 7f9e9bbec640 1 --2- 172.21.15.159:0/3487806607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e9415d680 0x7f9e940b3ed0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9e940691d0 tx=0x7f9e9002a560 comp rx=0 tx=0).stop 2024-07-24T16:24:09.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.897+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3487806607 shutdown_connections 2024-07-24T16:24:09.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.897+0000 7f9e9bbec640 1 --2- 172.21.15.159:0/3487806607 >> v2:172.21.15.193:3300/0 conn(0x7f9e940b4b20 0x7f9e940ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.897+0000 7f9e9bbec640 1 --2- 172.21.15.159:0/3487806607 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9e940af380 0x7f9e940b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.897+0000 7f9e9bbec640 1 --2- 172.21.15.159:0/3487806607 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e9415d680 0x7f9e940b3ed0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.897+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3487806607 >> 172.21.15.159:0/3487806607 conn(0x7f9e9406d450 msgr2=0x7f9e9406d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:09.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.897+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3487806607 shutdown_connections 2024-07-24T16:24:09.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.897+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3487806607 wait complete. 2024-07-24T16:24:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.898+0000 7f9e9bbec640 1 Processor -- start 2024-07-24T16:24:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.898+0000 7f9e9bbec640 1 -- start start 2024-07-24T16:24:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e9bbec640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9e940af380 0x7f9e941476e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e9bbec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e940b4b20 0x7f9e941e7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e9bbec640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e9415d680 0x7f9e941e7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e9bbec640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9e940ae160 con 0x7f9e940b4b20 2024-07-24T16:24:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e9bbec640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9e940adfe0 con 0x7f9e9415d680 2024-07-24T16:24:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e9bbec640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9e940ae2e0 con 0x7f9e940af380 2024-07-24T16:24:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e99187640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e940b4b20 0x7f9e941e7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e99187640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e940b4b20 0x7f9e941e7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43778/0 (socket says 172.21.15.159:43778) 2024-07-24T16:24:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e99187640 1 -- 172.21.15.159:0/3751575299 learned_addr learned my addr 172.21.15.159:0/3751575299 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e99988640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9e940af380 0x7f9e941476e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e9a189640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e9415d680 0x7f9e941e7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e99187640 1 -- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9e940af380 msgr2=0x7f9e941476e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e99187640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9e940af380 0x7f9e941476e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e99187640 1 -- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e9415d680 msgr2=0x7f9e941e7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e99187640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e9415d680 0x7f9e941e7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e99187640 1 -- 172.21.15.159:0/3751575299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e94157aa0 con 0x7f9e940b4b20 2024-07-24T16:24:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e99187640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e940b4b20 0x7f9e941e7730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400c9a0 tx=0x7f9e8400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e8a7fc640 1 -- 172.21.15.159:0/3751575299 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84004220 con 0x7f9e940b4b20 2024-07-24T16:24:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e8a7fc640 1 -- 172.21.15.159:0/3751575299 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e840079b0 con 0x7f9e940b4b20 2024-07-24T16:24:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e8a7fc640 1 -- 172.21.15.159:0/3751575299 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e84007e00 con 0x7f9e940b4b20 2024-07-24T16:24:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.899+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3751575299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e94147c20 con 0x7f9e940b4b20 2024-07-24T16:24:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.900+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3751575299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e941e85d0 con 0x7f9e940b4b20 2024-07-24T16:24:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.900+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3751575299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e940b18e0 con 0x7f9e940b4b20 2024-07-24T16:24:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.901+0000 7f9e8a7fc640 1 -- 172.21.15.159:0/3751575299 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f9e84003610 con 0x7f9e940b4b20 2024-07-24T16:24:09.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.902+0000 7f9e8a7fc640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9e78077010 0x7f9e780794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:09.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.902+0000 7f9e8a7fc640 1 -- 172.21.15.159:0/3751575299 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e84098ca0 con 0x7f9e940b4b20 2024-07-24T16:24:09.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.902+0000 7f9e99988640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9e78077010 0x7f9e780794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:09.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.902+0000 7f9e99988640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9e78077010 0x7f9e780794d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e90033000 tx=0x7f9e90004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:09.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:09.906+0000 7f9e8a7fc640 1 -- 172.21.15.159:0/3751575299 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f9e940b18e0 con 0x7f9e940b4b20 2024-07-24T16:24:09.955 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:24:09.957 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:24:10.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.095+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3751575299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9e940ad890 con 0x7f9e940b4b20 2024-07-24T16:24:10.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.096+0000 7f9e8a7fc640 1 -- 172.21.15.159:0/3751575299 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f9e84014030 con 0x7f9e940b4b20 2024-07-24T16:24:10.099 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:10.099 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:07.801757+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:00.757174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:01.708421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-24T16:24:05.423097+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:10.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.098+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9e78077010 msgr2=0x7f9e780794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.098+0000 7f9e9bbec640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9e78077010 0x7f9e780794d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9e90033000 tx=0x7f9e90004730 comp rx=0 tx=0).stop 2024-07-24T16:24:10.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.098+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3751575299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e940b4b20 msgr2=0x7f9e941e7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.098+0000 7f9e9bbec640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e940b4b20 0x7f9e941e7730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f9e8400c9a0 tx=0x7f9e8400ce60 comp rx=0 tx=0).stop 2024-07-24T16:24:10.101 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.098+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3751575299 shutdown_connections 2024-07-24T16:24:10.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.098+0000 7f9e9bbec640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9e78077010 0x7f9e780794d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.098+0000 7f9e9bbec640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9e9415d680 0x7f9e941e7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.098+0000 7f9e9bbec640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9e940b4b20 0x7f9e941e7730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.098+0000 7f9e9bbec640 1 --2- 172.21.15.159:0/3751575299 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9e940af380 0x7f9e941476e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.098+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3751575299 >> 172.21.15.159:0/3751575299 conn(0x7f9e9406d450 msgr2=0x7f9e9415fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:10.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.098+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3751575299 shutdown_connections 2024-07-24T16:24:10.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.098+0000 7f9e9bbec640 1 -- 172.21.15.159:0/3751575299 wait complete. 2024-07-24T16:24:10.514 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-24T16:24:02.762268+0000', 'modified': '2024-07-24T16:24:07.801905+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4348}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4348': {'gid': 4348, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.193:6836/1274628948', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 1274628948}, {'type': 'v1', 'addr': '172.21.15.193:6836', 'nonce': 1274628948}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4348, 'qdb_cluster': [4348]} 2024-07-24T16:24:10.515 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-07-24T16:24:10.515 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-07-24T16:24:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.616+0000 7fd691d60640 1 -- 172.21.15.159:0/1374156661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd68c0cf1f0 msgr2=0x7fd68c071ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.616+0000 7fd691d60640 1 --2- 172.21.15.159:0/1374156661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd68c0cf1f0 0x7fd68c071ad0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd684009830 tx=0x7fd68402a410 comp rx=0 tx=0).stop 2024-07-24T16:24:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.616+0000 7fd691d60640 1 -- 172.21.15.159:0/1374156661 shutdown_connections 2024-07-24T16:24:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.616+0000 7fd691d60640 1 --2- 172.21.15.159:0/1374156661 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd68c0707c0 0x7fd68c071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.616+0000 7fd691d60640 1 --2- 172.21.15.159:0/1374156661 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd68c0cf1f0 0x7fd68c071ad0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.616+0000 7fd691d60640 1 -- 172.21.15.159:0/1374156661 >> 172.21.15.159:0/1374156661 conn(0x7fd68c0b36f0 msgr2=0x7fd68c0b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.616+0000 7fd691d60640 1 -- 172.21.15.159:0/1374156661 shutdown_connections 2024-07-24T16:24:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.616+0000 7fd691d60640 1 -- 172.21.15.159:0/1374156661 wait complete. 2024-07-24T16:24:10.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.617+0000 7fd691d60640 1 Processor -- start 2024-07-24T16:24:10.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.617+0000 7fd691d60640 1 -- start start 2024-07-24T16:24:10.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd691d60640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd68c0707c0 0x7fd68c148bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd691d60640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd68c0cee10 0x7fd68c1483d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd691d60640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd68c0cf1f0 0x7fd68c1f2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd691d60640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c0b5950 con 0x7fd68c0cee10 2024-07-24T16:24:10.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd691d60640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c0b57d0 con 0x7fd68c0cf1f0 2024-07-24T16:24:10.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd691d60640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c0b5ad0 con 0x7fd68c0707c0 2024-07-24T16:24:10.622 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd68affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd68c0cee10 0x7fd68c1483d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd68affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd68c0cee10 0x7fd68c1483d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43800/0 (socket says 172.21.15.159:43800) 2024-07-24T16:24:10.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd68affd640 1 -- 172.21.15.159:0/2298119774 learned_addr learned my addr 172.21.15.159:0/2298119774 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:10.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd68bfff640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd68c0cf1f0 0x7fd68c1f2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd68b7fe640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd68c0707c0 0x7fd68c148bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd68affd640 1 -- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd68c0707c0 msgr2=0x7fd68c148bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd68affd640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd68c0707c0 0x7fd68c148bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd68affd640 1 -- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd68c0cf1f0 msgr2=0x7fd68c1f2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd68affd640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd68c0cf1f0 0x7fd68c1f2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd68affd640 1 -- 172.21.15.159:0/2298119774 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68c1e59d0 con 0x7fd68c0cee10 2024-07-24T16:24:10.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd68b7fe640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd68c0707c0 0x7fd68c148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:10.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.618+0000 7fd68bfff640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd68c0cf1f0 0x7fd68c1f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:10.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.619+0000 7fd68affd640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd68c0cee10 0x7fd68c1483d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd68000d6d0 tx=0x7fd68000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:10.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.619+0000 7fd673fff640 1 -- 172.21.15.159:0/2298119774 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680017070 con 0x7fd68c0cee10 2024-07-24T16:24:10.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.619+0000 7fd673fff640 1 -- 172.21.15.159:0/2298119774 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd680005330 con 0x7fd68c0cee10 2024-07-24T16:24:10.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.619+0000 7fd691d60640 1 -- 172.21.15.159:0/2298119774 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd68c1e5cb0 con 0x7fd68c0cee10 2024-07-24T16:24:10.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.619+0000 7fd673fff640 1 -- 172.21.15.159:0/2298119774 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680009820 con 0x7fd68c0cee10 2024-07-24T16:24:10.624 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.619+0000 7fd691d60640 1 -- 172.21.15.159:0/2298119774 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68c148910 con 0x7fd68c0cee10 2024-07-24T16:24:10.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.620+0000 7fd673fff640 1 -- 172.21.15.159:0/2298119774 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd680009bd0 con 0x7fd68c0cee10 2024-07-24T16:24:10.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.621+0000 7fd673fff640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd678077010 0x7fd6780794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.621+0000 7fd673fff640 1 -- 172.21.15.159:0/2298119774 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd680098e40 con 0x7fd68c0cee10 2024-07-24T16:24:10.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.621+0000 7fd68b7fe640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd678077010 0x7fd6780794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.621+0000 7fd68b7fe640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd678077010 0x7fd6780794d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0b6460 tx=0x7fd67c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:10.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.621+0000 7fd694b91740 1 Processor -- start 2024-07-24T16:24:10.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.622+0000 7fd694b91740 1 -- start start 2024-07-24T16:24:10.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.622+0000 7fd694b91740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 0x555d76497090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.622+0000 7fd694b91740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d76451e20 0x555d76495790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.627 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.622+0000 7fd694b91740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d764523a0 0x555d76495cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.622+0000 7fd694b91740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555d763c3270 con 0x555d76496cb0 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.622+0000 7fd694b91740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555d763b2770 con 0x555d764523a0 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.622+0000 7fd694b91740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x555d763b67b0 con 0x555d76451e20 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd68b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 0x555d76497090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd68b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 0x555d76497090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43812/0 (socket says 172.21.15.159:43812) 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd68b7fe640 1 -- 172.21.15.159:0/2575279945 learned_addr learned my addr 172.21.15.159:0/2575279945 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd68affd640 1 --2- 172.21.15.159:0/2575279945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d76451e20 0x555d76495790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd68bfff640 1 --2- 172.21.15.159:0/2575279945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d764523a0 0x555d76495cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd68b7fe640 1 -- 172.21.15.159:0/2575279945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d76451e20 msgr2=0x555d76495790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd68b7fe640 1 --2- 172.21.15.159:0/2575279945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d76451e20 0x555d76495790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd68b7fe640 1 -- 172.21.15.159:0/2575279945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d764523a0 msgr2=0x555d76495cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd68b7fe640 1 --2- 172.21.15.159:0/2575279945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d764523a0 0x555d76495cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd68b7fe640 1 -- 172.21.15.159:0/2575279945 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d7635fe20 con 0x555d76496cb0 2024-07-24T16:24:10.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd68b7fe640 1 --2- 172.21.15.159:0/2575279945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 0x555d76497090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00df20 tx=0x7fd67c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61612234da966cce server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:10.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd6717fa640 1 -- 172.21.15.159:0/2575279945 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c014e10 con 0x555d76496cb0 2024-07-24T16:24:10.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd6717fa640 1 -- 172.21.15.159:0/2575279945 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd67c003970 con 0x555d76496cb0 2024-07-24T16:24:10.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.623+0000 7fd6717fa640 1 -- 172.21.15.159:0/2575279945 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c003d20 con 0x555d76496cb0 2024-07-24T16:24:10.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.624+0000 7fd694b91740 1 -- 172.21.15.159:0/2575279945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 msgr2=0x555d76497090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.624+0000 7fd694b91740 1 --2- 172.21.15.159:0/2575279945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 0x555d76497090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd67c00df20 tx=0x7fd67c010000 comp rx=0 tx=0).stop 2024-07-24T16:24:10.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.624+0000 7fd694b91740 1 -- 172.21.15.159:0/2575279945 shutdown_connections 2024-07-24T16:24:10.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.624+0000 7fd694b91740 1 --2- 172.21.15.159:0/2575279945 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d764523a0 0x555d76495cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.624+0000 7fd694b91740 1 --2- 172.21.15.159:0/2575279945 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d76451e20 0x555d76495790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.624+0000 7fd694b91740 1 --2- 172.21.15.159:0/2575279945 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 0x555d76497090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.624+0000 7fd694b91740 1 -- 172.21.15.159:0/2575279945 >> 172.21.15.159:0/2575279945 conn(0x555d7644d3f0 msgr2=0x555d76450e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:10.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.624+0000 7fd694b91740 1 -- 172.21.15.159:0/2575279945 shutdown_connections 2024-07-24T16:24:10.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.624+0000 7fd694b91740 1 -- 172.21.15.159:0/2575279945 wait complete. 2024-07-24T16:24:10.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.624+0000 7fd694b91740 1 -- start start 2024-07-24T16:24:10.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.625+0000 7fd694b91740 1 Processor -- start 2024-07-24T16:24:10.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.625+0000 7fd694b91740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d764523a0 0x555d76464c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.625+0000 7fd694b91740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d76496cb0 0x555d76465180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.625+0000 7fd694b91740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7648c2f0 0x555d7648ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.625+0000 7fd694b91740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555d76125620 con 0x555d7648c2f0 2024-07-24T16:24:10.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.625+0000 7fd694b91740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555d7633a840 con 0x555d76496cb0 2024-07-24T16:24:10.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.625+0000 7fd694b91740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x555d7644be10 con 0x555d764523a0 2024-07-24T16:24:10.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.625+0000 7fd694b91740 10 client.0 _ll_register_callbacks cb 0x555d763ab7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T16:24:10.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.625+0000 7fd68bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7648c2f0 0x555d7648ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.625+0000 7fd68bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7648c2f0 0x555d7648ffc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43826/0 (socket says 172.21.15.159:43826) 2024-07-24T16:24:10.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.625+0000 7fd68bfff640 1 -- 172.21.15.159:0/2147856201 learned_addr learned my addr 172.21.15.159:0/2147856201 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:10.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.625+0000 7fd68b7fe640 1 --2- 172.21.15.159:0/2147856201 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d764523a0 0x555d76464c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.625+0000 7fd68affd640 1 --2- 172.21.15.159:0/2147856201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d76496cb0 0x555d76465180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd68bfff640 1 -- 172.21.15.159:0/2147856201 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d764523a0 msgr2=0x555d76464c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:10.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd68bfff640 1 --2- 172.21.15.159:0/2147856201 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d764523a0 0x555d76464c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd68bfff640 1 -- 172.21.15.159:0/2147856201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d76496cb0 msgr2=0x555d76465180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd68bfff640 1 --2- 172.21.15.159:0/2147856201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d76496cb0 0x555d76465180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd68bfff640 1 -- 172.21.15.159:0/2147856201 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d76116850 con 0x555d7648c2f0 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd68bfff640 1 --2- 172.21.15.159:0/2147856201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7648c2f0 0x555d7648ffc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd684005940 tx=0x7fd684003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cc13b87f1539586 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd66a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd66a7fc640 1 -- 172.21.15.159:0/2147856201 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684043070 con 0x555d7648c2f0 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd66a7fc640 1 -- 172.21.15.159:0/2147856201 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd684005020 con 0x555d7648c2f0 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd694b91740 1 -- 172.21.15.159:0/2147856201 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd67c003970 con 0x555d7648c2f0 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd66a7fc640 1 -- 172.21.15.159:0/2147856201 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fd68404d050 con 0x555d7648c2f0 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd694b91740 10 client.4476 fetch_fsmap learned FSMap version 7 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd694b91740 1 -- 172.21.15.159:0/2147856201 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x555d7618d6b0 con 0x555d7648c2f0 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd66a7fc640 1 -- 172.21.15.159:0/2147856201 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd67c003970 con 0x555d7648c2f0 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd66a7fc640 1 -- 172.21.15.159:0/2147856201 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7fd684050020 con 0x555d7648c2f0 2024-07-24T16:24:10.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd694b91740 10 client.4476 fetch_fsmap finished waiting for FSMap version 7 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd694b91740 10 client.4476 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd694b91740 20 client.4476 populate_metadata read hostname 'smithi159' 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd694b91740 1 --2- 172.21.15.159:0/2147856201 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x555d764a9a30 0x555d764a9e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd694b91740 4 client.4476 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.626+0000 7fd694b91740 1 -- 172.21.15.159:0/2147856201 --> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d763c51c0 con 0x555d764a9a30 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.627+0000 7fd68b7fe640 1 --2- 172.21.15.159:0/2147856201 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x555d764a9a30 0x555d764a9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.627+0000 7fd66a7fc640 10 client.4476 ms_handle_connect on v2:172.21.15.193:6834/1274628948 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.627+0000 7fd68b7fe640 1 --2- 172.21.15.159:0/2147856201 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x555d764a9a30 0x555d764a9e10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fe263ef909515bc server_cookie=5540119eed8ad301 in_seq=0 out_seq=0 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd66a7fc640 1 -- 172.21.15.159:0/2147856201 <== mds.0 v2:172.21.15.193:6834/1274628948 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555d763c51c0 con 0x555d764a9a30 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd66a7fc640 10 client.4476 handle_command_reply: tid=0 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd694b91740 1 client.4476 shutdown 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd694b91740 1 -- 172.21.15.159:0/2147856201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7648c2f0 msgr2=0x555d7648ffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd694b91740 1 --2- 172.21.15.159:0/2147856201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7648c2f0 0x555d7648ffc0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd684005940 tx=0x7fd684003820 comp rx=0 tx=0).stop 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd694b91740 1 -- 172.21.15.159:0/2147856201 shutdown_connections 2024-07-24T16:24:10.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd694b91740 1 --2- 172.21.15.159:0/2147856201 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x555d764a9a30 0x555d764a9e10 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd694b91740 1 --2- 172.21.15.159:0/2147856201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d7648c2f0 0x555d7648ffc0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd66a7fc640 0 client.4476 ms_handle_reset on v2:172.21.15.193:6834/1274628948 2024-07-24T16:24:10.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd694b91740 1 --2- 172.21.15.159:0/2147856201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d76496cb0 0x555d76465180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd694b91740 1 --2- 172.21.15.159:0/2147856201 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d764523a0 0x555d76464c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd694b91740 1 -- 172.21.15.159:0/2147856201 >> 172.21.15.159:0/2147856201 conn(0x555d76451e20 msgr2=0x555d7644bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:10.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd694b91740 1 -- 172.21.15.159:0/2147856201 shutdown_connections 2024-07-24T16:24:10.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd694b91740 1 -- 172.21.15.159:0/2147856201 wait complete. 2024-07-24T16:24:10.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.628+0000 7fd694b91740 20 client.4476 trim_cache size 0 max 16384 2024-07-24T16:24:10.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.647+0000 7fd694b91740 1 Processor -- start 2024-07-24T16:24:10.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.647+0000 7fd694b91740 1 -- start start 2024-07-24T16:24:10.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd694b91740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d764523a0 0x555d7644bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd694b91740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d7648c2f0 0x555d7648bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd694b91740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 0x555d764508a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd694b91740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c1fec60 con 0x555d76496cb0 2024-07-24T16:24:10.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd694b91740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd68c1e4c50 con 0x555d7648c2f0 2024-07-24T16:24:10.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd694b91740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd68c1fe610 con 0x555d764523a0 2024-07-24T16:24:10.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd68bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 0x555d764508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd68bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 0x555d764508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43838/0 (socket says 172.21.15.159:43838) 2024-07-24T16:24:10.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd68bfff640 1 -- 172.21.15.159:0/2939397090 learned_addr learned my addr 172.21.15.159:0/2939397090 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:10.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd68bfff640 1 -- 172.21.15.159:0/2939397090 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d764523a0 msgr2=0x555d7644bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:10.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd68bfff640 1 --2- 172.21.15.159:0/2939397090 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d764523a0 0x555d7644bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd68bfff640 1 -- 172.21.15.159:0/2939397090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d7648c2f0 msgr2=0x555d7648bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:10.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd68bfff640 1 --2- 172.21.15.159:0/2939397090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d7648c2f0 0x555d7648bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd68bfff640 1 -- 172.21.15.159:0/2939397090 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d76490330 con 0x555d76496cb0 2024-07-24T16:24:10.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd68bfff640 1 --2- 172.21.15.159:0/2939397090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 0x555d764508a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd684004440 tx=0x7fd6840096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e293c9251edaca server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:10.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd670ff9640 1 -- 172.21.15.159:0/2939397090 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684056070 con 0x555d76496cb0 2024-07-24T16:24:10.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd670ff9640 1 -- 172.21.15.159:0/2939397090 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd684038040 con 0x555d76496cb0 2024-07-24T16:24:10.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.648+0000 7fd670ff9640 1 -- 172.21.15.159:0/2939397090 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd684043040 con 0x555d76496cb0 2024-07-24T16:24:10.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.649+0000 7fd694b91740 1 -- 172.21.15.159:0/2939397090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 msgr2=0x555d764508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.649+0000 7fd694b91740 1 --2- 172.21.15.159:0/2939397090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 0x555d764508a0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd684004440 tx=0x7fd6840096b0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.649+0000 7fd694b91740 1 -- 172.21.15.159:0/2939397090 shutdown_connections 2024-07-24T16:24:10.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.649+0000 7fd694b91740 1 --2- 172.21.15.159:0/2939397090 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d76496cb0 0x555d764508a0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.649+0000 7fd694b91740 1 --2- 172.21.15.159:0/2939397090 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d7648c2f0 0x555d7648bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.649+0000 7fd694b91740 1 --2- 172.21.15.159:0/2939397090 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d764523a0 0x555d7644bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.649+0000 7fd694b91740 1 -- 172.21.15.159:0/2939397090 >> 172.21.15.159:0/2939397090 conn(0x555d76451e20 msgr2=0x555d7648ca20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:10.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.649+0000 7fd694b91740 1 -- 172.21.15.159:0/2939397090 shutdown_connections 2024-07-24T16:24:10.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.649+0000 7fd694b91740 1 -- 172.21.15.159:0/2939397090 wait complete. 2024-07-24T16:24:10.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.649+0000 7fd694b91740 1 -- start start 2024-07-24T16:24:10.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.650+0000 7fd694b91740 1 Processor -- start 2024-07-24T16:24:10.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.650+0000 7fd694b91740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d764523a0 0x555d7649eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.650+0000 7fd694b91740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d7648c2f0 0x555d76518a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.650+0000 7fd694b91740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d76496cb0 0x555d7648ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.650+0000 7fd694b91740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x555d76462b10 con 0x555d764523a0 2024-07-24T16:24:10.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.650+0000 7fd694b91740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x555d7647a2f0 con 0x555d76496cb0 2024-07-24T16:24:10.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.650+0000 7fd694b91740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x555d7647af50 con 0x555d7648c2f0 2024-07-24T16:24:10.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.650+0000 7fd694b91740 10 client.0 _ll_register_callbacks cb 0x7fd6740036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T16:24:10.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.650+0000 7fd68b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d764523a0 0x555d7649eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.650+0000 7fd68b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d764523a0 0x555d7649eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43848/0 (socket says 172.21.15.159:43848) 2024-07-24T16:24:10.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.650+0000 7fd68b7fe640 1 -- 172.21.15.159:0/4228388784 learned_addr learned my addr 172.21.15.159:0/4228388784 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:10.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.650+0000 7fd68affd640 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d7648c2f0 0x555d76518a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.650+0000 7fd68bfff640 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d76496cb0 0x555d7648ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd68b7fe640 1 -- 172.21.15.159:0/4228388784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d7648c2f0 msgr2=0x555d76518a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:10.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd68b7fe640 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d7648c2f0 0x555d76518a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd68b7fe640 1 -- 172.21.15.159:0/4228388784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d76496cb0 msgr2=0x555d7648ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:10.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd68b7fe640 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d76496cb0 0x555d7648ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd68b7fe640 1 -- 172.21.15.159:0/4228388784 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d764644d0 con 0x555d764523a0 2024-07-24T16:24:10.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd68affd640 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d7648c2f0 0x555d76518a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:10.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd68b7fe640 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d764523a0 0x555d7649eac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x555d76498330 tx=0x7fd67c002190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e971bd7aaf002a8 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:10.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd66a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-07-24T16:24:10.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd66a7fc640 1 -- 172.21.15.159:0/4228388784 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0052a0 con 0x555d764523a0 2024-07-24T16:24:10.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd66a7fc640 1 -- 172.21.15.159:0/4228388784 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd67c005440 con 0x555d764523a0 2024-07-24T16:24:10.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd694b91740 1 -- 172.21.15.159:0/4228388784 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd684038040 con 0x555d764523a0 2024-07-24T16:24:10.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd66a7fc640 1 -- 172.21.15.159:0/4228388784 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7fd67c003970 con 0x555d764523a0 2024-07-24T16:24:10.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd694b91740 10 client.4482 fetch_fsmap learned FSMap version 7 2024-07-24T16:24:10.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd694b91740 1 -- 172.21.15.159:0/4228388784 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x555d7644fc50 con 0x555d764523a0 2024-07-24T16:24:10.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd66a7fc640 1 -- 172.21.15.159:0/4228388784 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd684038040 con 0x555d764523a0 2024-07-24T16:24:10.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd66a7fc640 1 -- 172.21.15.159:0/4228388784 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 7) ==== 3510+0+0 (secure 0 0 0) 0x7fd67c035360 con 0x555d764523a0 2024-07-24T16:24:10.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd694b91740 10 client.4482 fetch_fsmap finished waiting for FSMap version 7 2024-07-24T16:24:10.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd694b91740 10 client.4482 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-24T16:24:10.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd694b91740 20 client.4482 populate_metadata read hostname 'smithi159' 2024-07-24T16:24:10.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd694b91740 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x555d7644a6b0 0x555d764a7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd694b91740 4 client.4482 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-24T16:24:10.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd694b91740 1 -- 172.21.15.159:0/4228388784 --> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] -- command(tid 0: {"prefix": "status"}) -- 0x555d763c0c60 con 0x555d7644a6b0 2024-07-24T16:24:10.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.651+0000 7fd68affd640 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x555d7644a6b0 0x555d764a7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd66a7fc640 10 client.4482 ms_handle_connect on v2:172.21.15.193:6834/1274628948 2024-07-24T16:24:10.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd68affd640 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x555d7644a6b0 0x555d764a7c80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c282bf7d22128 server_cookie=89a87f6583e81c96 in_seq=0 out_seq=0 2024-07-24T16:24:10.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd66a7fc640 1 -- 172.21.15.159:0/4228388784 <== mds.0 v2:172.21.15.193:6834/1274628948 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x555d763c0c60 con 0x555d7644a6b0 2024-07-24T16:24:10.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd66a7fc640 10 client.4482 handle_command_reply: tid=0 2024-07-24T16:24:10.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd694b91740 1 client.4482 shutdown 2024-07-24T16:24:10.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd694b91740 1 -- 172.21.15.159:0/4228388784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d764523a0 msgr2=0x555d7649eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd694b91740 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d764523a0 0x555d7649eac0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x555d76498330 tx=0x7fd67c002190 comp rx=0 tx=0).stop 2024-07-24T16:24:10.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd694b91740 1 -- 172.21.15.159:0/4228388784 shutdown_connections 2024-07-24T16:24:10.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd694b91740 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x555d7644a6b0 0x555d764a7c80 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd694b91740 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x555d76496cb0 0x555d7648ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd694b91740 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x555d7648c2f0 0x555d76518a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd66a7fc640 0 client.4482 ms_handle_reset on v2:172.21.15.193:6834/1274628948 2024-07-24T16:24:10.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd694b91740 1 --2- 172.21.15.159:0/4228388784 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x555d764523a0 0x555d7649eac0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd694b91740 1 -- 172.21.15.159:0/4228388784 >> 172.21.15.159:0/4228388784 conn(0x555d76451e20 msgr2=0x555d7648bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:10.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd694b91740 1 -- 172.21.15.159:0/4228388784 shutdown_connections 2024-07-24T16:24:10.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd694b91740 1 -- 172.21.15.159:0/4228388784 wait complete. 2024-07-24T16:24:10.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.652+0000 7fd694b91740 20 client.4482 trim_cache size 0 max 16384 2024-07-24T16:24:10.662 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:24:10.662 INFO:teuthology.orchestra.run.smithi159.stdout: "cluster_fsid": "15e9c2b9-79b9-45cf-833e-5ce98c29c7f6", 2024-07-24T16:24:10.662 INFO:teuthology.orchestra.run.smithi159.stdout: "whoami": 0, 2024-07-24T16:24:10.662 INFO:teuthology.orchestra.run.smithi159.stdout: "id": 4348, 2024-07-24T16:24:10.662 INFO:teuthology.orchestra.run.smithi159.stdout: "want_state": "up:active", 2024-07-24T16:24:10.662 INFO:teuthology.orchestra.run.smithi159.stdout: "state": "up:active", 2024-07-24T16:24:10.662 INFO:teuthology.orchestra.run.smithi159.stdout: "fs_name": "cephfs", 2024-07-24T16:24:10.662 INFO:teuthology.orchestra.run.smithi159.stdout: "rank_uptime": 7.2554474149999999, 2024-07-24T16:24:10.662 INFO:teuthology.orchestra.run.smithi159.stdout: "mdsmap_epoch": 7, 2024-07-24T16:24:10.663 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch": 24, 2024-07-24T16:24:10.663 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch_barrier": 24, 2024-07-24T16:24:10.663 INFO:teuthology.orchestra.run.smithi159.stdout: "uptime": 13.137871199999999 2024-07-24T16:24:10.663 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:24:10.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.653+0000 7fd691d60640 1 -- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd678077010 msgr2=0x7fd6780794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.653+0000 7fd691d60640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd678077010 0x7fd6780794d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0b6460 tx=0x7fd67c009040 comp rx=0 tx=0).stop 2024-07-24T16:24:10.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.653+0000 7fd691d60640 1 -- 172.21.15.159:0/2298119774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd68c0cee10 msgr2=0x7fd68c1483d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.653+0000 7fd691d60640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd68c0cee10 0x7fd68c1483d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd68000d6d0 tx=0x7fd68000db90 comp rx=0 tx=0).stop 2024-07-24T16:24:10.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.653+0000 7fd691d60640 1 -- 172.21.15.159:0/2298119774 shutdown_connections 2024-07-24T16:24:10.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.653+0000 7fd691d60640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd678077010 0x7fd6780794d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.653+0000 7fd691d60640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd68c0cf1f0 0x7fd68c1f2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.653+0000 7fd691d60640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd68c0cee10 0x7fd68c1483d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.653+0000 7fd691d60640 1 --2- 172.21.15.159:0/2298119774 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd68c0707c0 0x7fd68c148bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.653+0000 7fd691d60640 1 -- 172.21.15.159:0/2298119774 >> 172.21.15.159:0/2298119774 conn(0x7fd68c0b36f0 msgr2=0x7fd68c15bbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:10.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.653+0000 7fd691d60640 1 -- 172.21.15.159:0/2298119774 shutdown_connections 2024-07-24T16:24:10.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.653+0000 7fd691d60640 1 -- 172.21.15.159:0/2298119774 wait complete. 2024-07-24T16:24:10.666 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-07-24T16:24:10.666 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-07-24T16:24:10.667 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-24T16:24:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.767+0000 7f9591c06640 1 -- 172.21.15.159:0/468311109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9578004800 msgr2=0x7f9578004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.767+0000 7f9591c06640 1 --2- 172.21.15.159:0/468311109 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9578004800 0x7f9578004c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9574009b50 tx=0x7f9578005830 comp rx=0 tx=0).stop 2024-07-24T16:24:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.767+0000 7f958bfff640 1 -- 172.21.15.159:0/468311109 reap_dead start 2024-07-24T16:24:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.767+0000 7f9591c06640 1 -- 172.21.15.159:0/468311109 shutdown_connections 2024-07-24T16:24:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.767+0000 7f9591c06640 1 -- 172.21.15.159:0/468311109 >> 172.21.15.159:0/468311109 conn(0x7f958c09cd30 msgr2=0x7f958c0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.767+0000 7f9591c06640 1 -- 172.21.15.159:0/468311109 shutdown_connections 2024-07-24T16:24:10.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.767+0000 7f9591c06640 1 -- 172.21.15.159:0/468311109 wait complete. 2024-07-24T16:24:10.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.768+0000 7f9591c06640 1 Processor -- start 2024-07-24T16:24:10.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.768+0000 7f9591c06640 1 -- start start 2024-07-24T16:24:10.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f9591c06640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9578004800 0x7f958c0cc260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f9591c06640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f958c0c9e00 0x7f958c1f8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f9591c06640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f958c160be0 0x7f958c0b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f9591c06640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f958c161f20 con 0x7f9578004800 2024-07-24T16:24:10.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f9591c06640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f958c0d0090 con 0x7f958c0c9e00 2024-07-24T16:24:10.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f9591c06640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f958c1620a0 con 0x7f958c160be0 2024-07-24T16:24:10.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f958b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9578004800 0x7f958c0cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f958b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9578004800 0x7f958c0cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43866/0 (socket says 172.21.15.159:43866) 2024-07-24T16:24:10.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f958b7fe640 1 -- 172.21.15.159:0/3967272264 learned_addr learned my addr 172.21.15.159:0/3967272264 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:10.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f958bfff640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f958c160be0 0x7f958c0b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f9583fff640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f958c0c9e00 0x7f958c1f8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f958b7fe640 1 -- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f958c160be0 msgr2=0x7f958c0b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f958b7fe640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f958c160be0 0x7f958c0b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f958b7fe640 1 -- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f958c0c9e00 msgr2=0x7f958c1f8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:10.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f958b7fe640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f958c0c9e00 0x7f958c1f8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:10.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f958b7fe640 1 -- 172.21.15.159:0/3967272264 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c1f41a0 con 0x7f9578004800 2024-07-24T16:24:10.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f958bfff640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f958c160be0 0x7f958c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:10.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f9583fff640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f958c0c9e00 0x7f958c1f8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:10.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.769+0000 7f958b7fe640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9578004800 0x7f958c0cc260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f957c011a60 tx=0x7f957c011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:10.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.770+0000 7f9588ff9640 1 -- 172.21.15.159:0/3967272264 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c01e070 con 0x7f9578004800 2024-07-24T16:24:10.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.770+0000 7f9588ff9640 1 -- 172.21.15.159:0/3967272264 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f957c00fc70 con 0x7f9578004800 2024-07-24T16:24:10.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.770+0000 7f9588ff9640 1 -- 172.21.15.159:0/3967272264 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c019410 con 0x7f9578004800 2024-07-24T16:24:10.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.770+0000 7f9591c06640 1 -- 172.21.15.159:0/3967272264 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958c1f4460 con 0x7f9578004800 2024-07-24T16:24:10.774 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.770+0000 7f9591c06640 1 -- 172.21.15.159:0/3967272264 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958c1f4a20 con 0x7f9578004800 2024-07-24T16:24:10.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.771+0000 7f9591c06640 1 -- 172.21.15.159:0/3967272264 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958c0b0620 con 0x7f9578004800 2024-07-24T16:24:10.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.771+0000 7f9588ff9640 1 -- 172.21.15.159:0/3967272264 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f957c021070 con 0x7f9578004800 2024-07-24T16:24:10.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.772+0000 7f9588ff9640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f956c077010 0x7f956c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:10.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.772+0000 7f9588ff9640 1 -- 172.21.15.159:0/3967272264 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f957c099230 con 0x7f9578004800 2024-07-24T16:24:10.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.772+0000 7f9583fff640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f956c077010 0x7f956c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:10.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.772+0000 7f9583fff640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f956c077010 0x7f956c0794d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9574035000 tx=0x7f957402d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:10.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.776+0000 7f9588ff9640 1 -- 172.21.15.159:0/3967272264 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f957c061b40 con 0x7f9578004800 2024-07-24T16:24:10.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.994+0000 7f9591c06640 1 -- 172.21.15.159:0/3967272264 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f958c0b7330 con 0x7f9578004800 2024-07-24T16:24:11.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.995+0000 7f9588ff9640 1 -- 172.21.15.159:0/3967272264 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f957c066090 con 0x7f9578004800 2024-07-24T16:24:11.035 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-07-24T16:24:11.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.997+0000 7f9591c06640 1 -- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f956c077010 msgr2=0x7f956c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:11.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.997+0000 7f9591c06640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f956c077010 0x7f956c0794d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9574035000 tx=0x7f957402d040 comp rx=0 tx=0).stop 2024-07-24T16:24:11.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.997+0000 7f9591c06640 1 -- 172.21.15.159:0/3967272264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9578004800 msgr2=0x7f958c0cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:11.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.997+0000 7f9591c06640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9578004800 0x7f958c0cc260 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f957c011a60 tx=0x7f957c011f20 comp rx=0 tx=0).stop 2024-07-24T16:24:11.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.997+0000 7f9591c06640 1 -- 172.21.15.159:0/3967272264 shutdown_connections 2024-07-24T16:24:11.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.997+0000 7f9591c06640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f956c077010 0x7f956c0794d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:11.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.997+0000 7f9591c06640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f958c160be0 0x7f958c0b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:11.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.997+0000 7f9591c06640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f958c0c9e00 0x7f958c1f8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:11.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.997+0000 7f9591c06640 1 --2- 172.21.15.159:0/3967272264 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9578004800 0x7f958c0cc260 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:11.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.997+0000 7f9591c06640 1 -- 172.21.15.159:0/3967272264 >> 172.21.15.159:0/3967272264 conn(0x7f958c09cd30 msgr2=0x7f958c0b68c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:11.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.997+0000 7f9591c06640 1 -- 172.21.15.159:0/3967272264 shutdown_connections 2024-07-24T16:24:11.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:10.997+0000 7f9591c06640 1 -- 172.21.15.159:0/3967272264 wait complete. 2024-07-24T16:24:11.038 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-07-24T16:24:11.038 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-24T16:24:11.038 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2024-07-24T16:24:11.038 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-07-24T16:24:11.038 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-07-24T16:24:11.038 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-07-24T16:24:11.038 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-07-24T16:24:11.038 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-24T16:24:11.038 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-07-24T16:24:11.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:11.039 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2024-07-24T16:24:11.054 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-24T16:24:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-24T16:24:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2024-07-24T16:24:11.054 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2024-07-24T16:24:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:11.055 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2024-07-24T16:24:11.055 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2024-07-24T16:24:11.055 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:11.055 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-24T16:24:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:11.055 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-24T16:24:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42769sec preferred_lft 42769sec 2024-07-24T16:24:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2024-07-24T16:24:11.056 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:11.056 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-07-24T16:24:11.056 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:11.056 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:11.056 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add name ceph-brx type bridge 2024-07-24T16:24:11.057 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr flush dev ceph-brx 2024-07-24T16:24:11.057 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set ceph-brx up 2024-07-24T16:24:11.057 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-07-24T16:24:11.057 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:11.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:11.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:11.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:11.254 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-24T16:24:11.281 INFO:teuthology.orchestra.run.smithi159.stdout:1 2024-07-24T16:24:11.283 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:11.283 DEBUG:teuthology.orchestra.run.smithi159:> route 2024-07-24T16:24:11.351 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2024-07-24T16:24:11.351 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-24T16:24:11.351 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-24T16:24:11.351 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-24T16:24:11.351 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-24T16:24:11.352 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:11.352 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:11.352 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-24T16:24:11.352 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-24T16:24:11.352 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-24T16:24:11.352 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:11.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:11.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:11.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:11.642 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-07-24T16:24:11.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:11.659 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2024-07-24T16:24:11.715 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:11.715 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:11.715 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-24T16:24:11.716 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-07-24T16:24:11.716 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:11.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:11.829 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:11.836 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-07-24T16:24:11.836 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:11.836 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:11.836 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-07-24T16:24:11.836 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-07-24T16:24:11.836 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-07-24T16:24:11.836 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-07-24T16:24:11.836 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-07-24T16:24:11.836 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:11.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:11.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:11.966 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:11.966 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:11.966 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2024-07-24T16:24:11.966 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.0 master ceph-brx 2024-07-24T16:24:11.966 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:12.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:12.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:12.044 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-07-24T16:24:12.044 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:24:12.044 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-07-24T16:24:12.059 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-07-24T16:24:12.059 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:24:12.059 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-07-24T16:24:12.114 DEBUG:teuthology.orchestra.run.smithi159:> sudo modprobe fuse 2024-07-24T16:24:12.179 DEBUG:teuthology.orchestra.run.smithi159:> cat /proc/self/mounts | awk '{print $2}' 2024-07-24T16:24:12.235 INFO:teuthology.orchestra.run.smithi159.stdout:/proc 2024-07-24T16:24:12.235 INFO:teuthology.orchestra.run.smithi159.stdout:/sys 2024-07-24T16:24:12.235 INFO:teuthology.orchestra.run.smithi159.stdout:/dev 2024-07-24T16:24:12.235 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/security 2024-07-24T16:24:12.235 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/shm 2024-07-24T16:24:12.235 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/pts 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/run 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/cgroup 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/pstore 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/bpf 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/ 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/selinux 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/proc/sys/fs/binfmt_misc 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/mqueue 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/debug 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/hugepages 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/tracing 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/fuse/connections 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-sysctl.service 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/config 2024-07-24T16:24:12.236 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-07-24T16:24:12.237 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-07-24T16:24:12.237 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/nfs/rpc_pipefs 2024-07-24T16:24:12.237 INFO:teuthology.orchestra.run.smithi159.stdout:/run/user/1000 2024-07-24T16:24:12.237 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/ceph 2024-07-24T16:24:12.237 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/ceph/osd/ceph-0 2024-07-24T16:24:12.237 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/ceph/osd/ceph-1 2024-07-24T16:24:12.237 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/ceph/osd/ceph-2 2024-07-24T16:24:12.237 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/ceph/osd/ceph-3 2024-07-24T16:24:12.237 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns 2024-07-24T16:24:12.237 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-24T16:24:12.237 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-24T16:24:12.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:12.238 DEBUG:teuthology.orchestra.run.smithi159:> ls /sys/fs/fuse/connections 2024-07-24T16:24:12.291 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-07-24T16:24:12.291 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-07-24T16:24:12.332 DEBUG:teuthology.orchestra.run.smithi159:> sudo modprobe fuse 2024-07-24T16:24:12.356 DEBUG:teuthology.orchestra.run.smithi159:> cat /proc/self/mounts | awk '{print $2}' 2024-07-24T16:24:12.413 INFO:teuthology.orchestra.run.smithi159.stdout:/proc 2024-07-24T16:24:12.413 INFO:teuthology.orchestra.run.smithi159.stdout:/sys 2024-07-24T16:24:12.413 INFO:teuthology.orchestra.run.smithi159.stdout:/dev 2024-07-24T16:24:12.413 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/security 2024-07-24T16:24:12.413 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/shm 2024-07-24T16:24:12.413 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/pts 2024-07-24T16:24:12.414 INFO:teuthology.orchestra.run.smithi159.stdout:/run 2024-07-24T16:24:12.414 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/cgroup 2024-07-24T16:24:12.414 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/pstore 2024-07-24T16:24:12.414 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/bpf 2024-07-24T16:24:12.414 INFO:teuthology.orchestra.run.smithi159.stdout:/ 2024-07-24T16:24:12.414 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/selinux 2024-07-24T16:24:12.414 INFO:teuthology.orchestra.run.smithi159.stdout:/proc/sys/fs/binfmt_misc 2024-07-24T16:24:12.414 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/mqueue 2024-07-24T16:24:12.414 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/debug 2024-07-24T16:24:12.414 INFO:teuthology.orchestra.run.smithi159.stdout:/dev/hugepages 2024-07-24T16:24:12.414 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/tracing 2024-07-24T16:24:12.414 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/fs/fuse/connections 2024-07-24T16:24:12.415 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-sysctl.service 2024-07-24T16:24:12.415 INFO:teuthology.orchestra.run.smithi159.stdout:/sys/kernel/config 2024-07-24T16:24:12.415 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-07-24T16:24:12.415 INFO:teuthology.orchestra.run.smithi159.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-07-24T16:24:12.415 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/nfs/rpc_pipefs 2024-07-24T16:24:12.415 INFO:teuthology.orchestra.run.smithi159.stdout:/run/user/1000 2024-07-24T16:24:12.415 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/ceph 2024-07-24T16:24:12.415 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/ceph/osd/ceph-0 2024-07-24T16:24:12.415 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/ceph/osd/ceph-1 2024-07-24T16:24:12.415 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/ceph/osd/ceph-2 2024-07-24T16:24:12.415 INFO:teuthology.orchestra.run.smithi159.stdout:/var/lib/ceph/osd/ceph-3 2024-07-24T16:24:12.415 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns 2024-07-24T16:24:12.415 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-24T16:24:12.416 INFO:teuthology.orchestra.run.smithi159.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-24T16:24:12.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:12.416 DEBUG:teuthology.orchestra.run.smithi159:> ls /sys/fs/fuse/connections 2024-07-24T16:24:12.447 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi159.stderr:2024-07-24T16:24:12.445+0000 7fb4c380d480 -1 init, newargv = 0x559dbce5b3f0 newargc=15 2024-07-24T16:24:12.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi159.stderr:ceph-fuse[45699]: starting ceph client 2024-07-24T16:24:12.454 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi159.stderr:ceph-fuse[45699]: starting fuse 2024-07-24T16:24:12.463 INFO:teuthology.orchestra.run.smithi159.stdout:40 2024-07-24T16:24:12.464 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2024-07-24T16:24:12.464 DEBUG:teuthology.orchestra.run.smithi159:> sudo stdin-killer -- python3 -c ' 2024-07-24T16:24:12.464 DEBUG:teuthology.orchestra.run.smithi159:> import glob 2024-07-24T16:24:12.464 DEBUG:teuthology.orchestra.run.smithi159:> import re 2024-07-24T16:24:12.464 DEBUG:teuthology.orchestra.run.smithi159:> import os 2024-07-24T16:24:12.464 DEBUG:teuthology.orchestra.run.smithi159:> import subprocess 2024-07-24T16:24:12.464 DEBUG:teuthology.orchestra.run.smithi159:> 2024-07-24T16:24:12.464 DEBUG:teuthology.orchestra.run.smithi159:> def _find_admin_socket(client_name): 2024-07-24T16:24:12.465 DEBUG:teuthology.orchestra.run.smithi159:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-07-24T16:24:12.465 DEBUG:teuthology.orchestra.run.smithi159:> files = glob.glob(asok_path) 2024-07-24T16:24:12.465 DEBUG:teuthology.orchestra.run.smithi159:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-07-24T16:24:12.465 DEBUG:teuthology.orchestra.run.smithi159:> 2024-07-24T16:24:12.465 DEBUG:teuthology.orchestra.run.smithi159:> # Given a non-glob path, it better be there 2024-07-24T16:24:12.465 DEBUG:teuthology.orchestra.run.smithi159:> if "*" not in asok_path: 2024-07-24T16:24:12.465 DEBUG:teuthology.orchestra.run.smithi159:> assert(len(files) == 1) 2024-07-24T16:24:12.465 DEBUG:teuthology.orchestra.run.smithi159:> return files[0] 2024-07-24T16:24:12.465 DEBUG:teuthology.orchestra.run.smithi159:> 2024-07-24T16:24:12.465 DEBUG:teuthology.orchestra.run.smithi159:> for f in files: 2024-07-24T16:24:12.465 DEBUG:teuthology.orchestra.run.smithi159:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-07-24T16:24:12.465 DEBUG:teuthology.orchestra.run.smithi159:> if os.path.exists("/proc/{0}".format(pid)): 2024-07-24T16:24:12.465 DEBUG:teuthology.orchestra.run.smithi159:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-07-24T16:24:12.466 DEBUG:teuthology.orchestra.run.smithi159:> contents = proc_f.read() 2024-07-24T16:24:12.466 DEBUG:teuthology.orchestra.run.smithi159:> if mountpoint in contents: 2024-07-24T16:24:12.466 DEBUG:teuthology.orchestra.run.smithi159:> return f 2024-07-24T16:24:12.466 DEBUG:teuthology.orchestra.run.smithi159:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-07-24T16:24:12.466 DEBUG:teuthology.orchestra.run.smithi159:> 2024-07-24T16:24:12.466 DEBUG:teuthology.orchestra.run.smithi159:> print(_find_admin_socket("client.admin")) 2024-07-24T16:24:12.466 DEBUG:teuthology.orchestra.run.smithi159:> ' 2024-07-24T16:24:12.583 INFO:teuthology.orchestra.run.smithi159.stdout:/var/run/ceph/ceph-client.admin.45699.asok 2024-07-24T16:24:12.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:12.594 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.45699.asok 2024-07-24T16:24:12.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:12.595 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.45699.asok status 2024-07-24T16:24:12.730 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:24:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "metadata": { 2024-07-24T16:24:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_sha1": "86385b1daf5235400bbcd34a02515d168bde88e2", 2024-07-24T16:24:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "ceph_version": "ceph version 19.0.0-5197-g86385b1d (86385b1daf5235400bbcd34a02515d168bde88e2) squid (dev)", 2024-07-24T16:24:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "entity_id": "admin", 2024-07-24T16:24:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "hostname": "smithi159", 2024-07-24T16:24:12.730 INFO:teuthology.orchestra.run.smithi159.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "pid": "45699", 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "root": "/" 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "dentry_count": 0, 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "dentry_pinned_count": 0, 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "id": 4494, 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "inst": { 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "name": { 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "client", 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "num": 4494 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": { 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v1", 2024-07-24T16:24:12.731 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "192.168.0.1:0", 2024-07-24T16:24:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 1792010214 2024-07-24T16:24:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": { 2024-07-24T16:24:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "type": "v1", 2024-07-24T16:24:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "addr": "192.168.0.1:0", 2024-07-24T16:24:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "nonce": 1792010214 2024-07-24T16:24:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "inst_str": "client.4494 192.168.0.1:0/1792010214", 2024-07-24T16:24:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "addr_str": "192.168.0.1:0/1792010214", 2024-07-24T16:24:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "inode_count": 1, 2024-07-24T16:24:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "mds_epoch": 7, 2024-07-24T16:24:12.732 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_epoch": 24, 2024-07-24T16:24:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: "osd_epoch_barrier": 0, 2024-07-24T16:24:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: "blocklisted": false, 2024-07-24T16:24:12.733 INFO:teuthology.orchestra.run.smithi159.stdout: "fs_name": "cephfs" 2024-07-24T16:24:12.733 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:24:12.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:12.738 DEBUG:teuthology.orchestra.run.smithi159:> stat --file-system '--printf=%T 2024-07-24T16:24:12.738 DEBUG:teuthology.orchestra.run.smithi159:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-07-24T16:24:12.754 INFO:teuthology.orchestra.run.smithi159.stdout:fuseblk 2024-07-24T16:24:12.755 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-07-24T16:24:12.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:12.755 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-07-24T16:24:12.821 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-07-24T16:24:12.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:24:12.927 INFO:teuthology.orchestra.run.smithi159.stdout:# file: . 2024-07-24T16:24:12.927 INFO:teuthology.orchestra.run.smithi159.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-07-24T16:24:12.927 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:12.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:12.933 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:24:12.933 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:12.950 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-24T16:24:13.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.091+0000 7f4b91224640 1 -- 172.21.15.159:0/1809098038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b78004af0 msgr2=0x7f4b78004ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:13.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.091+0000 7f4b91224640 1 --2- 172.21.15.159:0/1809098038 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b78004af0 0x7f4b78004ef0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00c710 tx=0x7f4b78006940 comp rx=0 tx=0).stop 2024-07-24T16:24:13.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.091+0000 7f4b8b59e640 1 -- 172.21.15.159:0/1809098038 reap_dead start 2024-07-24T16:24:13.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.091+0000 7f4b91224640 1 -- 172.21.15.159:0/1809098038 shutdown_connections 2024-07-24T16:24:13.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.091+0000 7f4b91224640 1 -- 172.21.15.159:0/1809098038 >> 172.21.15.159:0/1809098038 conn(0x7f4b8c06c560 msgr2=0x7f4b8c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:13.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.091+0000 7f4b91224640 1 -- 172.21.15.159:0/1809098038 shutdown_connections 2024-07-24T16:24:13.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.091+0000 7f4b91224640 1 -- 172.21.15.159:0/1809098038 wait complete. 2024-07-24T16:24:13.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.093+0000 7f4b91224640 1 Processor -- start 2024-07-24T16:24:13.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.093+0000 7f4b91224640 1 -- start start 2024-07-24T16:24:13.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.093+0000 7f4b91224640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b78004af0 0x7f4b8c1548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:13.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.093+0000 7f4b91224640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b8c1f3ee0 0x7f4b8c14f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:13.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.093+0000 7f4b91224640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b8c158f80 0x7f4b8c0ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:13.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.093+0000 7f4b91224640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c0cf4b0 con 0x7f4b78004af0 2024-07-24T16:24:13.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.093+0000 7f4b91224640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8c0b45d0 con 0x7f4b8c1f3ee0 2024-07-24T16:24:13.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.093+0000 7f4b91224640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4b8c0cf630 con 0x7f4b8c158f80 2024-07-24T16:24:13.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.093+0000 7f4b8ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b78004af0 0x7f4b8c1548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:13.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b8ad9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b78004af0 0x7f4b8c1548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52268/0 (socket says 172.21.15.159:52268) 2024-07-24T16:24:13.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b8ad9d640 1 -- 172.21.15.159:0/3475866564 learned_addr learned my addr 172.21.15.159:0/3475866564 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:13.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b83fff640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b8c1f3ee0 0x7f4b8c14f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:13.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b8b59e640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b8c158f80 0x7f4b8c0ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:13.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b8ad9d640 1 -- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b8c158f80 msgr2=0x7f4b8c0ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:13.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b8ad9d640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b8c158f80 0x7f4b8c0ad890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b8ad9d640 1 -- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b8c1f3ee0 msgr2=0x7f4b8c14f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:13.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b8ad9d640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b8c1f3ee0 0x7f4b8c14f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b8ad9d640 1 -- 172.21.15.159:0/3475866564 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8c1f4370 con 0x7f4b78004af0 2024-07-24T16:24:13.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b8ad9d640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b78004af0 0x7f4b8c1548c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00c630 tx=0x7f4b7c006310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:13.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b837fe640 1 -- 172.21.15.159:0/3475866564 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c004a30 con 0x7f4b78004af0 2024-07-24T16:24:13.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b837fe640 1 -- 172.21.15.159:0/3475866564 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b7c039070 con 0x7f4b78004af0 2024-07-24T16:24:13.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b837fe640 1 -- 172.21.15.159:0/3475866564 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b7c006500 con 0x7f4b78004af0 2024-07-24T16:24:13.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b91224640 1 -- 172.21.15.159:0/3475866564 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8c1f4650 con 0x7f4b78004af0 2024-07-24T16:24:13.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.094+0000 7f4b91224640 1 -- 172.21.15.159:0/3475866564 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b8c1f4c10 con 0x7f4b78004af0 2024-07-24T16:24:13.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.095+0000 7f4b91224640 1 -- 172.21.15.159:0/3475866564 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b8c0b3850 con 0x7f4b78004af0 2024-07-24T16:24:13.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.096+0000 7f4b837fe640 1 -- 172.21.15.159:0/3475866564 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f4b7c043060 con 0x7f4b78004af0 2024-07-24T16:24:13.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.096+0000 7f4b837fe640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4b6c077010 0x7f4b6c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:13.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.096+0000 7f4b837fe640 1 -- 172.21.15.159:0/3475866564 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4b7c0b8110 con 0x7f4b78004af0 2024-07-24T16:24:13.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.096+0000 7f4b83fff640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4b6c077010 0x7f4b6c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:13.100 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.097+0000 7f4b83fff640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4b6c077010 0x7f4b6c0794d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4b74006bf0 tx=0x7f4b740010e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:13.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.100+0000 7f4b837fe640 1 -- 172.21.15.159:0/3475866564 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f4b7c081060 con 0x7f4b78004af0 2024-07-24T16:24:13.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.295+0000 7f4b91224640 1 -- 172.21.15.159:0/3475866564 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4b8c15c000 con 0x7f4b78004af0 2024-07-24T16:24:13.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.296+0000 7f4b837fe640 1 -- 172.21.15.159:0/3475866564 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f4b7c0892a0 con 0x7f4b78004af0 2024-07-24T16:24:13.298 INFO:teuthology.orchestra.run.smithi159.stderr:listed 0 entries 2024-07-24T16:24:13.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.298+0000 7f4b91224640 1 -- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4b6c077010 msgr2=0x7f4b6c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:13.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.298+0000 7f4b91224640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4b6c077010 0x7f4b6c0794d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4b74006bf0 tx=0x7f4b740010e0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.298+0000 7f4b91224640 1 -- 172.21.15.159:0/3475866564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b78004af0 msgr2=0x7f4b8c1548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:13.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.298+0000 7f4b91224640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b78004af0 0x7f4b8c1548c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c00c630 tx=0x7f4b7c006310 comp rx=0 tx=0).stop 2024-07-24T16:24:13.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.298+0000 7f4b91224640 1 -- 172.21.15.159:0/3475866564 shutdown_connections 2024-07-24T16:24:13.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.298+0000 7f4b91224640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4b6c077010 0x7f4b6c0794d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.298+0000 7f4b91224640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4b8c158f80 0x7f4b8c0ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.298+0000 7f4b91224640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4b8c1f3ee0 0x7f4b8c14f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.298+0000 7f4b91224640 1 --2- 172.21.15.159:0/3475866564 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4b78004af0 0x7f4b8c1548c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.298+0000 7f4b91224640 1 -- 172.21.15.159:0/3475866564 >> 172.21.15.159:0/3475866564 conn(0x7f4b8c06c560 msgr2=0x7f4b8c06d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:13.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.298+0000 7f4b91224640 1 -- 172.21.15.159:0/3475866564 shutdown_connections 2024-07-24T16:24:13.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.298+0000 7f4b91224640 1 -- 172.21.15.159:0/3475866564 wait complete. 2024-07-24T16:24:13.311 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:24:13.311 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:13.328 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-24T16:24:13.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.472+0000 7f94877c3640 1 -- 172.21.15.159:0/143021450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f948006d670 msgr2=0x7f948006c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:13.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.472+0000 7f94877c3640 1 --2- 172.21.15.159:0/143021450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f948006d670 0x7f948006c770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9470005fd0 tx=0x7f947002a670 comp rx=0 tx=0).stop 2024-07-24T16:24:13.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.472+0000 7f94877c3640 1 -- 172.21.15.159:0/143021450 shutdown_connections 2024-07-24T16:24:13.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.472+0000 7f94877c3640 1 --2- 172.21.15.159:0/143021450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9480161370 0x7f948006ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.472+0000 7f94877c3640 1 --2- 172.21.15.159:0/143021450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f948006d670 0x7f948006c770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.472+0000 7f94877c3640 1 -- 172.21.15.159:0/143021450 >> 172.21.15.159:0/143021450 conn(0x7f94800b5780 msgr2=0x7f94800b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:13.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.472+0000 7f94877c3640 1 -- 172.21.15.159:0/143021450 shutdown_connections 2024-07-24T16:24:13.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.472+0000 7f94877c3640 1 -- 172.21.15.159:0/143021450 wait complete. 2024-07-24T16:24:13.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.473+0000 7f94877c3640 1 Processor -- start 2024-07-24T16:24:13.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.473+0000 7f94877c3640 1 -- start start 2024-07-24T16:24:13.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f94877c3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f948006d670 0x7f94800c82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:13.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f94877c3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f948015d870 0x7f94801f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:13.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f94877c3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9480161370 0x7f94800c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:13.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f94877c3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f94800d29e0 con 0x7f948015d870 2024-07-24T16:24:13.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f94877c3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f94800d2860 con 0x7f948006d670 2024-07-24T16:24:13.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f94877c3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f94800d2b60 con 0x7f9480161370 2024-07-24T16:24:13.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f9484d5e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f948015d870 0x7f94801f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:13.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f9484d5e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f948015d870 0x7f94801f4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52296/0 (socket says 172.21.15.159:52296) 2024-07-24T16:24:13.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f9484d5e640 1 -- 172.21.15.159:0/2688644402 learned_addr learned my addr 172.21.15.159:0/2688644402 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:13.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f9485d60640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9480161370 0x7f94800c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:13.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f948555f640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f948006d670 0x7f94800c82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:13.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f9484d5e640 1 -- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9480161370 msgr2=0x7f94800c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:13.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f9484d5e640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9480161370 0x7f94800c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f9484d5e640 1 -- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f948006d670 msgr2=0x7f94800c82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:13.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f9484d5e640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f948006d670 0x7f94800c82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f9484d5e640 1 -- 172.21.15.159:0/2688644402 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94800c74e0 con 0x7f948015d870 2024-07-24T16:24:13.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f948555f640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f948006d670 0x7f94800c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:13.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f9484d5e640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f948015d870 0x7f94801f4e30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9470000c00 tx=0x7f94700039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:13.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f9475ffb640 1 -- 172.21.15.159:0/2688644402 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f947003f070 con 0x7f948015d870 2024-07-24T16:24:13.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f9475ffb640 1 -- 172.21.15.159:0/2688644402 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9470004890 con 0x7f948015d870 2024-07-24T16:24:13.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f94877c3640 1 -- 172.21.15.159:0/2688644402 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94800c77c0 con 0x7f948015d870 2024-07-24T16:24:13.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.474+0000 7f9475ffb640 1 -- 172.21.15.159:0/2688644402 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9470035030 con 0x7f948015d870 2024-07-24T16:24:13.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.475+0000 7f94877c3640 1 -- 172.21.15.159:0/2688644402 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94800c7d80 con 0x7f948015d870 2024-07-24T16:24:13.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.475+0000 7f94877c3640 1 -- 172.21.15.159:0/2688644402 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94800d30f0 con 0x7f948015d870 2024-07-24T16:24:13.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.476+0000 7f9475ffb640 1 -- 172.21.15.159:0/2688644402 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f9470042070 con 0x7f948015d870 2024-07-24T16:24:13.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.477+0000 7f9475ffb640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9464077010 0x7f94640794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:13.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.477+0000 7f9475ffb640 1 -- 172.21.15.159:0/2688644402 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f94700b9b00 con 0x7f948015d870 2024-07-24T16:24:13.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.477+0000 7f948555f640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9464077010 0x7f94640794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:13.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.477+0000 7f948555f640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9464077010 0x7f94640794d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f947c000f60 tx=0x7f947c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:13.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.481+0000 7f9475ffb640 1 -- 172.21.15.159:0/2688644402 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f9470082a50 con 0x7f948015d870 2024-07-24T16:24:13.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.675+0000 7f94877c3640 1 -- 172.21.15.159:0/2688644402 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f948006d3a0 con 0x7f948015d870 2024-07-24T16:24:13.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.675+0000 7f9475ffb640 1 -- 172.21.15.159:0/2688644402 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f9470082350 con 0x7f948015d870 2024-07-24T16:24:13.678 INFO:teuthology.orchestra.run.smithi159.stderr:listed 0 entries 2024-07-24T16:24:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.678+0000 7f94877c3640 1 -- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9464077010 msgr2=0x7f94640794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.678+0000 7f94877c3640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9464077010 0x7f94640794d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f947c000f60 tx=0x7f947c009040 comp rx=0 tx=0).stop 2024-07-24T16:24:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.678+0000 7f94877c3640 1 -- 172.21.15.159:0/2688644402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f948015d870 msgr2=0x7f94801f4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.678+0000 7f94877c3640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f948015d870 0x7f94801f4e30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9470000c00 tx=0x7f94700039e0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.678+0000 7f94877c3640 1 -- 172.21.15.159:0/2688644402 shutdown_connections 2024-07-24T16:24:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.678+0000 7f94877c3640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9464077010 0x7f94640794d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.678+0000 7f94877c3640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9480161370 0x7f94800c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.678+0000 7f94877c3640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f948015d870 0x7f94801f4e30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.678+0000 7f94877c3640 1 --2- 172.21.15.159:0/2688644402 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f948006d670 0x7f94800c82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.678+0000 7f94877c3640 1 -- 172.21.15.159:0/2688644402 >> 172.21.15.159:0/2688644402 conn(0x7f94800b5780 msgr2=0x7f94800b90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:13.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.678+0000 7f94877c3640 1 -- 172.21.15.159:0/2688644402 shutdown_connections 2024-07-24T16:24:13.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:13.678+0000 7f94877c3640 1 -- 172.21.15.159:0/2688644402 wait complete. 2024-07-24T16:24:13.691 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi159.front.sepia.ceph.com... 2024-07-24T16:24:13.691 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:13.691 DEBUG:teuthology.orchestra.run.smithi159:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-07-24T16:24:13.714 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi159.stderr:ceph-fuse[45699]: fuse finished with error 0 and tester_r 0 2024-07-24T16:24:13.717 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:24:19.818 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:24:19.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:19.818 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-07-24T16:24:19.846 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:19.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.996+0000 7f1ec8d97640 1 -- 172.21.15.159:0/1204835347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec4158fe0 msgr2=0x7f1ec406f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:19.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.996+0000 7f1ec8d97640 1 --2- 172.21.15.159:0/1204835347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec4158fe0 0x7f1ec406f890 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1ec4073510 tx=0x7f1eb402a8b0 comp rx=0 tx=0).stop 2024-07-24T16:24:19.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.996+0000 7f1ec8d97640 1 -- 172.21.15.159:0/1204835347 shutdown_connections 2024-07-24T16:24:19.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.996+0000 7f1ec8d97640 1 --2- 172.21.15.159:0/1204835347 >> v2:172.21.15.193:3300/0 conn(0x7f1ec406d670 0x7f1ec40cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.996+0000 7f1ec8d97640 1 --2- 172.21.15.159:0/1204835347 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec4158fe0 0x7f1ec406f890 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.996+0000 7f1ec8d97640 1 -- 172.21.15.159:0/1204835347 >> 172.21.15.159:0/1204835347 conn(0x7f1ec406c560 msgr2=0x7f1ec406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:20.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.996+0000 7f1ec8d97640 1 -- 172.21.15.159:0/1204835347 shutdown_connections 2024-07-24T16:24:20.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.996+0000 7f1ec8d97640 1 -- 172.21.15.159:0/1204835347 wait complete. 2024-07-24T16:24:20.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.998+0000 7f1ec8d97640 1 Processor -- start 2024-07-24T16:24:20.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.998+0000 7f1ec8d97640 1 -- start start 2024-07-24T16:24:20.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.998+0000 7f1ec8d97640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec406d670 0x7f1ec41f1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:20.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.998+0000 7f1ec8d97640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ec40cf860 0x7f1ec40a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:20.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.998+0000 7f1ec8d97640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ec4158fe0 0x7f1ec40a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:20.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.998+0000 7f1ec8d97640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec41593c0 con 0x7f1ec406d670 2024-07-24T16:24:20.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.998+0000 7f1ec8d97640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1ec406dc50 con 0x7f1ec4158fe0 2024-07-24T16:24:20.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.998+0000 7f1ec8d97640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1ec4159540 con 0x7f1ec40cf860 2024-07-24T16:24:20.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1ec259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec406d670 0x7f1ec41f1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:20.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1ec259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec406d670 0x7f1ec41f1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52316/0 (socket says 172.21.15.159:52316) 2024-07-24T16:24:20.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1ec259c640 1 -- 172.21.15.159:0/2684872361 learned_addr learned my addr 172.21.15.159:0/2684872361 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:20.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1ec2d9d640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ec4158fe0 0x7f1ec40a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:20.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1ec1d9b640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ec40cf860 0x7f1ec40a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:20.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1ec259c640 1 -- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ec40cf860 msgr2=0x7f1ec40a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:20.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1ec259c640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ec40cf860 0x7f1ec40a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1ec259c640 1 -- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ec4158fe0 msgr2=0x7f1ec40a99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:20.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1ec259c640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ec4158fe0 0x7f1ec40a99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1ec259c640 1 -- 172.21.15.159:0/2684872361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ec415e860 con 0x7f1ec406d670 2024-07-24T16:24:20.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1ec259c640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec406d670 0x7f1ec41f1510 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4009b30 tx=0x7f1eb40039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:20.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1eb2ffd640 1 -- 172.21.15.159:0/2684872361 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4031990 con 0x7f1ec406d670 2024-07-24T16:24:20.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1eb2ffd640 1 -- 172.21.15.159:0/2684872361 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1eb4031c20 con 0x7f1ec406d670 2024-07-24T16:24:20.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1ec8d97640 1 -- 172.21.15.159:0/2684872361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ec415e580 con 0x7f1ec406d670 2024-07-24T16:24:20.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1eb2ffd640 1 -- 172.21.15.159:0/2684872361 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eb4033330 con 0x7f1ec406d670 2024-07-24T16:24:20.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:19.999+0000 7f1ec8d97640 1 -- 172.21.15.159:0/2684872361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ec40afc90 con 0x7f1ec406d670 2024-07-24T16:24:20.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.000+0000 7f1ec8d97640 1 -- 172.21.15.159:0/2684872361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ec415c810 con 0x7f1ec406d670 2024-07-24T16:24:20.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.001+0000 7f1eb2ffd640 1 -- 172.21.15.159:0/2684872361 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1eb40334d0 con 0x7f1ec406d670 2024-07-24T16:24:20.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.001+0000 7f1eb2ffd640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1ea4077010 0x7f1ea40794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:20.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.001+0000 7f1eb2ffd640 1 -- 172.21.15.159:0/2684872361 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1eb40b9f50 con 0x7f1ec406d670 2024-07-24T16:24:20.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.001+0000 7f1ec1d9b640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1ea4077010 0x7f1ea40794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:20.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.002+0000 7f1ec1d9b640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1ea4077010 0x7f1ea40794d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40aead0 tx=0x7f1eb800b390 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:20.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.005+0000 7f1eb2ffd640 1 -- 172.21.15.159:0/2684872361 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f1eb403f030 con 0x7f1ec406d670 2024-07-24T16:24:20.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.190+0000 7f1ec8d97640 1 -- 172.21.15.159:0/2684872361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ec406ccc0 con 0x7f1ec406d670 2024-07-24T16:24:20.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.191+0000 7f1eb2ffd640 1 -- 172.21.15.159:0/2684872361 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f1eb4082850 con 0x7f1ec406d670 2024-07-24T16:24:20.194 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:20.194 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:07.801757+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:00.757174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:01.708421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-24T16:24:05.423097+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:20.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.194+0000 7f1ec8d97640 1 -- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1ea4077010 msgr2=0x7f1ea40794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:20.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.194+0000 7f1ec8d97640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1ea4077010 0x7f1ea40794d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1ec40aead0 tx=0x7f1eb800b390 comp rx=0 tx=0).stop 2024-07-24T16:24:20.196 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.194+0000 7f1ec8d97640 1 -- 172.21.15.159:0/2684872361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec406d670 msgr2=0x7f1ec41f1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:20.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.194+0000 7f1ec8d97640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec406d670 0x7f1ec41f1510 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1eb4009b30 tx=0x7f1eb40039f0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.194+0000 7f1ec8d97640 1 -- 172.21.15.159:0/2684872361 shutdown_connections 2024-07-24T16:24:20.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.194+0000 7f1ec8d97640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1ea4077010 0x7f1ea40794d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.194+0000 7f1ec8d97640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1ec4158fe0 0x7f1ec40a99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.194+0000 7f1ec8d97640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1ec40cf860 0x7f1ec40a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.194+0000 7f1ec8d97640 1 --2- 172.21.15.159:0/2684872361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1ec406d670 0x7f1ec41f1510 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.194+0000 7f1ec8d97640 1 -- 172.21.15.159:0/2684872361 >> 172.21.15.159:0/2684872361 conn(0x7f1ec406c560 msgr2=0x7f1ec40cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:20.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.194+0000 7f1ec8d97640 1 -- 172.21.15.159:0/2684872361 shutdown_connections 2024-07-24T16:24:20.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.194+0000 7f1ec8d97640 1 -- 172.21.15.159:0/2684872361 wait complete. 2024-07-24T16:24:20.208 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:20.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.307+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3933675420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40d0fc0 msgr2=0x7f0fb4071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:20.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.307+0000 7f0fbae6b640 1 --2- 172.21.15.159:0/3933675420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40d0fc0 0x7f0fb4071ca0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0fb40751c0 tx=0x7f0fa402a8f0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.307+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3933675420 shutdown_connections 2024-07-24T16:24:20.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.307+0000 7f0fbae6b640 1 --2- 172.21.15.159:0/3933675420 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0fb40721e0 0x7f0fb4073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.307+0000 7f0fbae6b640 1 --2- 172.21.15.159:0/3933675420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40d0fc0 0x7f0fb4071ca0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.307+0000 7f0fbae6b640 1 --2- 172.21.15.159:0/3933675420 >> v2:172.21.15.193:3300/0 conn(0x7f0fb40b66e0 0x7f0fb415bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.307+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3933675420 >> 172.21.15.159:0/3933675420 conn(0x7f0fb40b33c0 msgr2=0x7f0fb40b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:20.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.307+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3933675420 shutdown_connections 2024-07-24T16:24:20.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.307+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3933675420 wait complete. 2024-07-24T16:24:20.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.308+0000 7f0fbae6b640 1 Processor -- start 2024-07-24T16:24:20.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.308+0000 7f0fbae6b640 1 -- start start 2024-07-24T16:24:20.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.309+0000 7f0fbae6b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fb40721e0 0x7f0fb41e3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:20.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.309+0000 7f0fbae6b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0fb40b66e0 0x7f0fb413c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:20.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.309+0000 7f0fbae6b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40d0fc0 0x7f0fb415a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:20.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.309+0000 7f0fbae6b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb4074260 con 0x7f0fb40d0fc0 2024-07-24T16:24:20.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.309+0000 7f0fbae6b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb40740e0 con 0x7f0fb40721e0 2024-07-24T16:24:20.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.309+0000 7f0fbae6b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb40743e0 con 0x7f0fb40b66e0 2024-07-24T16:24:20.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.309+0000 7f0fb9408640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40d0fc0 0x7f0fb415a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:20.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.309+0000 7f0fb9408640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40d0fc0 0x7f0fb415a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52328/0 (socket says 172.21.15.159:52328) 2024-07-24T16:24:20.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.309+0000 7f0fb9408640 1 -- 172.21.15.159:0/3401033056 learned_addr learned my addr 172.21.15.159:0/3401033056 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:20.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.309+0000 7f0fb8c07640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fb40721e0 0x7f0fb41e3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:20.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.309+0000 7f0fb3fff640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0fb40b66e0 0x7f0fb413c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:20.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.310+0000 7f0fb9408640 1 -- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0fb40b66e0 msgr2=0x7f0fb413c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:20.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.310+0000 7f0fb9408640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0fb40b66e0 0x7f0fb413c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.310+0000 7f0fb9408640 1 -- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fb40721e0 msgr2=0x7f0fb41e3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:20.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.310+0000 7f0fb9408640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fb40721e0 0x7f0fb41e3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.310+0000 7f0fb9408640 1 -- 172.21.15.159:0/3401033056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb413ceb0 con 0x7f0fb40d0fc0 2024-07-24T16:24:20.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.310+0000 7f0fb9408640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40d0fc0 0x7f0fb415a650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00d640 tx=0x7f0fac00db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:20.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.310+0000 7f0fb17fa640 1 -- 172.21.15.159:0/3401033056 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac017070 con 0x7f0fb40d0fc0 2024-07-24T16:24:20.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.310+0000 7f0fb17fa640 1 -- 172.21.15.159:0/3401033056 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fac004310 con 0x7f0fb40d0fc0 2024-07-24T16:24:20.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.310+0000 7f0fb17fa640 1 -- 172.21.15.159:0/3401033056 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac005280 con 0x7f0fb40d0fc0 2024-07-24T16:24:20.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.310+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3401033056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb4140140 con 0x7f0fb40d0fc0 2024-07-24T16:24:20.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.310+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3401033056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb4159230 con 0x7f0fb40d0fc0 2024-07-24T16:24:20.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.311+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3401033056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb415bae0 con 0x7f0fb40d0fc0 2024-07-24T16:24:20.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.312+0000 7f0fb17fa640 1 -- 172.21.15.159:0/3401033056 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0fac005420 con 0x7f0fb40d0fc0 2024-07-24T16:24:20.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.312+0000 7f0fb17fa640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0f94077010 0x7f0f940794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:20.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.312+0000 7f0fb17fa640 1 -- 172.21.15.159:0/3401033056 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0fac098df0 con 0x7f0fb40d0fc0 2024-07-24T16:24:20.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.312+0000 7f0fb8c07640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0f94077010 0x7f0f940794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:20.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.313+0000 7f0fb8c07640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0f94077010 0x7f0f940794d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00bbe0 tx=0x7f0f9c00b390 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:20.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.316+0000 7f0fb17fa640 1 -- 172.21.15.159:0/3401033056 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f0fac020020 con 0x7f0fb40d0fc0 2024-07-24T16:24:20.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.503+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3401033056 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0fb4071280 con 0x7f0fb40d0fc0 2024-07-24T16:24:20.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.504+0000 7f0fb17fa640 1 -- 172.21.15.159:0/3401033056 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f0fac061670 con 0x7f0fb40d0fc0 2024-07-24T16:24:20.507 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:20.507 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:07.801757+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:00.757174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:01.708421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-24T16:24:05.423097+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:20.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.506+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0f94077010 msgr2=0x7f0f940794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:20.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.506+0000 7f0fbae6b640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0f94077010 0x7f0f940794d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c00bbe0 tx=0x7f0f9c00b390 comp rx=0 tx=0).stop 2024-07-24T16:24:20.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.506+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3401033056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40d0fc0 msgr2=0x7f0fb415a650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:20.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.506+0000 7f0fbae6b640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40d0fc0 0x7f0fb415a650 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0fac00d640 tx=0x7f0fac00db00 comp rx=0 tx=0).stop 2024-07-24T16:24:20.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.506+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3401033056 shutdown_connections 2024-07-24T16:24:20.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.506+0000 7f0fbae6b640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0f94077010 0x7f0f940794d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.506+0000 7f0fbae6b640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0fb40d0fc0 0x7f0fb415a650 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.506+0000 7f0fbae6b640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0fb40b66e0 0x7f0fb413c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.506+0000 7f0fbae6b640 1 --2- 172.21.15.159:0/3401033056 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0fb40721e0 0x7f0fb41e3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.506+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3401033056 >> 172.21.15.159:0/3401033056 conn(0x7f0fb40b33c0 msgr2=0x7f0fb4159670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:20.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.506+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3401033056 shutdown_connections 2024-07-24T16:24:20.510 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.506+0000 7f0fbae6b640 1 -- 172.21.15.159:0/3401033056 wait complete. 2024-07-24T16:24:20.520 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-07-24T16:24:20.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.625+0000 7f168ecbe640 1 -- 172.21.15.159:0/3560749380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700051c0 msgr2=0x7f167000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:20.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.625+0000 7f168ecbe640 1 --2- 172.21.15.159:0/3560749380 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700051c0 0x7f167000b9c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f168000c640 tx=0x7f1670005830 comp rx=0 tx=0).stop 2024-07-24T16:24:20.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.625+0000 7f168d25b640 1 -- 172.21.15.159:0/3560749380 reap_dead start 2024-07-24T16:24:20.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.625+0000 7f168ecbe640 1 -- 172.21.15.159:0/3560749380 shutdown_connections 2024-07-24T16:24:20.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.625+0000 7f168ecbe640 1 -- 172.21.15.159:0/3560749380 >> 172.21.15.159:0/3560749380 conn(0x7f168809aa20 msgr2=0x7f16880d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:20.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.626+0000 7f168ecbe640 1 -- 172.21.15.159:0/3560749380 shutdown_connections 2024-07-24T16:24:20.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.626+0000 7f168ecbe640 1 -- 172.21.15.159:0/3560749380 wait complete. 2024-07-24T16:24:20.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.627+0000 7f168ecbe640 1 Processor -- start 2024-07-24T16:24:20.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.627+0000 7f168ecbe640 1 -- start start 2024-07-24T16:24:20.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ecbe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700051c0 0x7f16880cab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:20.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ecbe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16880cb060 0x7f16881f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:20.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ecbe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16881f2900 0x7f16881f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:20.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ecbe640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f16880cfce0 con 0x7f16700051c0 2024-07-24T16:24:20.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ecbe640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f16880cfb60 con 0x7f16880cb060 2024-07-24T16:24:20.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ecbe640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f16880cfe60 con 0x7f16881f2900 2024-07-24T16:24:20.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ca5a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700051c0 0x7f16880cab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:20.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ca5a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700051c0 0x7f16880cab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52332/0 (socket says 172.21.15.159:52332) 2024-07-24T16:24:20.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ca5a640 1 -- 172.21.15.159:0/2509603958 learned_addr learned my addr 172.21.15.159:0/2509603958 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:20.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168d25b640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16881f2900 0x7f16881f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:20.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f1687fff640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16880cb060 0x7f16881f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:20.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ca5a640 1 -- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16881f2900 msgr2=0x7f16881f56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:20.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ca5a640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16881f2900 0x7f16881f56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ca5a640 1 -- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16880cb060 msgr2=0x7f16881f23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:20.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ca5a640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16880cb060 0x7f16881f23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:20.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ca5a640 1 -- 172.21.15.159:0/2509603958 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16880b4b20 con 0x7f16700051c0 2024-07-24T16:24:20.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ca5a640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700051c0 0x7f16880cab20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1678011ab0 tx=0x7f1678011eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:20.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f16857fa640 1 -- 172.21.15.159:0/2509603958 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167801e070 con 0x7f16700051c0 2024-07-24T16:24:20.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f16857fa640 1 -- 172.21.15.159:0/2509603958 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f167800fbb0 con 0x7f16700051c0 2024-07-24T16:24:20.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ecbe640 1 -- 172.21.15.159:0/2509603958 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16880b4e00 con 0x7f16700051c0 2024-07-24T16:24:20.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f16857fa640 1 -- 172.21.15.159:0/2509603958 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1678019410 con 0x7f16700051c0 2024-07-24T16:24:20.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.628+0000 7f168ecbe640 1 -- 172.21.15.159:0/2509603958 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16880b53c0 con 0x7f16700051c0 2024-07-24T16:24:20.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.629+0000 7f168ecbe640 1 -- 172.21.15.159:0/2509603958 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1688070750 con 0x7f16700051c0 2024-07-24T16:24:20.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.630+0000 7f16857fa640 1 -- 172.21.15.159:0/2509603958 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1678021070 con 0x7f16700051c0 2024-07-24T16:24:20.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.630+0000 7f16857fa640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1674077010 0x7f16740794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:20.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.631+0000 7f16857fa640 1 -- 172.21.15.159:0/2509603958 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1678099310 con 0x7f16700051c0 2024-07-24T16:24:20.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.631+0000 7f1687fff640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1674077010 0x7f16740794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:20.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.631+0000 7f1687fff640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1674077010 0x7f16740794d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f16880b6070 tx=0x7f167c005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:20.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.634+0000 7f16857fa640 1 -- 172.21.15.159:0/2509603958 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f1678061c20 con 0x7f16700051c0 2024-07-24T16:24:20.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:20.856+0000 7f168ecbe640 1 -- 172.21.15.159:0/2509603958 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f16880cb440 con 0x7f16700051c0 2024-07-24T16:24:21.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.477+0000 7f16857fa640 1 -- 172.21.15.159:0/2509603958 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7f1678066170 con 0x7f16700051c0 2024-07-24T16:24:21.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.480+0000 7f168ecbe640 1 -- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1674077010 msgr2=0x7f16740794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:21.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.480+0000 7f168ecbe640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1674077010 0x7f16740794d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f16880b6070 tx=0x7f167c005f90 comp rx=0 tx=0).stop 2024-07-24T16:24:21.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.480+0000 7f168ecbe640 1 -- 172.21.15.159:0/2509603958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700051c0 msgr2=0x7f16880cab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:21.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.480+0000 7f168ecbe640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700051c0 0x7f16880cab20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1678011ab0 tx=0x7f1678011eb0 comp rx=0 tx=0).stop 2024-07-24T16:24:21.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.480+0000 7f168ecbe640 1 -- 172.21.15.159:0/2509603958 shutdown_connections 2024-07-24T16:24:21.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.480+0000 7f168ecbe640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1674077010 0x7f16740794d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:21.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.481+0000 7f168ecbe640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f16881f2900 0x7f16881f56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:21.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.481+0000 7f168ecbe640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f16880cb060 0x7f16881f23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:21.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.481+0000 7f168ecbe640 1 --2- 172.21.15.159:0/2509603958 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f16700051c0 0x7f16880cab20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:21.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.481+0000 7f168ecbe640 1 -- 172.21.15.159:0/2509603958 >> 172.21.15.159:0/2509603958 conn(0x7f168809aa20 msgr2=0x7f1688159e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:21.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.481+0000 7f168ecbe640 1 -- 172.21.15.159:0/2509603958 shutdown_connections 2024-07-24T16:24:21.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.481+0000 7f168ecbe640 1 -- 172.21.15.159:0/2509603958 wait complete. 2024-07-24T16:24:21.497 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-07-24T16:24:21.497 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-07-24T16:24:21.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.606+0000 7fee55759640 1 -- 172.21.15.159:0/1564941708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee500cfa30 msgr2=0x7fee5015bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:21.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.607+0000 7fee55759640 1 --2- 172.21.15.159:0/1564941708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee500cfa30 0x7fee5015bf90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fee500b4850 tx=0x7fee4802a820 comp rx=0 tx=0).stop 2024-07-24T16:24:21.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.607+0000 7fee55759640 1 -- 172.21.15.159:0/1564941708 shutdown_connections 2024-07-24T16:24:21.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.607+0000 7fee55759640 1 --2- 172.21.15.159:0/1564941708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee500cfa30 0x7fee5015bf90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:21.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.607+0000 7fee55759640 1 --2- 172.21.15.159:0/1564941708 >> v2:172.21.15.193:3300/0 conn(0x7fee50158fe0 0x7fee5006f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:21.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.607+0000 7fee55759640 1 -- 172.21.15.159:0/1564941708 >> 172.21.15.159:0/1564941708 conn(0x7fee5006c560 msgr2=0x7fee5006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:21.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.607+0000 7fee55759640 1 -- 172.21.15.159:0/1564941708 shutdown_connections 2024-07-24T16:24:21.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.607+0000 7fee55759640 1 -- 172.21.15.159:0/1564941708 wait complete. 2024-07-24T16:24:21.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.608+0000 7fee55759640 1 Processor -- start 2024-07-24T16:24:21.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.608+0000 7fee55759640 1 -- start start 2024-07-24T16:24:21.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee55759640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee5006d670 0x7fee50153b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:21.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee55759640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee500cfa30 0x7fee50150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:21.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee55759640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee50158fe0 0x7fee500adf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:21.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee55759640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fee50159540 con 0x7fee50158fe0 2024-07-24T16:24:21.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee55759640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fee501593c0 con 0x7fee500cfa30 2024-07-24T16:24:21.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee55759640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fee5015c4d0 con 0x7fee5006d670 2024-07-24T16:24:21.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee4f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee50158fe0 0x7fee500adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:21.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee4f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee50158fe0 0x7fee500adf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59608/0 (socket says 172.21.15.159:59608) 2024-07-24T16:24:21.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee4f7fe640 1 -- 172.21.15.159:0/1432192119 learned_addr learned my addr 172.21.15.159:0/1432192119 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:21.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee47fff640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee500cfa30 0x7fee50150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:21.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee4effd640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee5006d670 0x7fee50153b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:21.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee4f7fe640 1 -- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee5006d670 msgr2=0x7fee50153b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:21.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee4f7fe640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee5006d670 0x7fee50153b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:21.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee4f7fe640 1 -- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee500cfa30 msgr2=0x7fee50150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:21.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee4f7fe640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee500cfa30 0x7fee50150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:21.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee4f7fe640 1 -- 172.21.15.159:0/1432192119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee50152d90 con 0x7fee50158fe0 2024-07-24T16:24:21.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee47fff640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee500cfa30 0x7fee50150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:21.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee4f7fe640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee50158fe0 0x7fee500adf00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee48009b30 tx=0x7fee48032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:21.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee477fe640 1 -- 172.21.15.159:0/1432192119 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48037040 con 0x7fee50158fe0 2024-07-24T16:24:21.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee477fe640 1 -- 172.21.15.159:0/1432192119 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee48042070 con 0x7fee50158fe0 2024-07-24T16:24:21.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee55759640 1 -- 172.21.15.159:0/1432192119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee50153070 con 0x7fee50158fe0 2024-07-24T16:24:21.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee477fe640 1 -- 172.21.15.159:0/1432192119 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee48004280 con 0x7fee50158fe0 2024-07-24T16:24:21.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.609+0000 7fee55759640 1 -- 172.21.15.159:0/1432192119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee50153630 con 0x7fee50158fe0 2024-07-24T16:24:21.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.610+0000 7fee55759640 1 -- 172.21.15.159:0/1432192119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee5015db30 con 0x7fee50158fe0 2024-07-24T16:24:21.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.611+0000 7fee477fe640 1 -- 172.21.15.159:0/1432192119 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fee48004420 con 0x7fee50158fe0 2024-07-24T16:24:21.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.611+0000 7fee477fe640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fee30077010 0x7fee300794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:21.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.611+0000 7fee477fe640 1 -- 172.21.15.159:0/1432192119 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fee480b9990 con 0x7fee50158fe0 2024-07-24T16:24:21.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.612+0000 7fee4effd640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fee30077010 0x7fee300794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:21.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.612+0000 7fee4effd640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fee30077010 0x7fee300794d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee40005fd0 tx=0x7fee40005bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:21.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.616+0000 7fee477fe640 1 -- 172.21.15.159:0/1432192119 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fee480828e0 con 0x7fee50158fe0 2024-07-24T16:24:21.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:21.841+0000 7fee55759640 1 -- 172.21.15.159:0/1432192119 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fee5006dee0 con 0x7fee50158fe0 2024-07-24T16:24:22.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.485+0000 7fee477fe640 1 -- 172.21.15.159:0/1432192119 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) ==== 122+0+0 (secure 0 0 0) 0x7fee480821e0 con 0x7fee50158fe0 2024-07-24T16:24:22.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.488+0000 7fee55759640 1 -- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fee30077010 msgr2=0x7fee300794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:22.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.488+0000 7fee55759640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fee30077010 0x7fee300794d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fee40005fd0 tx=0x7fee40005bc0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.488+0000 7fee55759640 1 -- 172.21.15.159:0/1432192119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee50158fe0 msgr2=0x7fee500adf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:22.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.488+0000 7fee55759640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee50158fe0 0x7fee500adf00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fee48009b30 tx=0x7fee48032c90 comp rx=0 tx=0).stop 2024-07-24T16:24:22.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.488+0000 7fee55759640 1 -- 172.21.15.159:0/1432192119 shutdown_connections 2024-07-24T16:24:22.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.488+0000 7fee55759640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fee30077010 0x7fee300794d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.488+0000 7fee55759640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee50158fe0 0x7fee500adf00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.488+0000 7fee55759640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee500cfa30 0x7fee50150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.488+0000 7fee55759640 1 --2- 172.21.15.159:0/1432192119 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee5006d670 0x7fee50153b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.488+0000 7fee55759640 1 -- 172.21.15.159:0/1432192119 >> 172.21.15.159:0/1432192119 conn(0x7fee5006c560 msgr2=0x7fee500ceed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:22.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.488+0000 7fee55759640 1 -- 172.21.15.159:0/1432192119 shutdown_connections 2024-07-24T16:24:22.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.488+0000 7fee55759640 1 -- 172.21.15.159:0/1432192119 wait complete. 2024-07-24T16:24:22.504 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-07-24T16:24:22.505 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:24:22.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.612+0000 7f95efb97640 1 -- 172.21.15.159:0/1218023979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95d0003a00 msgr2=0x7f95d0003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:22.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.612+0000 7f95efb97640 1 --2- 172.21.15.159:0/1218023979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95d0003a00 0x7f95d0003de0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009ed0 tx=0x7f95d0005830 comp rx=0 tx=0).stop 2024-07-24T16:24:22.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.612+0000 7f95efb97640 1 -- 172.21.15.159:0/1218023979 shutdown_connections 2024-07-24T16:24:22.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.612+0000 7f95efb97640 1 --2- 172.21.15.159:0/1218023979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95d0003a00 0x7f95d0003de0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.612+0000 7f95efb97640 1 -- 172.21.15.159:0/1218023979 >> 172.21.15.159:0/1218023979 conn(0x7f95e80d3810 msgr2=0x7f95e80d3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:22.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.612+0000 7f95efb97640 1 -- 172.21.15.159:0/1218023979 shutdown_connections 2024-07-24T16:24:22.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.612+0000 7f95efb97640 1 -- 172.21.15.159:0/1218023979 wait complete. 2024-07-24T16:24:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.613+0000 7f95efb97640 1 Processor -- start 2024-07-24T16:24:22.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.613+0000 7f95efb97640 1 -- start start 2024-07-24T16:24:22.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95efb97640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95d0003a00 0x7f95e814fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:22.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95efb97640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95e81f43a0 0x7f95e8156d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:22.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95efb97640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95e81572a0 0x7f95e8157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:22.618 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95efb97640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f95e80d14d0 con 0x7f95d0003a00 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95efb97640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f95e80d1350 con 0x7f95e81572a0 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95efb97640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f95e80d1650 con 0x7f95e81f43a0 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95ed933640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95d0003a00 0x7f95e814fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95ed933640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95d0003a00 0x7f95e814fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59634/0 (socket says 172.21.15.159:59634) 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95ed933640 1 -- 172.21.15.159:0/677627250 learned_addr learned my addr 172.21.15.159:0/677627250 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95ee134640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95e81572a0 0x7f95e8157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95ed132640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95e81f43a0 0x7f95e8156d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95ed933640 1 -- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95e81f43a0 msgr2=0x7f95e8156d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95ed933640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95e81f43a0 0x7f95e8156d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95ed933640 1 -- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95e81572a0 msgr2=0x7f95e8157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95ed933640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95e81572a0 0x7f95e8157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95ed933640 1 -- 172.21.15.159:0/677627250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e81f4900 con 0x7f95d0003a00 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.614+0000 7f95ed132640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95e81f43a0 0x7f95e8156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:22.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.615+0000 7f95ed933640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95d0003a00 0x7f95e814fab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f95d802aec0 tx=0x7f95d8033cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:22.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.615+0000 7f95e67fc640 1 -- 172.21.15.159:0/677627250 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d8038040 con 0x7f95d0003a00 2024-07-24T16:24:22.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.615+0000 7f95e67fc640 1 -- 172.21.15.159:0/677627250 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95d8041070 con 0x7f95d0003a00 2024-07-24T16:24:22.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.615+0000 7f95efb97640 1 -- 172.21.15.159:0/677627250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e81f4be0 con 0x7f95d0003a00 2024-07-24T16:24:22.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.615+0000 7f95e67fc640 1 -- 172.21.15.159:0/677627250 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d803c690 con 0x7f95d0003a00 2024-07-24T16:24:22.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.615+0000 7f95efb97640 1 -- 172.21.15.159:0/677627250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e81f51a0 con 0x7f95d0003a00 2024-07-24T16:24:22.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.616+0000 7f95efb97640 1 -- 172.21.15.159:0/677627250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95e80b58f0 con 0x7f95d0003a00 2024-07-24T16:24:22.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.616+0000 7f95e67fc640 1 -- 172.21.15.159:0/677627250 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f95d803c830 con 0x7f95d0003a00 2024-07-24T16:24:22.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.617+0000 7f95e67fc640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f95d4077040 0x7f95d4079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:22.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.617+0000 7f95e67fc640 1 -- 172.21.15.159:0/677627250 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f95d80b97a0 con 0x7f95d0003a00 2024-07-24T16:24:22.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.617+0000 7f95ed132640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f95d4077040 0x7f95d4079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:22.621 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.617+0000 7f95ed132640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f95d4077040 0x7f95d4079500 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f95dc001b40 tx=0x7f95dc001ad0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:22.623 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.621+0000 7f95e67fc640 1 -- 172.21.15.159:0/677627250 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f95d80820a0 con 0x7f95d0003a00 2024-07-24T16:24:22.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.841+0000 7f95efb97640 1 -- 172.21.15.159:0/677627250 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f95e80b9710 con 0x7f95d0003a00 2024-07-24T16:24:22.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.841+0000 7f95e67fc640 1 -- 172.21.15.159:0/677627250 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f95d80865f0 con 0x7f95d0003a00 2024-07-24T16:24:22.844 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:22.844 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":9,"btime":"2024-07-24T16:24:22:479106+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1307622320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1307622320},{"type":"v1","addr":"172.21.15.193:6837","nonce":1307622320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3191234203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3191234203},{"type":"v1","addr":"172.21.15.159:6833","nonce":3191234203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4336,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4102467909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":4102467909},{"type":"v1","addr":"172.21.15.159:6835","nonce":4102467909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:02.762268+0000","modified":"2024-07-24T16:24:21.842971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4348":{"gid":4348,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1274628948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1274628948},{"type":"v1","addr":"172.21.15.193:6836","nonce":1274628948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4348,"qdb_cluster":[4348]},"id":1}]} 2024-07-24T16:24:22.844 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 9 2024-07-24T16:24:22.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.843+0000 7f95efb97640 1 -- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f95d4077040 msgr2=0x7f95d4079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:22.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.843+0000 7f95efb97640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f95d4077040 0x7f95d4079500 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f95dc001b40 tx=0x7f95dc001ad0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.843+0000 7f95efb97640 1 -- 172.21.15.159:0/677627250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95d0003a00 msgr2=0x7f95e814fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:22.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.843+0000 7f95efb97640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95d0003a00 0x7f95e814fab0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f95d802aec0 tx=0x7f95d8033cb0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.843+0000 7f95efb97640 1 -- 172.21.15.159:0/677627250 shutdown_connections 2024-07-24T16:24:22.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.843+0000 7f95efb97640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f95d4077040 0x7f95d4079500 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.843+0000 7f95efb97640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95e81572a0 0x7f95e8157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.843+0000 7f95efb97640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95e81f43a0 0x7f95e8156d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.843+0000 7f95efb97640 1 --2- 172.21.15.159:0/677627250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95d0003a00 0x7f95e814fab0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.843+0000 7f95efb97640 1 -- 172.21.15.159:0/677627250 >> 172.21.15.159:0/677627250 conn(0x7f95e80d3810 msgr2=0x7f95e80cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:22.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.843+0000 7f95efb97640 1 -- 172.21.15.159:0/677627250 shutdown_connections 2024-07-24T16:24:22.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.843+0000 7f95efb97640 1 -- 172.21.15.159:0/677627250 wait complete. 2024-07-24T16:24:22.857 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:22.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.958+0000 7faaecbe8640 1 -- 172.21.15.159:0/3468521394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faad4005210 msgr2=0x7faad400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:22.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.958+0000 7faaecbe8640 1 --2- 172.21.15.159:0/3468521394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faad4005210 0x7faad400b9c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faae000c590 tx=0x7faad4005830 comp rx=0 tx=0).stop 2024-07-24T16:24:22.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.958+0000 7faaecbe8640 1 -- 172.21.15.159:0/3468521394 shutdown_connections 2024-07-24T16:24:22.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.958+0000 7faaecbe8640 1 --2- 172.21.15.159:0/3468521394 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faad4005210 0x7faad400b9c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.958+0000 7faaecbe8640 1 -- 172.21.15.159:0/3468521394 >> 172.21.15.159:0/3468521394 conn(0x7faae808cdf0 msgr2=0x7faae80d3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:22.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.958+0000 7faaecbe8640 1 -- 172.21.15.159:0/3468521394 shutdown_connections 2024-07-24T16:24:22.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.958+0000 7faaecbe8640 1 -- 172.21.15.159:0/3468521394 wait complete. 2024-07-24T16:24:22.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.959+0000 7faaecbe8640 1 Processor -- start 2024-07-24T16:24:22.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.960+0000 7faaecbe8640 1 -- start start 2024-07-24T16:24:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.960+0000 7faaecbe8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faad4005210 0x7faae81f42b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.960+0000 7faaecbe8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faae80cce60 0x7faae815dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.960+0000 7faaecbe8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faae8159540 0x7faae81599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.960+0000 7faaecbe8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7faae80b6c50 con 0x7faae8159540 2024-07-24T16:24:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.960+0000 7faaecbe8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faae80b6ad0 con 0x7faae80cce60 2024-07-24T16:24:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.960+0000 7faaecbe8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7faae80b6dd0 con 0x7faad4005210 2024-07-24T16:24:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.960+0000 7faae6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faae8159540 0x7faae81599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:22.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.960+0000 7faae6d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faae8159540 0x7faae81599d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59646/0 (socket says 172.21.15.159:59646) 2024-07-24T16:24:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.960+0000 7faae6d9d640 1 -- 172.21.15.159:0/1037561254 learned_addr learned my addr 172.21.15.159:0/1037561254 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.960+0000 7faaddd9b640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faae80cce60 0x7faae815dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.960+0000 7faae659c640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faad4005210 0x7faae81f42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.961+0000 7faae6d9d640 1 -- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faad4005210 msgr2=0x7faae81f42b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.961+0000 7faae6d9d640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faad4005210 0x7faae81f42b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.961+0000 7faae6d9d640 1 -- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faae80cce60 msgr2=0x7faae815dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:22.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.961+0000 7faae6d9d640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faae80cce60 0x7faae815dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:22.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.961+0000 7faae6d9d640 1 -- 172.21.15.159:0/1037561254 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae8157e70 con 0x7faae8159540 2024-07-24T16:24:22.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.961+0000 7faae659c640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faad4005210 0x7faae81f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:22.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.961+0000 7faae6d9d640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faae8159540 0x7faae81599d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faae0000f80 tx=0x7faae0004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:22.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.961+0000 7faadf7fe640 1 -- 172.21.15.159:0/1037561254 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae002b960 con 0x7faae8159540 2024-07-24T16:24:22.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.961+0000 7faadf7fe640 1 -- 172.21.15.159:0/1037561254 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faae002bc10 con 0x7faae8159540 2024-07-24T16:24:22.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.961+0000 7faaecbe8640 1 -- 172.21.15.159:0/1037561254 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faae8158150 con 0x7faae8159540 2024-07-24T16:24:22.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.961+0000 7faadf7fe640 1 -- 172.21.15.159:0/1037561254 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae00060a0 con 0x7faae8159540 2024-07-24T16:24:22.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.961+0000 7faaecbe8640 1 -- 172.21.15.159:0/1037561254 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faae8158710 con 0x7faae8159540 2024-07-24T16:24:22.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.962+0000 7faaecbe8640 1 -- 172.21.15.159:0/1037561254 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faae80cf4a0 con 0x7faae8159540 2024-07-24T16:24:22.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.963+0000 7faadf7fe640 1 -- 172.21.15.159:0/1037561254 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7faae0006240 con 0x7faae8159540 2024-07-24T16:24:22.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.963+0000 7faadf7fe640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7faac8077010 0x7faac80794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:22.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.963+0000 7faadf7fe640 1 -- 172.21.15.159:0/1037561254 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7faae00b8e40 con 0x7faae8159540 2024-07-24T16:24:22.969 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.963+0000 7faae659c640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7faac8077010 0x7faac80794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:22.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.964+0000 7faae659c640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7faac8077010 0x7faac80794d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faae80ccdf0 tx=0x7faad80060d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:22.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:22.967+0000 7faadf7fe640 1 -- 172.21.15.159:0/1037561254 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7faae00817d0 con 0x7faae8159540 2024-07-24T16:24:23.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.151+0000 7faaecbe8640 1 -- 172.21.15.159:0/1037561254 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faae808d300 con 0x7faae8159540 2024-07-24T16:24:23.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.152+0000 7faadf7fe640 1 -- 172.21.15.159:0/1037561254 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7faae008a060 con 0x7faae8159540 2024-07-24T16:24:23.155 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:23.155 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:07.801757+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:00.757174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:01.708421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-24T16:24:05.423097+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:23.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.154+0000 7faaecbe8640 1 -- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7faac8077010 msgr2=0x7faac80794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.154+0000 7faaecbe8640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7faac8077010 0x7faac80794d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faae80ccdf0 tx=0x7faad80060d0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.154+0000 7faaecbe8640 1 -- 172.21.15.159:0/1037561254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faae8159540 msgr2=0x7faae81599d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.154+0000 7faaecbe8640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faae8159540 0x7faae81599d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7faae0000f80 tx=0x7faae0004bb0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.154+0000 7faaecbe8640 1 -- 172.21.15.159:0/1037561254 shutdown_connections 2024-07-24T16:24:23.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.154+0000 7faaecbe8640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7faac8077010 0x7faac80794d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.154+0000 7faaecbe8640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faae8159540 0x7faae81599d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.154+0000 7faaecbe8640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faae80cce60 0x7faae815dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.154+0000 7faaecbe8640 1 --2- 172.21.15.159:0/1037561254 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faad4005210 0x7faae81f42b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.154+0000 7faaecbe8640 1 -- 172.21.15.159:0/1037561254 >> 172.21.15.159:0/1037561254 conn(0x7faae808cdf0 msgr2=0x7faae80b4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:23.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.154+0000 7faaecbe8640 1 -- 172.21.15.159:0/1037561254 shutdown_connections 2024-07-24T16:24:23.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.154+0000 7faaecbe8640 1 -- 172.21.15.159:0/1037561254 wait complete. 2024-07-24T16:24:23.168 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-07-24T16:24:23.168 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:24:23.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.268+0000 7f064bf60640 1 -- 172.21.15.159:0/3592348860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06440b45e0 msgr2=0x7f064406f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.268+0000 7f064bf60640 1 --2- 172.21.15.159:0/3592348860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06440b45e0 0x7f064406f330 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0634009830 tx=0x7f063402a510 comp rx=0 tx=0).stop 2024-07-24T16:24:23.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.268+0000 7f064bf60640 1 -- 172.21.15.159:0/3592348860 shutdown_connections 2024-07-24T16:24:23.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.268+0000 7f064bf60640 1 --2- 172.21.15.159:0/3592348860 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06440af380 0x7f064406f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.268+0000 7f064bf60640 1 --2- 172.21.15.159:0/3592348860 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06440b45e0 0x7f064406f330 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.268+0000 7f064bf60640 1 -- 172.21.15.159:0/3592348860 >> 172.21.15.159:0/3592348860 conn(0x7f064406d450 msgr2=0x7f064406d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:23.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.268+0000 7f064bf60640 1 -- 172.21.15.159:0/3592348860 shutdown_connections 2024-07-24T16:24:23.271 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.268+0000 7f064bf60640 1 -- 172.21.15.159:0/3592348860 wait complete. 2024-07-24T16:24:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.269+0000 7f064bf60640 1 Processor -- start 2024-07-24T16:24:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.269+0000 7f064bf60640 1 -- start start 2024-07-24T16:24:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064bf60640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06440af380 0x7f06441f4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064bf60640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06440b45e0 0x7f06440ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064bf60640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f064415d680 0x7f0644144350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064bf60640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f064406fdb0 con 0x7f064415d680 2024-07-24T16:24:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064bf60640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f06440b4d70 con 0x7f06440b45e0 2024-07-24T16:24:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064bf60640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f064406ff30 con 0x7f06440af380 2024-07-24T16:24:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064a4fd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f064415d680 0x7f0644144350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064a4fd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f064415d680 0x7f0644144350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59668/0 (socket says 172.21.15.159:59668) 2024-07-24T16:24:23.274 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064a4fd640 1 -- 172.21.15.159:0/2665471939 learned_addr learned my addr 172.21.15.159:0/2665471939 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f06494fb640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06440b45e0 0x7f06440ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f0649cfc640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06440af380 0x7f06441f4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064a4fd640 1 -- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06440af380 msgr2=0x7f06441f4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064a4fd640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06440af380 0x7f06441f4b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064a4fd640 1 -- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06440b45e0 msgr2=0x7f06440ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064a4fd640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06440b45e0 0x7f06440ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064a4fd640 1 -- 172.21.15.159:0/2665471939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06441f50b0 con 0x7f064415d680 2024-07-24T16:24:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064a4fd640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f064415d680 0x7f0644144350 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f063c00b970 tx=0x7f063c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f063a7fc640 1 -- 172.21.15.159:0/2665471939 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c019070 con 0x7f064415d680 2024-07-24T16:24:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f063a7fc640 1 -- 172.21.15.159:0/2665471939 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f063c00cc50 con 0x7f064415d680 2024-07-24T16:24:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f064bf60640 1 -- 172.21.15.159:0/2665471939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0644156420 con 0x7f064415d680 2024-07-24T16:24:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.270+0000 7f063a7fc640 1 -- 172.21.15.159:0/2665471939 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063c0146a0 con 0x7f064415d680 2024-07-24T16:24:23.275 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.271+0000 7f064bf60640 1 -- 172.21.15.159:0/2665471939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06441569e0 con 0x7f064415d680 2024-07-24T16:24:23.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.271+0000 7f064bf60640 1 -- 172.21.15.159:0/2665471939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0644070460 con 0x7f064415d680 2024-07-24T16:24:23.276 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.272+0000 7f063a7fc640 1 -- 172.21.15.159:0/2665471939 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f063c01c070 con 0x7f064415d680 2024-07-24T16:24:23.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.273+0000 7f063a7fc640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0628077010 0x7f06280794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:23.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.273+0000 7f063a7fc640 1 -- 172.21.15.159:0/2665471939 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f063c098960 con 0x7f064415d680 2024-07-24T16:24:23.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.273+0000 7f0649cfc640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0628077010 0x7f06280794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:23.277 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.273+0000 7f0649cfc640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0628077010 0x7f06280794d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0640000f60 tx=0x7f0640009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:23.279 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.277+0000 7f063a7fc640 1 -- 172.21.15.159:0/2665471939 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f063c061260 con 0x7f064415d680 2024-07-24T16:24:23.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.460+0000 7f064bf60640 1 -- 172.21.15.159:0/2665471939 --> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f06441583c0 con 0x7f0628077010 2024-07-24T16:24:23.468 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.466+0000 7f063a7fc640 1 -- 172.21.15.159:0/2665471939 <== mgr.4103 v2:172.21.15.193:6832/222319347 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332520 (secure 0 0 0) 0x7f06441583c0 con 0x7f0628077010 2024-07-24T16:24:23.472 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:23.473 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:24:23.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.469+0000 7f064bf60640 1 -- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0628077010 msgr2=0x7f06280794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.469+0000 7f064bf60640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0628077010 0x7f06280794d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0640000f60 tx=0x7f0640009040 comp rx=0 tx=0).stop 2024-07-24T16:24:23.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.469+0000 7f064bf60640 1 -- 172.21.15.159:0/2665471939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f064415d680 msgr2=0x7f0644144350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.469+0000 7f064bf60640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f064415d680 0x7f0644144350 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f063c00b970 tx=0x7f063c00be30 comp rx=0 tx=0).stop 2024-07-24T16:24:23.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.469+0000 7f064bf60640 1 -- 172.21.15.159:0/2665471939 shutdown_connections 2024-07-24T16:24:23.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.469+0000 7f064bf60640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0628077010 0x7f06280794d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.469+0000 7f064bf60640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f064415d680 0x7f0644144350 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.469+0000 7f064bf60640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06440b45e0 0x7f06440ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.469+0000 7f064bf60640 1 --2- 172.21.15.159:0/2665471939 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06440af380 0x7f06441f4b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.469+0000 7f064bf60640 1 -- 172.21.15.159:0/2665471939 >> 172.21.15.159:0/2665471939 conn(0x7f064406d450 msgr2=0x7f0644153060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:23.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.469+0000 7f064bf60640 1 -- 172.21.15.159:0/2665471939 shutdown_connections 2024-07-24T16:24:23.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.469+0000 7f064bf60640 1 -- 172.21.15.159:0/2665471939 wait complete. 2024-07-24T16:24:23.483 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-07-24T16:24:22.366093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1988976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003497"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441633+0000","last_change":"2024-07-24T16:24:02.424537+0000","last_active":"2024-07-24T16:24:08.441633+0000","last_peered":"2024-07-24T16:24:08.441633+0000","last_clean":"2024-07-24T16:24:08.441633+0000","last_became_active":"2024-07-24T16:24:02.424271+0000","last_became_peered":"2024-07-24T16:24:02.424271+0000","last_unstale":"2024-07-24T16:24:08.441633+0000","last_undegraded":"2024-07-24T16:24:08.441633+0000","last_fullsized":"2024-07-24T16:24:08.441633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:39:09.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663338+0000","last_change":"2024-07-24T16:24:03.415815+0000","last_active":"2024-07-24T16:24:08.663338+0000","last_peered":"2024-07-24T16:24:08.663338+0000","last_clean":"2024-07-24T16:24:08.663338+0000","last_became_active":"2024-07-24T16:24:03.415526+0000","last_became_peered":"2024-07-24T16:24:03.415526+0000","last_unstale":"2024-07-24T16:24:08.663338+0000","last_undegraded":"2024-07-24T16:24:08.663338+0000","last_fullsized":"2024-07-24T16:24:08.663338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662707+0000","last_change":"2024-07-24T16:24:07.690761+0000","last_active":"2024-07-24T16:24:08.662707+0000","last_peered":"2024-07-24T16:24:08.662707+0000","last_clean":"2024-07-24T16:24:08.662707+0000","last_became_active":"2024-07-24T16:24:07.690360+0000","last_became_peered":"2024-07-24T16:24:07.690360+0000","last_unstale":"2024-07-24T16:24:08.662707+0000","last_undegraded":"2024-07-24T16:24:08.662707+0000","last_fullsized":"2024-07-24T16:24:08.662707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:20:33.168439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663491+0000","last_change":"2024-07-24T16:24:02.417793+0000","last_active":"2024-07-24T16:24:08.663491+0000","last_peered":"2024-07-24T16:24:08.663491+0000","last_clean":"2024-07-24T16:24:08.663491+0000","last_became_active":"2024-07-24T16:24:02.417520+0000","last_became_peered":"2024-07-24T16:24:02.417520+0000","last_unstale":"2024-07-24T16:24:08.663491+0000","last_undegraded":"2024-07-24T16:24:08.663491+0000","last_fullsized":"2024-07-24T16:24:08.663491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:39:09.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441465+0000","last_change":"2024-07-24T16:24:03.431760+0000","last_active":"2024-07-24T16:24:08.441465+0000","last_peered":"2024-07-24T16:24:08.441465+0000","last_clean":"2024-07-24T16:24:08.441465+0000","last_became_active":"2024-07-24T16:24:03.431479+0000","last_became_peered":"2024-07-24T16:24:03.431479+0000","last_unstale":"2024-07-24T16:24:08.441465+0000","last_undegraded":"2024-07-24T16:24:08.441465+0000","last_fullsized":"2024-07-24T16:24:08.441465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:30:43.693386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759610+0000","last_change":"2024-07-24T16:24:07.447841+0000","last_active":"2024-07-24T16:24:08.759610+0000","last_peered":"2024-07-24T16:24:08.759610+0000","last_clean":"2024-07-24T16:24:08.759610+0000","last_became_active":"2024-07-24T16:24:07.446215+0000","last_became_peered":"2024-07-24T16:24:07.446215+0000","last_unstale":"2024-07-24T16:24:08.759610+0000","last_undegraded":"2024-07-24T16:24:08.759610+0000","last_fullsized":"2024-07-24T16:24:08.759610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:09.837609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932112+0000","last_change":"2024-07-24T16:24:02.427356+0000","last_active":"2024-07-24T16:24:08.932112+0000","last_peered":"2024-07-24T16:24:08.932112+0000","last_clean":"2024-07-24T16:24:08.932112+0000","last_became_active":"2024-07-24T16:24:02.426961+0000","last_became_peered":"2024-07-24T16:24:02.426961+0000","last_unstale":"2024-07-24T16:24:08.932112+0000","last_undegraded":"2024-07-24T16:24:08.932112+0000","last_fullsized":"2024-07-24T16:24:08.932112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:45:48.251916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441858+0000","last_change":"2024-07-24T16:24:03.410957+0000","last_active":"2024-07-24T16:24:08.441858+0000","last_peered":"2024-07-24T16:24:08.441858+0000","last_clean":"2024-07-24T16:24:08.441858+0000","last_became_active":"2024-07-24T16:24:03.410678+0000","last_became_peered":"2024-07-24T16:24:03.410678+0000","last_unstale":"2024-07-24T16:24:08.441858+0000","last_undegraded":"2024-07-24T16:24:08.441858+0000","last_fullsized":"2024-07-24T16:24:08.441858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:32:56.003382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759927+0000","last_change":"2024-07-24T16:24:07.447764+0000","last_active":"2024-07-24T16:24:08.759927+0000","last_peered":"2024-07-24T16:24:08.759927+0000","last_clean":"2024-07-24T16:24:08.759927+0000","last_became_active":"2024-07-24T16:24:07.446150+0000","last_became_peered":"2024-07-24T16:24:07.446150+0000","last_unstale":"2024-07-24T16:24:08.759927+0000","last_undegraded":"2024-07-24T16:24:08.759927+0000","last_fullsized":"2024-07-24T16:24:08.759927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:29.138058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931831+0000","last_change":"2024-07-24T16:24:02.427694+0000","last_active":"2024-07-24T16:24:08.931831+0000","last_peered":"2024-07-24T16:24:08.931831+0000","last_clean":"2024-07-24T16:24:08.931831+0000","last_became_active":"2024-07-24T16:24:02.427418+0000","last_became_peered":"2024-07-24T16:24:02.427418+0000","last_unstale":"2024-07-24T16:24:08.931831+0000","last_undegraded":"2024-07-24T16:24:08.931831+0000","last_fullsized":"2024-07-24T16:24:08.931831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:35:30.416854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442157+0000","last_change":"2024-07-24T16:24:03.411299+0000","last_active":"2024-07-24T16:24:08.442157+0000","last_peered":"2024-07-24T16:24:08.442157+0000","last_clean":"2024-07-24T16:24:08.442157+0000","last_became_active":"2024-07-24T16:24:03.410332+0000","last_became_peered":"2024-07-24T16:24:03.410332+0000","last_unstale":"2024-07-24T16:24:08.442157+0000","last_undegraded":"2024-07-24T16:24:08.442157+0000","last_fullsized":"2024-07-24T16:24:08.442157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:05.808945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759607+0000","last_change":"2024-07-24T16:24:07.449263+0000","last_active":"2024-07-24T16:24:08.759607+0000","last_peered":"2024-07-24T16:24:08.759607+0000","last_clean":"2024-07-24T16:24:08.759607+0000","last_became_active":"2024-07-24T16:24:07.448686+0000","last_became_peered":"2024-07-24T16:24:07.448686+0000","last_unstale":"2024-07-24T16:24:08.759607+0000","last_undegraded":"2024-07-24T16:24:08.759607+0000","last_fullsized":"2024-07-24T16:24:08.759607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:05.528295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931074+0000","last_change":"2024-07-24T16:24:03.420544+0000","last_active":"2024-07-24T16:24:08.931074+0000","last_peered":"2024-07-24T16:24:08.931074+0000","last_clean":"2024-07-24T16:24:08.931074+0000","last_became_active":"2024-07-24T16:24:03.419248+0000","last_became_peered":"2024-07-24T16:24:03.419248+0000","last_unstale":"2024-07-24T16:24:08.931074+0000","last_undegraded":"2024-07-24T16:24:08.931074+0000","last_fullsized":"2024-07-24T16:24:08.931074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931758+0000","last_change":"2024-07-24T16:24:02.427241+0000","last_active":"2024-07-24T16:24:08.931758+0000","last_peered":"2024-07-24T16:24:08.931758+0000","last_clean":"2024-07-24T16:24:08.931758+0000","last_became_active":"2024-07-24T16:24:02.426981+0000","last_became_peered":"2024-07-24T16:24:02.426981+0000","last_unstale":"2024-07-24T16:24:08.931758+0000","last_undegraded":"2024-07-24T16:24:08.931758+0000","last_fullsized":"2024-07-24T16:24:08.931758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760170+0000","last_change":"2024-07-24T16:24:07.453666+0000","last_active":"2024-07-24T16:24:08.760170+0000","last_peered":"2024-07-24T16:24:08.760170+0000","last_clean":"2024-07-24T16:24:08.760170+0000","last_became_active":"2024-07-24T16:24:07.453136+0000","last_became_peered":"2024-07-24T16:24:07.453136+0000","last_unstale":"2024-07-24T16:24:08.760170+0000","last_undegraded":"2024-07-24T16:24:08.760170+0000","last_fullsized":"2024-07-24T16:24:08.760170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:25.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663125+0000","last_change":"2024-07-24T16:24:03.419598+0000","last_active":"2024-07-24T16:24:08.663125+0000","last_peered":"2024-07-24T16:24:08.663125+0000","last_clean":"2024-07-24T16:24:08.663125+0000","last_became_active":"2024-07-24T16:24:03.419148+0000","last_became_peered":"2024-07-24T16:24:03.419148+0000","last_unstale":"2024-07-24T16:24:08.663125+0000","last_undegraded":"2024-07-24T16:24:08.663125+0000","last_fullsized":"2024-07-24T16:24:08.663125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:33:56.923986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930432+0000","last_change":"2024-07-24T16:24:02.412753+0000","last_active":"2024-07-24T16:24:08.930432+0000","last_peered":"2024-07-24T16:24:08.930432+0000","last_clean":"2024-07-24T16:24:08.930432+0000","last_became_active":"2024-07-24T16:24:02.412500+0000","last_became_peered":"2024-07-24T16:24:02.412500+0000","last_unstale":"2024-07-24T16:24:08.930432+0000","last_undegraded":"2024-07-24T16:24:08.930432+0000","last_fullsized":"2024-07-24T16:24:08.930432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759990+0000","last_change":"2024-07-24T16:24:07.447575+0000","last_active":"2024-07-24T16:24:08.759990+0000","last_peered":"2024-07-24T16:24:08.759990+0000","last_clean":"2024-07-24T16:24:08.759990+0000","last_became_active":"2024-07-24T16:24:07.447131+0000","last_became_peered":"2024-07-24T16:24:07.447131+0000","last_unstale":"2024-07-24T16:24:08.759990+0000","last_undegraded":"2024-07-24T16:24:08.759990+0000","last_fullsized":"2024-07-24T16:24:08.759990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:00.032046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662902+0000","last_change":"2024-07-24T16:24:03.414198+0000","last_active":"2024-07-24T16:24:08.662902+0000","last_peered":"2024-07-24T16:24:08.662902+0000","last_clean":"2024-07-24T16:24:08.662902+0000","last_became_active":"2024-07-24T16:24:03.413765+0000","last_became_peered":"2024-07-24T16:24:03.413765+0000","last_unstale":"2024-07-24T16:24:08.662902+0000","last_undegraded":"2024-07-24T16:24:08.662902+0000","last_fullsized":"2024-07-24T16:24:08.662902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:11.929285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930215+0000","last_change":"2024-07-24T16:24:02.424488+0000","last_active":"2024-07-24T16:24:08.930215+0000","last_peered":"2024-07-24T16:24:08.930215+0000","last_clean":"2024-07-24T16:24:08.930215+0000","last_became_active":"2024-07-24T16:24:02.424175+0000","last_became_peered":"2024-07-24T16:24:02.424175+0000","last_unstale":"2024-07-24T16:24:08.930215+0000","last_undegraded":"2024-07-24T16:24:08.930215+0000","last_fullsized":"2024-07-24T16:24:08.930215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930944+0000","last_change":"2024-07-24T16:24:07.689275+0000","last_active":"2024-07-24T16:24:08.930944+0000","last_peered":"2024-07-24T16:24:08.930944+0000","last_clean":"2024-07-24T16:24:08.930944+0000","last_became_active":"2024-07-24T16:24:07.688814+0000","last_became_peered":"2024-07-24T16:24:07.688814+0000","last_unstale":"2024-07-24T16:24:08.930944+0000","last_undegraded":"2024-07-24T16:24:08.930944+0000","last_fullsized":"2024-07-24T16:24:08.930944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:50:06.081975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759861+0000","last_change":"2024-07-24T16:24:03.410501+0000","last_active":"2024-07-24T16:24:08.759861+0000","last_peered":"2024-07-24T16:24:08.759861+0000","last_clean":"2024-07-24T16:24:08.759861+0000","last_became_active":"2024-07-24T16:24:03.410221+0000","last_became_peered":"2024-07-24T16:24:03.410221+0000","last_unstale":"2024-07-24T16:24:08.759861+0000","last_undegraded":"2024-07-24T16:24:08.759861+0000","last_fullsized":"2024-07-24T16:24:08.759861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:07.509173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930886+0000","last_change":"2024-07-24T16:24:02.424500+0000","last_active":"2024-07-24T16:24:08.930886+0000","last_peered":"2024-07-24T16:24:08.930886+0000","last_clean":"2024-07-24T16:24:08.930886+0000","last_became_active":"2024-07-24T16:24:02.423974+0000","last_became_peered":"2024-07-24T16:24:02.423974+0000","last_unstale":"2024-07-24T16:24:08.930886+0000","last_undegraded":"2024-07-24T16:24:08.930886+0000","last_fullsized":"2024-07-24T16:24:08.930886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760199+0000","last_change":"2024-07-24T16:24:07.446830+0000","last_active":"2024-07-24T16:24:08.760199+0000","last_peered":"2024-07-24T16:24:08.760199+0000","last_clean":"2024-07-24T16:24:08.760199+0000","last_became_active":"2024-07-24T16:24:07.446412+0000","last_became_peered":"2024-07-24T16:24:07.446412+0000","last_unstale":"2024-07-24T16:24:08.760199+0000","last_undegraded":"2024-07-24T16:24:08.760199+0000","last_fullsized":"2024-07-24T16:24:08.760199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:46.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441614+0000","last_change":"2024-07-24T16:24:03.418856+0000","last_active":"2024-07-24T16:24:08.441614+0000","last_peered":"2024-07-24T16:24:08.441614+0000","last_clean":"2024-07-24T16:24:08.441614+0000","last_became_active":"2024-07-24T16:24:03.418584+0000","last_became_peered":"2024-07-24T16:24:03.418584+0000","last_unstale":"2024-07-24T16:24:08.441614+0000","last_undegraded":"2024-07-24T16:24:08.441614+0000","last_fullsized":"2024-07-24T16:24:08.441614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931815+0000","last_change":"2024-07-24T16:24:02.424481+0000","last_active":"2024-07-24T16:24:08.931815+0000","last_peered":"2024-07-24T16:24:08.931815+0000","last_clean":"2024-07-24T16:24:08.931815+0000","last_became_active":"2024-07-24T16:24:02.424223+0000","last_became_peered":"2024-07-24T16:24:02.424223+0000","last_unstale":"2024-07-24T16:24:08.931815+0000","last_undegraded":"2024-07-24T16:24:08.931815+0000","last_fullsized":"2024-07-24T16:24:08.931815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759577+0000","last_change":"2024-07-24T16:24:07.689438+0000","last_active":"2024-07-24T16:24:08.759577+0000","last_peered":"2024-07-24T16:24:08.759577+0000","last_clean":"2024-07-24T16:24:08.759577+0000","last_became_active":"2024-07-24T16:24:07.689062+0000","last_became_peered":"2024-07-24T16:24:07.689062+0000","last_unstale":"2024-07-24T16:24:08.759577+0000","last_undegraded":"2024-07-24T16:24:08.759577+0000","last_fullsized":"2024-07-24T16:24:08.759577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:15.957949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663604+0000","last_change":"2024-07-24T16:24:03.420566+0000","last_active":"2024-07-24T16:24:08.663604+0000","last_peered":"2024-07-24T16:24:08.663604+0000","last_clean":"2024-07-24T16:24:08.663604+0000","last_became_active":"2024-07-24T16:24:03.420294+0000","last_became_peered":"2024-07-24T16:24:03.420294+0000","last_unstale":"2024-07-24T16:24:08.663604+0000","last_undegraded":"2024-07-24T16:24:08.663604+0000","last_fullsized":"2024-07-24T16:24:08.663604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:01.499631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930843+0000","last_change":"2024-07-24T16:24:02.417701+0000","last_active":"2024-07-24T16:24:08.930843+0000","last_peered":"2024-07-24T16:24:08.930843+0000","last_clean":"2024-07-24T16:24:08.930843+0000","last_became_active":"2024-07-24T16:24:02.417387+0000","last_became_peered":"2024-07-24T16:24:02.417387+0000","last_unstale":"2024-07-24T16:24:08.930843+0000","last_undegraded":"2024-07-24T16:24:08.930843+0000","last_fullsized":"2024-07-24T16:24:08.930843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662631+0000","last_change":"2024-07-24T16:24:07.692448+0000","last_active":"2024-07-24T16:24:08.662631+0000","last_peered":"2024-07-24T16:24:08.662631+0000","last_clean":"2024-07-24T16:24:08.662631+0000","last_became_active":"2024-07-24T16:24:07.691926+0000","last_became_peered":"2024-07-24T16:24:07.691926+0000","last_unstale":"2024-07-24T16:24:08.662631+0000","last_undegraded":"2024-07-24T16:24:08.662631+0000","last_fullsized":"2024-07-24T16:24:08.662631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:53:01.459934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930611+0000","last_change":"2024-07-24T16:24:03.407657+0000","last_active":"2024-07-24T16:24:08.930611+0000","last_peered":"2024-07-24T16:24:08.930611+0000","last_clean":"2024-07-24T16:24:08.930611+0000","last_became_active":"2024-07-24T16:24:03.407207+0000","last_became_peered":"2024-07-24T16:24:03.407207+0000","last_unstale":"2024-07-24T16:24:08.930611+0000","last_undegraded":"2024-07-24T16:24:08.930611+0000","last_fullsized":"2024-07-24T16:24:08.930611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932275+0000","last_change":"2024-07-24T16:24:02.424314+0000","last_active":"2024-07-24T16:24:08.932275+0000","last_peered":"2024-07-24T16:24:08.932275+0000","last_clean":"2024-07-24T16:24:08.932275+0000","last_became_active":"2024-07-24T16:24:02.424058+0000","last_became_peered":"2024-07-24T16:24:02.424058+0000","last_unstale":"2024-07-24T16:24:08.932275+0000","last_undegraded":"2024-07-24T16:24:08.932275+0000","last_fullsized":"2024-07-24T16:24:08.932275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:56:35.089759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441392+0000","last_change":"2024-07-24T16:24:07.689455+0000","last_active":"2024-07-24T16:24:08.441392+0000","last_peered":"2024-07-24T16:24:08.441392+0000","last_clean":"2024-07-24T16:24:08.441392+0000","last_became_active":"2024-07-24T16:24:07.689096+0000","last_became_peered":"2024-07-24T16:24:07.689096+0000","last_unstale":"2024-07-24T16:24:08.441392+0000","last_undegraded":"2024-07-24T16:24:08.441392+0000","last_fullsized":"2024-07-24T16:24:08.441392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:46.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442272+0000","last_change":"2024-07-24T16:24:03.418605+0000","last_active":"2024-07-24T16:24:08.442272+0000","last_peered":"2024-07-24T16:24:08.442272+0000","last_clean":"2024-07-24T16:24:08.442272+0000","last_became_active":"2024-07-24T16:24:03.417882+0000","last_became_peered":"2024-07-24T16:24:03.417882+0000","last_unstale":"2024-07-24T16:24:08.442272+0000","last_undegraded":"2024-07-24T16:24:08.442272+0000","last_fullsized":"2024-07-24T16:24:08.442272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:01.499631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930686+0000","last_change":"2024-07-24T16:24:02.414441+0000","last_active":"2024-07-24T16:24:08.930686+0000","last_peered":"2024-07-24T16:24:08.930686+0000","last_clean":"2024-07-24T16:24:08.930686+0000","last_became_active":"2024-07-24T16:24:02.414195+0000","last_became_peered":"2024-07-24T16:24:02.414195+0000","last_unstale":"2024-07-24T16:24:08.930686+0000","last_undegraded":"2024-07-24T16:24:08.930686+0000","last_fullsized":"2024-07-24T16:24:08.930686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:11:26.148830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930197+0000","last_change":"2024-07-24T16:24:07.456656+0000","last_active":"2024-07-24T16:24:08.930197+0000","last_peered":"2024-07-24T16:24:08.930197+0000","last_clean":"2024-07-24T16:24:08.930197+0000","last_became_active":"2024-07-24T16:24:07.456253+0000","last_became_peered":"2024-07-24T16:24:07.456253+0000","last_unstale":"2024-07-24T16:24:08.930197+0000","last_undegraded":"2024-07-24T16:24:08.930197+0000","last_fullsized":"2024-07-24T16:24:08.930197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:46.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760097+0000","last_change":"2024-07-24T16:24:03.419761+0000","last_active":"2024-07-24T16:24:08.760097+0000","last_peered":"2024-07-24T16:24:08.760097+0000","last_clean":"2024-07-24T16:24:08.760097+0000","last_became_active":"2024-07-24T16:24:03.419479+0000","last_became_peered":"2024-07-24T16:24:03.419479+0000","last_unstale":"2024-07-24T16:24:08.760097+0000","last_undegraded":"2024-07-24T16:24:08.760097+0000","last_fullsized":"2024-07-24T16:24:08.760097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:45:49.295282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442191+0000","last_change":"2024-07-24T16:24:02.414549+0000","last_active":"2024-07-24T16:24:08.442191+0000","last_peered":"2024-07-24T16:24:08.442191+0000","last_clean":"2024-07-24T16:24:08.442191+0000","last_became_active":"2024-07-24T16:24:02.414271+0000","last_became_peered":"2024-07-24T16:24:02.414271+0000","last_unstale":"2024-07-24T16:24:08.442191+0000","last_undegraded":"2024-07-24T16:24:08.442191+0000","last_fullsized":"2024-07-24T16:24:08.442191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930578+0000","last_change":"2024-07-24T16:24:07.446913+0000","last_active":"2024-07-24T16:24:08.930578+0000","last_peered":"2024-07-24T16:24:08.930578+0000","last_clean":"2024-07-24T16:24:08.930578+0000","last_became_active":"2024-07-24T16:24:07.446002+0000","last_became_peered":"2024-07-24T16:24:07.446002+0000","last_unstale":"2024-07-24T16:24:08.930578+0000","last_undegraded":"2024-07-24T16:24:08.930578+0000","last_fullsized":"2024-07-24T16:24:08.930578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:41.634001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930229+0000","last_change":"2024-07-24T16:24:03.406743+0000","last_active":"2024-07-24T16:24:08.930229+0000","last_peered":"2024-07-24T16:24:08.930229+0000","last_clean":"2024-07-24T16:24:08.930229+0000","last_became_active":"2024-07-24T16:24:03.406481+0000","last_became_peered":"2024-07-24T16:24:03.406481+0000","last_unstale":"2024-07-24T16:24:08.930229+0000","last_undegraded":"2024-07-24T16:24:08.930229+0000","last_fullsized":"2024-07-24T16:24:08.930229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.439757+0000","last_change":"2024-07-24T16:24:02.412920+0000","last_active":"2024-07-24T16:24:08.439757+0000","last_peered":"2024-07-24T16:24:08.439757+0000","last_clean":"2024-07-24T16:24:08.439757+0000","last_became_active":"2024-07-24T16:24:02.412548+0000","last_became_peered":"2024-07-24T16:24:02.412548+0000","last_unstale":"2024-07-24T16:24:08.439757+0000","last_undegraded":"2024-07-24T16:24:08.439757+0000","last_fullsized":"2024-07-24T16:24:08.439757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930950+0000","last_change":"2024-07-24T16:24:07.456001+0000","last_active":"2024-07-24T16:24:08.930950+0000","last_peered":"2024-07-24T16:24:08.930950+0000","last_clean":"2024-07-24T16:24:08.930950+0000","last_became_active":"2024-07-24T16:24:07.455608+0000","last_became_peered":"2024-07-24T16:24:07.455608+0000","last_unstale":"2024-07-24T16:24:08.930950+0000","last_undegraded":"2024-07-24T16:24:08.930950+0000","last_fullsized":"2024-07-24T16:24:08.930950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:48:55.180884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441022+0000","last_change":"2024-07-24T16:24:03.421468+0000","last_active":"2024-07-24T16:24:08.441022+0000","last_peered":"2024-07-24T16:24:08.441022+0000","last_clean":"2024-07-24T16:24:08.441022+0000","last_became_active":"2024-07-24T16:24:03.420885+0000","last_became_peered":"2024-07-24T16:24:03.420885+0000","last_unstale":"2024-07-24T16:24:08.441022+0000","last_undegraded":"2024-07-24T16:24:08.441022+0000","last_fullsized":"2024-07-24T16:24:08.441022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930925+0000","last_change":"2024-07-24T16:24:02.424655+0000","last_active":"2024-07-24T16:24:08.930925+0000","last_peered":"2024-07-24T16:24:08.930925+0000","last_clean":"2024-07-24T16:24:08.930925+0000","last_became_active":"2024-07-24T16:24:02.424258+0000","last_became_peered":"2024-07-24T16:24:02.424258+0000","last_unstale":"2024-07-24T16:24:08.930925+0000","last_undegraded":"2024-07-24T16:24:08.930925+0000","last_fullsized":"2024-07-24T16:24:08.930925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441444+0000","last_change":"2024-07-24T16:24:07.689063+0000","last_active":"2024-07-24T16:24:08.441444+0000","last_peered":"2024-07-24T16:24:08.441444+0000","last_clean":"2024-07-24T16:24:08.441444+0000","last_became_active":"2024-07-24T16:24:07.688668+0000","last_became_peered":"2024-07-24T16:24:07.688668+0000","last_unstale":"2024-07-24T16:24:08.441444+0000","last_undegraded":"2024-07-24T16:24:08.441444+0000","last_fullsized":"2024-07-24T16:24:08.441444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:41.279030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663032+0000","last_change":"2024-07-24T16:24:03.414611+0000","last_active":"2024-07-24T16:24:08.663032+0000","last_peered":"2024-07-24T16:24:08.663032+0000","last_clean":"2024-07-24T16:24:08.663032+0000","last_became_active":"2024-07-24T16:24:03.414234+0000","last_became_peered":"2024-07-24T16:24:03.414234+0000","last_unstale":"2024-07-24T16:24:08.663032+0000","last_undegraded":"2024-07-24T16:24:08.663032+0000","last_fullsized":"2024-07-24T16:24:08.663032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442285+0000","last_change":"2024-07-24T16:24:02.413921+0000","last_active":"2024-07-24T16:24:08.442285+0000","last_peered":"2024-07-24T16:24:08.442285+0000","last_clean":"2024-07-24T16:24:08.442285+0000","last_became_active":"2024-07-24T16:24:02.413460+0000","last_became_peered":"2024-07-24T16:24:02.413460+0000","last_unstale":"2024-07-24T16:24:08.442285+0000","last_undegraded":"2024-07-24T16:24:08.442285+0000","last_fullsized":"2024-07-24T16:24:08.442285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":117,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930636+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:24:08.930636+0000","last_peered":"2024-07-24T16:24:08.930636+0000","last_clean":"2024-07-24T16:24:08.930636+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:24:08.930636+0000","last_undegraded":"2024-07-24T16:24:08.930636+0000","last_fullsized":"2024-07-24T16:24:08.930636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931362+0000","last_change":"2024-07-24T16:24:07.691109+0000","last_active":"2024-07-24T16:24:08.931362+0000","last_peered":"2024-07-24T16:24:08.931362+0000","last_clean":"2024-07-24T16:24:08.931362+0000","last_became_active":"2024-07-24T16:24:07.690690+0000","last_became_peered":"2024-07-24T16:24:07.690690+0000","last_unstale":"2024-07-24T16:24:08.931362+0000","last_undegraded":"2024-07-24T16:24:08.931362+0000","last_fullsized":"2024-07-24T16:24:08.931362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:00.032046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931993+0000","last_change":"2024-07-24T16:24:03.425855+0000","last_active":"2024-07-24T16:24:08.931993+0000","last_peered":"2024-07-24T16:24:08.931993+0000","last_clean":"2024-07-24T16:24:08.931993+0000","last_became_active":"2024-07-24T16:24:03.425039+0000","last_became_peered":"2024-07-24T16:24:03.425039+0000","last_unstale":"2024-07-24T16:24:08.931993+0000","last_undegraded":"2024-07-24T16:24:08.931993+0000","last_fullsized":"2024-07-24T16:24:08.931993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:32:56.003382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440339+0000","last_change":"2024-07-24T16:24:02.419130+0000","last_active":"2024-07-24T16:24:08.440339+0000","last_peered":"2024-07-24T16:24:08.440339+0000","last_clean":"2024-07-24T16:24:08.440339+0000","last_became_active":"2024-07-24T16:24:02.418877+0000","last_became_peered":"2024-07-24T16:24:02.418877+0000","last_unstale":"2024-07-24T16:24:08.440339+0000","last_undegraded":"2024-07-24T16:24:08.440339+0000","last_fullsized":"2024-07-24T16:24:08.440339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:11:26.148830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931126+0000","last_change":"2024-07-24T16:24:07.689387+0000","last_active":"2024-07-24T16:24:08.931126+0000","last_peered":"2024-07-24T16:24:08.931126+0000","last_clean":"2024-07-24T16:24:08.931126+0000","last_became_active":"2024-07-24T16:24:07.688861+0000","last_became_peered":"2024-07-24T16:24:07.688861+0000","last_unstale":"2024-07-24T16:24:08.931126+0000","last_undegraded":"2024-07-24T16:24:08.931126+0000","last_fullsized":"2024-07-24T16:24:08.931126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:29.138058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442010+0000","last_change":"2024-07-24T16:24:03.414560+0000","last_active":"2024-07-24T16:24:08.442010+0000","last_peered":"2024-07-24T16:24:08.442010+0000","last_clean":"2024-07-24T16:24:08.442010+0000","last_became_active":"2024-07-24T16:24:03.414244+0000","last_became_peered":"2024-07-24T16:24:03.414244+0000","last_unstale":"2024-07-24T16:24:08.442010+0000","last_undegraded":"2024-07-24T16:24:08.442010+0000","last_fullsized":"2024-07-24T16:24:08.442010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:21.258885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930741+0000","last_change":"2024-07-24T16:24:02.414255+0000","last_active":"2024-07-24T16:24:08.930741+0000","last_peered":"2024-07-24T16:24:08.930741+0000","last_clean":"2024-07-24T16:24:08.930741+0000","last_became_active":"2024-07-24T16:24:02.413982+0000","last_became_peered":"2024-07-24T16:24:02.413982+0000","last_unstale":"2024-07-24T16:24:08.930741+0000","last_undegraded":"2024-07-24T16:24:08.930741+0000","last_fullsized":"2024-07-24T16:24:08.930741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441533+0000","last_change":"2024-07-24T16:24:07.450463+0000","last_active":"2024-07-24T16:24:08.441533+0000","last_peered":"2024-07-24T16:24:08.441533+0000","last_clean":"2024-07-24T16:24:08.441533+0000","last_became_active":"2024-07-24T16:24:07.449717+0000","last_became_peered":"2024-07-24T16:24:07.449717+0000","last_unstale":"2024-07-24T16:24:08.441533+0000","last_undegraded":"2024-07-24T16:24:08.441533+0000","last_fullsized":"2024-07-24T16:24:08.441533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:41.634001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932150+0000","last_change":"2024-07-24T16:24:03.421244+0000","last_active":"2024-07-24T16:24:08.932150+0000","last_peered":"2024-07-24T16:24:08.932150+0000","last_clean":"2024-07-24T16:24:08.932150+0000","last_became_active":"2024-07-24T16:24:03.420900+0000","last_became_peered":"2024-07-24T16:24:03.420900+0000","last_unstale":"2024-07-24T16:24:08.932150+0000","last_undegraded":"2024-07-24T16:24:08.932150+0000","last_fullsized":"2024-07-24T16:24:08.932150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:48:51.152220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440222+0000","last_change":"2024-07-24T16:24:02.413448+0000","last_active":"2024-07-24T16:24:08.440222+0000","last_peered":"2024-07-24T16:24:08.440222+0000","last_clean":"2024-07-24T16:24:08.440222+0000","last_became_active":"2024-07-24T16:24:02.412569+0000","last_became_peered":"2024-07-24T16:24:02.412569+0000","last_unstale":"2024-07-24T16:24:08.440222+0000","last_undegraded":"2024-07-24T16:24:08.440222+0000","last_fullsized":"2024-07-24T16:24:08.440222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441408+0000","last_change":"2024-07-24T16:24:07.689773+0000","last_active":"2024-07-24T16:24:08.441408+0000","last_peered":"2024-07-24T16:24:08.441408+0000","last_clean":"2024-07-24T16:24:08.441408+0000","last_became_active":"2024-07-24T16:24:07.689367+0000","last_became_peered":"2024-07-24T16:24:07.689367+0000","last_unstale":"2024-07-24T16:24:08.441408+0000","last_undegraded":"2024-07-24T16:24:08.441408+0000","last_fullsized":"2024-07-24T16:24:08.441408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:53:01.459934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932045+0000","last_change":"2024-07-24T16:24:03.420569+0000","last_active":"2024-07-24T16:24:08.932045+0000","last_peered":"2024-07-24T16:24:08.932045+0000","last_clean":"2024-07-24T16:24:08.932045+0000","last_became_active":"2024-07-24T16:24:03.420253+0000","last_became_peered":"2024-07-24T16:24:03.420253+0000","last_unstale":"2024-07-24T16:24:08.932045+0000","last_undegraded":"2024-07-24T16:24:08.932045+0000","last_fullsized":"2024-07-24T16:24:08.932045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:21.258885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760346+0000","last_change":"2024-07-24T16:24:02.417860+0000","last_active":"2024-07-24T16:24:08.760346+0000","last_peered":"2024-07-24T16:24:08.760346+0000","last_clean":"2024-07-24T16:24:08.760346+0000","last_became_active":"2024-07-24T16:24:02.417610+0000","last_became_peered":"2024-07-24T16:24:02.417610+0000","last_unstale":"2024-07-24T16:24:08.760346+0000","last_undegraded":"2024-07-24T16:24:08.760346+0000","last_fullsized":"2024-07-24T16:24:08.760346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:34:17.692339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759523+0000","last_change":"2024-07-24T16:24:07.447096+0000","last_active":"2024-07-24T16:24:08.759523+0000","last_peered":"2024-07-24T16:24:08.759523+0000","last_clean":"2024-07-24T16:24:08.759523+0000","last_became_active":"2024-07-24T16:24:07.446606+0000","last_became_peered":"2024-07-24T16:24:07.446606+0000","last_unstale":"2024-07-24T16:24:08.759523+0000","last_undegraded":"2024-07-24T16:24:08.759523+0000","last_fullsized":"2024-07-24T16:24:08.759523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:31.194762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931063+0000","last_change":"2024-07-24T16:24:03.425422+0000","last_active":"2024-07-24T16:24:08.931063+0000","last_peered":"2024-07-24T16:24:08.931063+0000","last_clean":"2024-07-24T16:24:08.931063+0000","last_became_active":"2024-07-24T16:24:03.421595+0000","last_became_peered":"2024-07-24T16:24:03.421595+0000","last_unstale":"2024-07-24T16:24:08.931063+0000","last_undegraded":"2024-07-24T16:24:08.931063+0000","last_fullsized":"2024-07-24T16:24:08.931063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:11.929285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.439657+0000","last_change":"2024-07-24T16:24:02.411221+0000","last_active":"2024-07-24T16:24:08.439657+0000","last_peered":"2024-07-24T16:24:08.439657+0000","last_clean":"2024-07-24T16:24:08.439657+0000","last_became_active":"2024-07-24T16:24:02.410863+0000","last_became_peered":"2024-07-24T16:24:02.410863+0000","last_unstale":"2024-07-24T16:24:08.439657+0000","last_undegraded":"2024-07-24T16:24:08.439657+0000","last_fullsized":"2024-07-24T16:24:08.439657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:39:09.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441228+0000","last_change":"2024-07-24T16:24:07.451699+0000","last_active":"2024-07-24T16:24:08.441228+0000","last_peered":"2024-07-24T16:24:08.441228+0000","last_clean":"2024-07-24T16:24:08.441228+0000","last_became_active":"2024-07-24T16:24:07.451312+0000","last_became_peered":"2024-07-24T16:24:07.451312+0000","last_unstale":"2024-07-24T16:24:08.441228+0000","last_undegraded":"2024-07-24T16:24:08.441228+0000","last_fullsized":"2024-07-24T16:24:08.441228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:00.032046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930892+0000","last_change":"2024-07-24T16:24:03.423978+0000","last_active":"2024-07-24T16:24:08.930892+0000","last_peered":"2024-07-24T16:24:08.930892+0000","last_clean":"2024-07-24T16:24:08.930892+0000","last_became_active":"2024-07-24T16:24:03.423695+0000","last_became_peered":"2024-07-24T16:24:03.423695+0000","last_unstale":"2024-07-24T16:24:08.930892+0000","last_undegraded":"2024-07-24T16:24:08.930892+0000","last_fullsized":"2024-07-24T16:24:08.930892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930970+0000","last_change":"2024-07-24T16:24:02.420730+0000","last_active":"2024-07-24T16:24:08.930970+0000","last_peered":"2024-07-24T16:24:08.930970+0000","last_clean":"2024-07-24T16:24:08.930970+0000","last_became_active":"2024-07-24T16:24:02.420437+0000","last_became_peered":"2024-07-24T16:24:02.420437+0000","last_unstale":"2024-07-24T16:24:08.930970+0000","last_undegraded":"2024-07-24T16:24:08.930970+0000","last_fullsized":"2024-07-24T16:24:08.930970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663486+0000","last_change":"2024-07-24T16:24:07.689640+0000","last_active":"2024-07-24T16:24:08.663486+0000","last_peered":"2024-07-24T16:24:08.663486+0000","last_clean":"2024-07-24T16:24:08.663486+0000","last_became_active":"2024-07-24T16:24:07.689279+0000","last_became_peered":"2024-07-24T16:24:07.689279+0000","last_unstale":"2024-07-24T16:24:08.663486+0000","last_undegraded":"2024-07-24T16:24:08.663486+0000","last_fullsized":"2024-07-24T16:24:08.663486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:48:40.982486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931940+0000","last_change":"2024-07-24T16:24:03.422243+0000","last_active":"2024-07-24T16:24:08.931940+0000","last_peered":"2024-07-24T16:24:08.931940+0000","last_clean":"2024-07-24T16:24:08.931940+0000","last_became_active":"2024-07-24T16:24:03.419977+0000","last_became_peered":"2024-07-24T16:24:03.419977+0000","last_unstale":"2024-07-24T16:24:08.931940+0000","last_undegraded":"2024-07-24T16:24:08.931940+0000","last_fullsized":"2024-07-24T16:24:08.931940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:33:56.923986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442330+0000","last_change":"2024-07-24T16:24:02.415148+0000","last_active":"2024-07-24T16:24:08.442330+0000","last_peered":"2024-07-24T16:24:08.442330+0000","last_clean":"2024-07-24T16:24:08.442330+0000","last_became_active":"2024-07-24T16:24:02.414888+0000","last_became_peered":"2024-07-24T16:24:02.414888+0000","last_unstale":"2024-07-24T16:24:08.442330+0000","last_undegraded":"2024-07-24T16:24:08.442330+0000","last_fullsized":"2024-07-24T16:24:08.442330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663297+0000","last_change":"2024-07-24T16:24:07.689067+0000","last_active":"2024-07-24T16:24:08.663297+0000","last_peered":"2024-07-24T16:24:08.663297+0000","last_clean":"2024-07-24T16:24:08.663297+0000","last_became_active":"2024-07-24T16:24:07.688641+0000","last_became_peered":"2024-07-24T16:24:07.688641+0000","last_unstale":"2024-07-24T16:24:08.663297+0000","last_undegraded":"2024-07-24T16:24:08.663297+0000","last_fullsized":"2024-07-24T16:24:08.663297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:25:51.738843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441338+0000","last_change":"2024-07-24T16:24:03.431327+0000","last_active":"2024-07-24T16:24:08.441338+0000","last_peered":"2024-07-24T16:24:08.441338+0000","last_clean":"2024-07-24T16:24:08.441338+0000","last_became_active":"2024-07-24T16:24:03.430853+0000","last_became_peered":"2024-07-24T16:24:03.430853+0000","last_unstale":"2024-07-24T16:24:08.441338+0000","last_undegraded":"2024-07-24T16:24:08.441338+0000","last_fullsized":"2024-07-24T16:24:08.441338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441701+0000","last_change":"2024-07-24T16:24:02.420934+0000","last_active":"2024-07-24T16:24:08.441701+0000","last_peered":"2024-07-24T16:24:08.441701+0000","last_clean":"2024-07-24T16:24:08.441701+0000","last_became_active":"2024-07-24T16:24:02.420671+0000","last_became_peered":"2024-07-24T16:24:02.420671+0000","last_unstale":"2024-07-24T16:24:08.441701+0000","last_undegraded":"2024-07-24T16:24:08.441701+0000","last_fullsized":"2024-07-24T16:24:08.441701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:34:17.692339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441875+0000","last_change":"2024-07-24T16:24:07.689105+0000","last_active":"2024-07-24T16:24:08.441875+0000","last_peered":"2024-07-24T16:24:08.441875+0000","last_clean":"2024-07-24T16:24:08.441875+0000","last_became_active":"2024-07-24T16:24:07.688653+0000","last_became_peered":"2024-07-24T16:24:07.688653+0000","last_unstale":"2024-07-24T16:24:08.441875+0000","last_undegraded":"2024-07-24T16:24:08.441875+0000","last_fullsized":"2024-07-24T16:24:08.441875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:53:17.994950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931785+0000","last_change":"2024-07-24T16:24:03.426312+0000","last_active":"2024-07-24T16:24:08.931785+0000","last_peered":"2024-07-24T16:24:08.931785+0000","last_clean":"2024-07-24T16:24:08.931785+0000","last_became_active":"2024-07-24T16:24:03.425604+0000","last_became_peered":"2024-07-24T16:24:03.425604+0000","last_unstale":"2024-07-24T16:24:08.931785+0000","last_undegraded":"2024-07-24T16:24:08.931785+0000","last_fullsized":"2024-07-24T16:24:08.931785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:25.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:12.924059+0000","last_change":"2024-07-24T16:24:02.422934+0000","last_active":"2024-07-24T16:24:12.924059+0000","last_peered":"2024-07-24T16:24:12.924059+0000","last_clean":"2024-07-24T16:24:12.924059+0000","last_became_active":"2024-07-24T16:24:02.422695+0000","last_became_peered":"2024-07-24T16:24:02.422695+0000","last_unstale":"2024-07-24T16:24:12.924059+0000","last_undegraded":"2024-07-24T16:24:12.924059+0000","last_fullsized":"2024-07-24T16:24:12.924059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930364+0000","last_change":"2024-07-24T16:24:07.456345+0000","last_active":"2024-07-24T16:24:08.930364+0000","last_peered":"2024-07-24T16:24:08.930364+0000","last_clean":"2024-07-24T16:24:08.930364+0000","last_became_active":"2024-07-24T16:24:07.455655+0000","last_became_peered":"2024-07-24T16:24:07.455655+0000","last_unstale":"2024-07-24T16:24:08.930364+0000","last_undegraded":"2024-07-24T16:24:08.930364+0000","last_fullsized":"2024-07-24T16:24:08.930364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:41.279030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760268+0000","last_change":"2024-07-24T16:24:03.421137+0000","last_active":"2024-07-24T16:24:08.760268+0000","last_peered":"2024-07-24T16:24:08.760268+0000","last_clean":"2024-07-24T16:24:08.760268+0000","last_became_active":"2024-07-24T16:24:03.420297+0000","last_became_peered":"2024-07-24T16:24:03.420297+0000","last_unstale":"2024-07-24T16:24:08.760268+0000","last_undegraded":"2024-07-24T16:24:08.760268+0000","last_fullsized":"2024-07-24T16:24:08.760268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:56:36.133125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930677+0000","last_change":"2024-07-24T16:24:02.420388+0000","last_active":"2024-07-24T16:24:08.930677+0000","last_peered":"2024-07-24T16:24:08.930677+0000","last_clean":"2024-07-24T16:24:08.930677+0000","last_became_active":"2024-07-24T16:24:02.420112+0000","last_became_peered":"2024-07-24T16:24:02.420112+0000","last_unstale":"2024-07-24T16:24:08.930677+0000","last_undegraded":"2024-07-24T16:24:08.930677+0000","last_fullsized":"2024-07-24T16:24:08.930677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759693+0000","last_change":"2024-07-24T16:24:07.448340+0000","last_active":"2024-07-24T16:24:08.759693+0000","last_peered":"2024-07-24T16:24:08.759693+0000","last_clean":"2024-07-24T16:24:08.759693+0000","last_became_active":"2024-07-24T16:24:07.447324+0000","last_became_peered":"2024-07-24T16:24:07.447324+0000","last_unstale":"2024-07-24T16:24:08.759693+0000","last_undegraded":"2024-07-24T16:24:08.759693+0000","last_fullsized":"2024-07-24T16:24:08.759693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:34:00.952650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441533+0000","last_change":"2024-07-24T16:24:03.426242+0000","last_active":"2024-07-24T16:24:08.441533+0000","last_peered":"2024-07-24T16:24:08.441533+0000","last_clean":"2024-07-24T16:24:08.441533+0000","last_became_active":"2024-07-24T16:24:03.425940+0000","last_became_peered":"2024-07-24T16:24:03.425940+0000","last_unstale":"2024-07-24T16:24:08.441533+0000","last_undegraded":"2024-07-24T16:24:08.441533+0000","last_fullsized":"2024-07-24T16:24:08.441533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442327+0000","last_change":"2024-07-24T16:24:02.419299+0000","last_active":"2024-07-24T16:24:08.442327+0000","last_peered":"2024-07-24T16:24:08.442327+0000","last_clean":"2024-07-24T16:24:08.442327+0000","last_became_active":"2024-07-24T16:24:02.419004+0000","last_became_peered":"2024-07-24T16:24:02.419004+0000","last_unstale":"2024-07-24T16:24:08.442327+0000","last_undegraded":"2024-07-24T16:24:08.442327+0000","last_fullsized":"2024-07-24T16:24:08.442327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662799+0000","last_change":"2024-07-24T16:24:07.446403+0000","last_active":"2024-07-24T16:24:08.662799+0000","last_peered":"2024-07-24T16:24:08.662799+0000","last_clean":"2024-07-24T16:24:08.662799+0000","last_became_active":"2024-07-24T16:24:07.445711+0000","last_became_peered":"2024-07-24T16:24:07.445711+0000","last_unstale":"2024-07-24T16:24:08.662799+0000","last_undegraded":"2024-07-24T16:24:08.662799+0000","last_fullsized":"2024-07-24T16:24:08.662799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:14:48.365984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441973+0000","last_change":"2024-07-24T16:24:03.421104+0000","last_active":"2024-07-24T16:24:08.441973+0000","last_peered":"2024-07-24T16:24:08.441973+0000","last_clean":"2024-07-24T16:24:08.441973+0000","last_became_active":"2024-07-24T16:24:03.420479+0000","last_became_peered":"2024-07-24T16:24:03.420479+0000","last_unstale":"2024-07-24T16:24:08.441973+0000","last_undegraded":"2024-07-24T16:24:08.441973+0000","last_fullsized":"2024-07-24T16:24:08.441973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:37.605337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931694+0000","last_change":"2024-07-24T16:24:02.424342+0000","last_active":"2024-07-24T16:24:08.931694+0000","last_peered":"2024-07-24T16:24:08.931694+0000","last_clean":"2024-07-24T16:24:08.931694+0000","last_became_active":"2024-07-24T16:24:02.424056+0000","last_became_peered":"2024-07-24T16:24:02.424056+0000","last_unstale":"2024-07-24T16:24:08.931694+0000","last_undegraded":"2024-07-24T16:24:08.931694+0000","last_fullsized":"2024-07-24T16:24:08.931694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662718+0000","last_change":"2024-07-24T16:24:07.689112+0000","last_active":"2024-07-24T16:24:08.662718+0000","last_peered":"2024-07-24T16:24:08.662718+0000","last_clean":"2024-07-24T16:24:08.662718+0000","last_became_active":"2024-07-24T16:24:07.688763+0000","last_became_peered":"2024-07-24T16:24:07.688763+0000","last_unstale":"2024-07-24T16:24:08.662718+0000","last_undegraded":"2024-07-24T16:24:08.662718+0000","last_fullsized":"2024-07-24T16:24:08.662718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:53:17.994950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441200+0000","last_change":"2024-07-24T16:24:07.689772+0000","last_active":"2024-07-24T16:24:08.441200+0000","last_peered":"2024-07-24T16:24:08.441200+0000","last_clean":"2024-07-24T16:24:08.441200+0000","last_became_active":"2024-07-24T16:24:07.689417+0000","last_became_peered":"2024-07-24T16:24:07.689417+0000","last_unstale":"2024-07-24T16:24:08.441200+0000","last_undegraded":"2024-07-24T16:24:08.441200+0000","last_fullsized":"2024-07-24T16:24:08.441200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:25.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930100+0000","last_change":"2024-07-24T16:24:03.416202+0000","last_active":"2024-07-24T16:24:08.930100+0000","last_peered":"2024-07-24T16:24:08.930100+0000","last_clean":"2024-07-24T16:24:08.930100+0000","last_became_active":"2024-07-24T16:24:03.415444+0000","last_became_peered":"2024-07-24T16:24:03.415444+0000","last_unstale":"2024-07-24T16:24:08.930100+0000","last_undegraded":"2024-07-24T16:24:08.930100+0000","last_fullsized":"2024-07-24T16:24:08.930100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441673+0000","last_change":"2024-07-24T16:24:02.416160+0000","last_active":"2024-07-24T16:24:08.441673+0000","last_peered":"2024-07-24T16:24:08.441673+0000","last_clean":"2024-07-24T16:24:08.441673+0000","last_became_active":"2024-07-24T16:24:02.415685+0000","last_became_peered":"2024-07-24T16:24:02.415685+0000","last_unstale":"2024-07-24T16:24:08.441673+0000","last_undegraded":"2024-07-24T16:24:08.441673+0000","last_fullsized":"2024-07-24T16:24:08.441673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931484+0000","last_change":"2024-07-24T16:24:07.453889+0000","last_active":"2024-07-24T16:24:08.931484+0000","last_peered":"2024-07-24T16:24:08.931484+0000","last_clean":"2024-07-24T16:24:08.931484+0000","last_became_active":"2024-07-24T16:24:07.453401+0000","last_became_peered":"2024-07-24T16:24:07.453401+0000","last_unstale":"2024-07-24T16:24:08.931484+0000","last_undegraded":"2024-07-24T16:24:08.931484+0000","last_fullsized":"2024-07-24T16:24:08.931484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:25.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662799+0000","last_change":"2024-07-24T16:24:03.422055+0000","last_active":"2024-07-24T16:24:08.662799+0000","last_peered":"2024-07-24T16:24:08.662799+0000","last_clean":"2024-07-24T16:24:08.662799+0000","last_became_active":"2024-07-24T16:24:03.420953+0000","last_became_peered":"2024-07-24T16:24:03.420953+0000","last_unstale":"2024-07-24T16:24:08.662799+0000","last_undegraded":"2024-07-24T16:24:08.662799+0000","last_fullsized":"2024-07-24T16:24:08.662799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662904+0000","last_change":"2024-07-24T16:24:02.416293+0000","last_active":"2024-07-24T16:24:08.662904+0000","last_peered":"2024-07-24T16:24:08.662904+0000","last_clean":"2024-07-24T16:24:08.662904+0000","last_became_active":"2024-07-24T16:24:02.415990+0000","last_became_peered":"2024-07-24T16:24:02.415990+0000","last_unstale":"2024-07-24T16:24:08.662904+0000","last_undegraded":"2024-07-24T16:24:08.662904+0000","last_fullsized":"2024-07-24T16:24:08.662904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931260+0000","last_change":"2024-07-24T16:24:02.421954+0000","last_active":"2024-07-24T16:24:08.931260+0000","last_peered":"2024-07-24T16:24:08.931260+0000","last_clean":"2024-07-24T16:24:08.931260+0000","last_became_active":"2024-07-24T16:24:02.421684+0000","last_became_peered":"2024-07-24T16:24:02.421684+0000","last_unstale":"2024-07-24T16:24:08.931260+0000","last_undegraded":"2024-07-24T16:24:08.931260+0000","last_fullsized":"2024-07-24T16:24:08.931260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441648+0000","last_change":"2024-07-24T16:24:03.421135+0000","last_active":"2024-07-24T16:24:08.441648+0000","last_peered":"2024-07-24T16:24:08.441648+0000","last_clean":"2024-07-24T16:24:08.441648+0000","last_became_active":"2024-07-24T16:24:03.420836+0000","last_became_peered":"2024-07-24T16:24:03.420836+0000","last_unstale":"2024-07-24T16:24:08.441648+0000","last_undegraded":"2024-07-24T16:24:08.441648+0000","last_fullsized":"2024-07-24T16:24:08.441648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:17:16.704958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440237+0000","last_change":"2024-07-24T16:24:07.456171+0000","last_active":"2024-07-24T16:24:08.440237+0000","last_peered":"2024-07-24T16:24:08.440237+0000","last_clean":"2024-07-24T16:24:08.440237+0000","last_became_active":"2024-07-24T16:24:07.455706+0000","last_became_peered":"2024-07-24T16:24:07.455706+0000","last_unstale":"2024-07-24T16:24:08.440237+0000","last_undegraded":"2024-07-24T16:24:08.440237+0000","last_fullsized":"2024-07-24T16:24:08.440237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:57:59.034419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663222+0000","last_change":"2024-07-24T16:24:02.424430+0000","last_active":"2024-07-24T16:24:08.663222+0000","last_peered":"2024-07-24T16:24:08.663222+0000","last_clean":"2024-07-24T16:24:08.663222+0000","last_became_active":"2024-07-24T16:24:02.424131+0000","last_became_peered":"2024-07-24T16:24:02.424131+0000","last_unstale":"2024-07-24T16:24:08.663222+0000","last_undegraded":"2024-07-24T16:24:08.663222+0000","last_fullsized":"2024-07-24T16:24:08.663222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:11:26.148830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759757+0000","last_change":"2024-07-24T16:24:03.405739+0000","last_active":"2024-07-24T16:24:08.759757+0000","last_peered":"2024-07-24T16:24:08.759757+0000","last_clean":"2024-07-24T16:24:08.759757+0000","last_became_active":"2024-07-24T16:24:03.405465+0000","last_became_peered":"2024-07-24T16:24:03.405465+0000","last_unstale":"2024-07-24T16:24:08.759757+0000","last_undegraded":"2024-07-24T16:24:08.759757+0000","last_fullsized":"2024-07-24T16:24:08.759757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:17.143178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663324+0000","last_change":"2024-07-24T16:24:07.451902+0000","last_active":"2024-07-24T16:24:08.663324+0000","last_peered":"2024-07-24T16:24:08.663324+0000","last_clean":"2024-07-24T16:24:08.663324+0000","last_became_active":"2024-07-24T16:24:07.451243+0000","last_became_peered":"2024-07-24T16:24:07.451243+0000","last_unstale":"2024-07-24T16:24:08.663324+0000","last_undegraded":"2024-07-24T16:24:08.663324+0000","last_fullsized":"2024-07-24T16:24:08.663324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:32:02.239427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930768+0000","last_change":"2024-07-24T16:24:03.426344+0000","last_active":"2024-07-24T16:24:08.930768+0000","last_peered":"2024-07-24T16:24:08.930768+0000","last_clean":"2024-07-24T16:24:08.930768+0000","last_became_active":"2024-07-24T16:24:03.426064+0000","last_became_peered":"2024-07-24T16:24:03.426064+0000","last_unstale":"2024-07-24T16:24:08.930768+0000","last_undegraded":"2024-07-24T16:24:08.930768+0000","last_fullsized":"2024-07-24T16:24:08.930768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:17:16.704958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.439822+0000","last_change":"2024-07-24T16:24:03.414954+0000","last_active":"2024-07-24T16:24:08.439822+0000","last_peered":"2024-07-24T16:24:08.439822+0000","last_clean":"2024-07-24T16:24:08.439822+0000","last_became_active":"2024-07-24T16:24:03.414684+0000","last_became_peered":"2024-07-24T16:24:03.414684+0000","last_unstale":"2024-07-24T16:24:08.439822+0000","last_undegraded":"2024-07-24T16:24:08.439822+0000","last_fullsized":"2024-07-24T16:24:08.439822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:17.143178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441834+0000","last_change":"2024-07-24T16:24:03.420882+0000","last_active":"2024-07-24T16:24:08.441834+0000","last_peered":"2024-07-24T16:24:08.441834+0000","last_clean":"2024-07-24T16:24:08.441834+0000","last_became_active":"2024-07-24T16:24:03.420555+0000","last_became_peered":"2024-07-24T16:24:03.420555+0000","last_unstale":"2024-07-24T16:24:08.441834+0000","last_undegraded":"2024-07-24T16:24:08.441834+0000","last_fullsized":"2024-07-24T16:24:08.441834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:37.250366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441536+0000","last_change":"2024-07-24T16:24:03.419648+0000","last_active":"2024-07-24T16:24:08.441536+0000","last_peered":"2024-07-24T16:24:08.441536+0000","last_clean":"2024-07-24T16:24:08.441536+0000","last_became_active":"2024-07-24T16:24:03.419390+0000","last_became_peered":"2024-07-24T16:24:03.419390+0000","last_unstale":"2024-07-24T16:24:08.441536+0000","last_undegraded":"2024-07-24T16:24:08.441536+0000","last_fullsized":"2024-07-24T16:24:08.441536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663423+0000","last_change":"2024-07-24T16:24:03.420527+0000","last_active":"2024-07-24T16:24:08.663423+0000","last_peered":"2024-07-24T16:24:08.663423+0000","last_clean":"2024-07-24T16:24:08.663423+0000","last_became_active":"2024-07-24T16:24:03.419368+0000","last_became_peered":"2024-07-24T16:24:03.419368+0000","last_unstale":"2024-07-24T16:24:08.663423+0000","last_undegraded":"2024-07-24T16:24:08.663423+0000","last_fullsized":"2024-07-24T16:24:08.663423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:25.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930580+0000","last_change":"2024-07-24T16:24:03.416673+0000","last_active":"2024-07-24T16:24:08.930580+0000","last_peered":"2024-07-24T16:24:08.930580+0000","last_clean":"2024-07-24T16:24:08.930580+0000","last_became_active":"2024-07-24T16:24:03.416375+0000","last_became_peered":"2024-07-24T16:24:03.416375+0000","last_unstale":"2024-07-24T16:24:08.930580+0000","last_undegraded":"2024-07-24T16:24:08.930580+0000","last_fullsized":"2024-07-24T16:24:08.930580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931645+0000","last_change":"2024-07-24T16:24:03.424087+0000","last_active":"2024-07-24T16:24:08.931645+0000","last_peered":"2024-07-24T16:24:08.931645+0000","last_clean":"2024-07-24T16:24:08.931645+0000","last_became_active":"2024-07-24T16:24:03.423409+0000","last_became_peered":"2024-07-24T16:24:03.423409+0000","last_unstale":"2024-07-24T16:24:08.931645+0000","last_undegraded":"2024-07-24T16:24:08.931645+0000","last_fullsized":"2024-07-24T16:24:08.931645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663596+0000","last_change":"2024-07-24T16:24:03.418712+0000","last_active":"2024-07-24T16:24:08.663596+0000","last_peered":"2024-07-24T16:24:08.663596+0000","last_clean":"2024-07-24T16:24:08.663596+0000","last_became_active":"2024-07-24T16:24:03.418419+0000","last_became_peered":"2024-07-24T16:24:03.418419+0000","last_unstale":"2024-07-24T16:24:08.663596+0000","last_undegraded":"2024-07-24T16:24:08.663596+0000","last_fullsized":"2024-07-24T16:24:08.663596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441633+0000","last_change":"2024-07-24T16:24:03.418720+0000","last_active":"2024-07-24T16:24:08.441633+0000","last_peered":"2024-07-24T16:24:08.441633+0000","last_clean":"2024-07-24T16:24:08.441633+0000","last_became_active":"2024-07-24T16:24:03.418318+0000","last_became_peered":"2024-07-24T16:24:03.418318+0000","last_unstale":"2024-07-24T16:24:08.441633+0000","last_undegraded":"2024-07-24T16:24:08.441633+0000","last_fullsized":"2024-07-24T16:24:08.441633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:11.929285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662844+0000","last_change":"2024-07-24T16:24:03.418662+0000","last_active":"2024-07-24T16:24:08.662844+0000","last_peered":"2024-07-24T16:24:08.662844+0000","last_clean":"2024-07-24T16:24:08.662844+0000","last_became_active":"2024-07-24T16:24:03.418378+0000","last_became_peered":"2024-07-24T16:24:03.418378+0000","last_unstale":"2024-07-24T16:24:08.662844+0000","last_undegraded":"2024-07-24T16:24:08.662844+0000","last_fullsized":"2024-07-24T16:24:08.662844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441710+0000","last_change":"2024-07-24T16:24:03.418038+0000","last_active":"2024-07-24T16:24:08.441710+0000","last_peered":"2024-07-24T16:24:08.441710+0000","last_clean":"2024-07-24T16:24:08.441710+0000","last_became_active":"2024-07-24T16:24:03.417007+0000","last_became_peered":"2024-07-24T16:24:03.417007+0000","last_unstale":"2024-07-24T16:24:08.441710+0000","last_undegraded":"2024-07-24T16:24:08.441710+0000","last_fullsized":"2024-07-24T16:24:08.441710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:42.549780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441338+0000","last_change":"2024-07-24T16:24:03.431911+0000","last_active":"2024-07-24T16:24:08.441338+0000","last_peered":"2024-07-24T16:24:08.441338+0000","last_clean":"2024-07-24T16:24:08.441338+0000","last_became_active":"2024-07-24T16:24:03.431609+0000","last_became_peered":"2024-07-24T16:24:03.431609+0000","last_unstale":"2024-07-24T16:24:08.441338+0000","last_undegraded":"2024-07-24T16:24:08.441338+0000","last_fullsized":"2024-07-24T16:24:08.441338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:48:51.593685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931556+0000","last_change":"2024-07-24T16:24:03.421743+0000","last_active":"2024-07-24T16:24:08.931556+0000","last_peered":"2024-07-24T16:24:08.931556+0000","last_clean":"2024-07-24T16:24:08.931556+0000","last_became_active":"2024-07-24T16:24:03.419448+0000","last_became_peered":"2024-07-24T16:24:03.419448+0000","last_unstale":"2024-07-24T16:24:08.931556+0000","last_undegraded":"2024-07-24T16:24:08.931556+0000","last_fullsized":"2024-07-24T16:24:08.931556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932230+0000","last_change":"2024-07-24T16:24:03.426083+0000","last_active":"2024-07-24T16:24:08.932230+0000","last_peered":"2024-07-24T16:24:08.932230+0000","last_clean":"2024-07-24T16:24:08.932230+0000","last_became_active":"2024-07-24T16:24:03.425305+0000","last_became_peered":"2024-07-24T16:24:03.425305+0000","last_unstale":"2024-07-24T16:24:08.932230+0000","last_undegraded":"2024-07-24T16:24:08.932230+0000","last_fullsized":"2024-07-24T16:24:08.932230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:37.250366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440125+0000","last_change":"2024-07-24T16:24:03.414343+0000","last_active":"2024-07-24T16:24:08.440125+0000","last_peered":"2024-07-24T16:24:08.440125+0000","last_clean":"2024-07-24T16:24:08.440125+0000","last_became_active":"2024-07-24T16:24:03.414057+0000","last_became_peered":"2024-07-24T16:24:03.414057+0000","last_unstale":"2024-07-24T16:24:08.440125+0000","last_undegraded":"2024-07-24T16:24:08.440125+0000","last_fullsized":"2024-07-24T16:24:08.440125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:45:49.295282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442181+0000","last_change":"2024-07-24T16:24:03.420932+0000","last_active":"2024-07-24T16:24:08.442181+0000","last_peered":"2024-07-24T16:24:08.442181+0000","last_clean":"2024-07-24T16:24:08.442181+0000","last_became_active":"2024-07-24T16:24:03.420642+0000","last_became_peered":"2024-07-24T16:24:03.420642+0000","last_unstale":"2024-07-24T16:24:08.442181+0000","last_undegraded":"2024-07-24T16:24:08.442181+0000","last_fullsized":"2024-07-24T16:24:08.442181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441303+0000","last_change":"2024-07-24T16:24:03.425237+0000","last_active":"2024-07-24T16:24:08.441303+0000","last_peered":"2024-07-24T16:24:08.441303+0000","last_clean":"2024-07-24T16:24:08.441303+0000","last_became_active":"2024-07-24T16:24:03.424915+0000","last_became_peered":"2024-07-24T16:24:03.424915+0000","last_unstale":"2024-07-24T16:24:08.441303+0000","last_undegraded":"2024-07-24T16:24:08.441303+0000","last_fullsized":"2024-07-24T16:24:08.441303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930172+0000","last_change":"2024-07-24T16:24:03.404488+0000","last_active":"2024-07-24T16:24:08.930172+0000","last_peered":"2024-07-24T16:24:08.930172+0000","last_clean":"2024-07-24T16:24:08.930172+0000","last_became_active":"2024-07-24T16:24:03.404145+0000","last_became_peered":"2024-07-24T16:24:03.404145+0000","last_unstale":"2024-07-24T16:24:08.930172+0000","last_undegraded":"2024-07-24T16:24:08.930172+0000","last_fullsized":"2024-07-24T16:24:08.930172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441452+0000","last_change":"2024-07-24T16:24:03.421865+0000","last_active":"2024-07-24T16:24:08.441452+0000","last_peered":"2024-07-24T16:24:08.441452+0000","last_clean":"2024-07-24T16:24:08.441452+0000","last_became_active":"2024-07-24T16:24:03.421569+0000","last_became_peered":"2024-07-24T16:24:03.421569+0000","last_unstale":"2024-07-24T16:24:08.441452+0000","last_undegraded":"2024-07-24T16:24:08.441452+0000","last_fullsized":"2024-07-24T16:24:08.441452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663120+0000","last_change":"2024-07-24T16:24:03.414078+0000","last_active":"2024-07-24T16:24:08.663120+0000","last_peered":"2024-07-24T16:24:08.663120+0000","last_clean":"2024-07-24T16:24:08.663120+0000","last_became_active":"2024-07-24T16:24:03.413790+0000","last_became_peered":"2024-07-24T16:24:03.413790+0000","last_unstale":"2024-07-24T16:24:08.663120+0000","last_undegraded":"2024-07-24T16:24:08.663120+0000","last_fullsized":"2024-07-24T16:24:08.663120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:05.808945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760147+0000","last_change":"2024-07-24T16:24:03.415097+0000","last_active":"2024-07-24T16:24:08.760147+0000","last_peered":"2024-07-24T16:24:08.760147+0000","last_clean":"2024-07-24T16:24:08.760147+0000","last_became_active":"2024-07-24T16:24:03.413714+0000","last_became_peered":"2024-07-24T16:24:03.413714+0000","last_unstale":"2024-07-24T16:24:08.760147+0000","last_undegraded":"2024-07-24T16:24:08.760147+0000","last_fullsized":"2024-07-24T16:24:08.760147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:35:31.460220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931494+0000","last_change":"2024-07-24T16:24:03.414407+0000","last_active":"2024-07-24T16:24:08.931494+0000","last_peered":"2024-07-24T16:24:08.931494+0000","last_clean":"2024-07-24T16:24:08.931494+0000","last_became_active":"2024-07-24T16:24:03.414130+0000","last_became_peered":"2024-07-24T16:24:03.414130+0000","last_unstale":"2024-07-24T16:24:08.931494+0000","last_undegraded":"2024-07-24T16:24:08.931494+0000","last_fullsized":"2024-07-24T16:24:08.931494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931527+0000","last_change":"2024-07-24T16:24:03.423751+0000","last_active":"2024-07-24T16:24:08.931527+0000","last_peered":"2024-07-24T16:24:08.931527+0000","last_clean":"2024-07-24T16:24:08.931527+0000","last_became_active":"2024-07-24T16:24:03.423474+0000","last_became_peered":"2024-07-24T16:24:03.423474+0000","last_unstale":"2024-07-24T16:24:08.931527+0000","last_undegraded":"2024-07-24T16:24:08.931527+0000","last_fullsized":"2024-07-24T16:24:08.931527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932077+0000","last_change":"2024-07-24T16:24:03.427935+0000","last_active":"2024-07-24T16:24:08.932077+0000","last_peered":"2024-07-24T16:24:08.932077+0000","last_clean":"2024-07-24T16:24:08.932077+0000","last_became_active":"2024-07-24T16:24:03.427533+0000","last_became_peered":"2024-07-24T16:24:03.427533+0000","last_unstale":"2024-07-24T16:24:08.932077+0000","last_undegraded":"2024-07-24T16:24:08.932077+0000","last_fullsized":"2024-07-24T16:24:08.932077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:37.605337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662710+0000","last_change":"2024-07-24T16:24:03.426562+0000","last_active":"2024-07-24T16:24:08.662710+0000","last_peered":"2024-07-24T16:24:08.662710+0000","last_clean":"2024-07-24T16:24:08.662710+0000","last_became_active":"2024-07-24T16:24:03.426289+0000","last_became_peered":"2024-07-24T16:24:03.426289+0000","last_unstale":"2024-07-24T16:24:08.662710+0000","last_undegraded":"2024-07-24T16:24:08.662710+0000","last_fullsized":"2024-07-24T16:24:08.662710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930924+0000","last_change":"2024-07-24T16:24:03.425133+0000","last_active":"2024-07-24T16:24:08.930924+0000","last_peered":"2024-07-24T16:24:08.930924+0000","last_clean":"2024-07-24T16:24:08.930924+0000","last_became_active":"2024-07-24T16:24:03.424694+0000","last_became_peered":"2024-07-24T16:24:03.424694+0000","last_unstale":"2024-07-24T16:24:08.930924+0000","last_undegraded":"2024-07-24T16:24:08.930924+0000","last_fullsized":"2024-07-24T16:24:08.930924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:05.808945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441560+0000","last_change":"2024-07-24T16:24:03.424756+0000","last_active":"2024-07-24T16:24:08.441560+0000","last_peered":"2024-07-24T16:24:08.441560+0000","last_clean":"2024-07-24T16:24:08.441560+0000","last_became_active":"2024-07-24T16:24:03.424496+0000","last_became_peered":"2024-07-24T16:24:03.424496+0000","last_unstale":"2024-07-24T16:24:08.441560+0000","last_undegraded":"2024-07-24T16:24:08.441560+0000","last_fullsized":"2024-07-24T16:24:08.441560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:25.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931259+0000","last_change":"2024-07-24T16:24:03.424754+0000","last_active":"2024-07-24T16:24:08.931259+0000","last_peered":"2024-07-24T16:24:08.931259+0000","last_clean":"2024-07-24T16:24:08.931259+0000","last_became_active":"2024-07-24T16:24:03.421220+0000","last_became_peered":"2024-07-24T16:24:03.421220+0000","last_unstale":"2024-07-24T16:24:08.931259+0000","last_undegraded":"2024-07-24T16:24:08.931259+0000","last_fullsized":"2024-07-24T16:24:08.931259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:01.499631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441829+0000","last_change":"2024-07-24T16:24:03.419695+0000","last_active":"2024-07-24T16:24:08.441829+0000","last_peered":"2024-07-24T16:24:08.441829+0000","last_clean":"2024-07-24T16:24:08.441829+0000","last_became_active":"2024-07-24T16:24:03.416727+0000","last_became_peered":"2024-07-24T16:24:03.416727+0000","last_unstale":"2024-07-24T16:24:08.441829+0000","last_undegraded":"2024-07-24T16:24:08.441829+0000","last_fullsized":"2024-07-24T16:24:08.441829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:33:56.923986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441260+0000","last_change":"2024-07-24T16:24:03.422051+0000","last_active":"2024-07-24T16:24:08.441260+0000","last_peered":"2024-07-24T16:24:08.441260+0000","last_clean":"2024-07-24T16:24:08.441260+0000","last_became_active":"2024-07-24T16:24:03.421771+0000","last_became_peered":"2024-07-24T16:24:03.421771+0000","last_unstale":"2024-07-24T16:24:08.441260+0000","last_undegraded":"2024-07-24T16:24:08.441260+0000","last_fullsized":"2024-07-24T16:24:08.441260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:07:14.015059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930778+0000","last_change":"2024-07-24T16:24:03.419502+0000","last_active":"2024-07-24T16:24:08.930778+0000","last_peered":"2024-07-24T16:24:08.930778+0000","last_clean":"2024-07-24T16:24:08.930778+0000","last_became_active":"2024-07-24T16:24:03.419206+0000","last_became_peered":"2024-07-24T16:24:03.419206+0000","last_unstale":"2024-07-24T16:24:08.930778+0000","last_undegraded":"2024-07-24T16:24:08.930778+0000","last_fullsized":"2024-07-24T16:24:08.930778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931978+0000","last_change":"2024-07-24T16:24:03.419857+0000","last_active":"2024-07-24T16:24:08.931978+0000","last_peered":"2024-07-24T16:24:08.931978+0000","last_clean":"2024-07-24T16:24:08.931978+0000","last_became_active":"2024-07-24T16:24:03.419599+0000","last_became_peered":"2024-07-24T16:24:03.419599+0000","last_unstale":"2024-07-24T16:24:08.931978+0000","last_undegraded":"2024-07-24T16:24:08.931978+0000","last_fullsized":"2024-07-24T16:24:08.931978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:42.549780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:24:23.488 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:24:23.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.625+0000 7ff85aec6640 1 -- 172.21.15.159:0/394137471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff83c003a30 msgr2=0x7ff83c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.625+0000 7ff85aec6640 1 --2- 172.21.15.159:0/394137471 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff83c003a30 0x7ff83c003e50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff84400bb20 tx=0x7ff83c005830 comp rx=0 tx=0).stop 2024-07-24T16:24:23.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.625+0000 7ff859463640 1 -- 172.21.15.159:0/394137471 reap_dead start 2024-07-24T16:24:23.628 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.625+0000 7ff85aec6640 1 -- 172.21.15.159:0/394137471 shutdown_connections 2024-07-24T16:24:23.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.625+0000 7ff85aec6640 1 -- 172.21.15.159:0/394137471 >> 172.21.15.159:0/394137471 conn(0x7ff8540b5780 msgr2=0x7ff8540b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:23.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.625+0000 7ff85aec6640 1 -- 172.21.15.159:0/394137471 shutdown_connections 2024-07-24T16:24:23.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.625+0000 7ff85aec6640 1 -- 172.21.15.159:0/394137471 wait complete. 2024-07-24T16:24:23.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.627+0000 7ff85aec6640 1 Processor -- start 2024-07-24T16:24:23.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.627+0000 7ff85aec6640 1 -- start start 2024-07-24T16:24:23.631 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff85aec6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff83c003a30 0x7ff85415eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:23.631 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff85aec6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8540cb1d0 0x7ff8541f4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:23.631 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff85aec6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff854160ac0 0x7ff8541f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:23.631 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff85aec6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff8540d30f0 con 0x7ff854160ac0 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff85aec6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff8540d2f70 con 0x7ff8540cb1d0 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff85aec6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff8540d3270 con 0x7ff83c003a30 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff859463640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff854160ac0 0x7ff8541f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff859463640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff854160ac0 0x7ff8541f4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59688/0 (socket says 172.21.15.159:59688) 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff859463640 1 -- 172.21.15.159:0/2982179489 learned_addr learned my addr 172.21.15.159:0/2982179489 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff858c62640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff83c003a30 0x7ff85415eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff853fff640 1 --2- 172.21.15.159:0/2982179489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8540cb1d0 0x7ff8541f4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff859463640 1 -- 172.21.15.159:0/2982179489 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff83c003a30 msgr2=0x7ff85415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff859463640 1 --2- 172.21.15.159:0/2982179489 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff83c003a30 0x7ff85415eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff859463640 1 -- 172.21.15.159:0/2982179489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8540cb1d0 msgr2=0x7ff8541f4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff859463640 1 --2- 172.21.15.159:0/2982179489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8540cb1d0 0x7ff8541f4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff859463640 1 -- 172.21.15.159:0/2982179489 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8541f50d0 con 0x7ff854160ac0 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff859463640 1 --2- 172.21.15.159:0/2982179489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff854160ac0 0x7ff8541f4ab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff85406a670 tx=0x7ff84c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:23.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff8517fa640 1 -- 172.21.15.159:0/2982179489 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c015020 con 0x7ff854160ac0 2024-07-24T16:24:23.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff8517fa640 1 -- 172.21.15.159:0/2982179489 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff84c011960 con 0x7ff854160ac0 2024-07-24T16:24:23.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff8517fa640 1 -- 172.21.15.159:0/2982179489 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84c011db0 con 0x7ff854160ac0 2024-07-24T16:24:23.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.628+0000 7ff85aec6640 1 -- 172.21.15.159:0/2982179489 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8540c85e0 con 0x7ff854160ac0 2024-07-24T16:24:23.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.629+0000 7ff85aec6640 1 -- 172.21.15.159:0/2982179489 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8540c8ba0 con 0x7ff854160ac0 2024-07-24T16:24:23.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.630+0000 7ff85aec6640 1 -- 172.21.15.159:0/2982179489 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8540c8da0 con 0x7ff854160ac0 2024-07-24T16:24:23.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.630+0000 7ff8517fa640 1 -- 172.21.15.159:0/2982179489 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff84c018020 con 0x7ff854160ac0 2024-07-24T16:24:23.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.630+0000 7ff8517fa640 1 --2- 172.21.15.159:0/2982179489 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff840077010 0x7ff8400794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:23.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.631+0000 7ff8517fa640 1 -- 172.21.15.159:0/2982179489 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff84c099400 con 0x7ff854160ac0 2024-07-24T16:24:23.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.631+0000 7ff858c62640 1 --2- 172.21.15.159:0/2982179489 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff840077010 0x7ff8400794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:23.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.631+0000 7ff858c62640 1 --2- 172.21.15.159:0/2982179489 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff840077010 0x7ff8400794d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff844036000 tx=0x7ff84403c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:23.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.635+0000 7ff8517fa640 1 -- 172.21.15.159:0/2982179489 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7ff8540c8da0 con 0x7ff854160ac0 2024-07-24T16:24:23.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.820+0000 7ff85aec6640 1 -- 172.21.15.159:0/2982179489 --> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff85406d3a0 con 0x7ff840077010 2024-07-24T16:24:23.829 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.827+0000 7ff8517fa640 1 -- 172.21.15.159:0/2982179489 <== mgr.4103 v2:172.21.15.193:6832/222319347 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332520 (secure 0 0 0) 0x7ff844099300 con 0x7ff840077010 2024-07-24T16:24:23.832 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:23.834 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:24:23.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.830+0000 7ff85aec6640 1 -- 172.21.15.159:0/2982179489 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff840077010 msgr2=0x7ff8400794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.830+0000 7ff85aec6640 1 --2- 172.21.15.159:0/2982179489 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff840077010 0x7ff8400794d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff844036000 tx=0x7ff84403c040 comp rx=0 tx=0).stop 2024-07-24T16:24:23.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.830+0000 7ff85aec6640 1 -- 172.21.15.159:0/2982179489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff854160ac0 msgr2=0x7ff8541f4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.830+0000 7ff85aec6640 1 --2- 172.21.15.159:0/2982179489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff854160ac0 0x7ff8541f4ab0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7ff85406a670 tx=0x7ff84c0019b0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.830+0000 7ff85aec6640 1 -- 172.21.15.159:0/2982179489 shutdown_connections 2024-07-24T16:24:23.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.830+0000 7ff85aec6640 1 --2- 172.21.15.159:0/2982179489 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff840077010 0x7ff8400794d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.830+0000 7ff85aec6640 1 --2- 172.21.15.159:0/2982179489 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff854160ac0 0x7ff8541f4ab0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.830+0000 7ff85aec6640 1 --2- 172.21.15.159:0/2982179489 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff8540cb1d0 0x7ff8541f4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.830+0000 7ff85aec6640 1 --2- 172.21.15.159:0/2982179489 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff83c003a30 0x7ff85415eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.830+0000 7ff85aec6640 1 -- 172.21.15.159:0/2982179489 >> 172.21.15.159:0/2982179489 conn(0x7ff8540b5780 msgr2=0x7ff8540b8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:23.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.831+0000 7ff85aec6640 1 -- 172.21.15.159:0/2982179489 shutdown_connections 2024-07-24T16:24:23.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.831+0000 7ff85aec6640 1 -- 172.21.15.159:0/2982179489 wait complete. 2024-07-24T16:24:23.844 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2024-07-24T16:24:22.366093+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1988976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003497"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441633+0000","last_change":"2024-07-24T16:24:02.424537+0000","last_active":"2024-07-24T16:24:08.441633+0000","last_peered":"2024-07-24T16:24:08.441633+0000","last_clean":"2024-07-24T16:24:08.441633+0000","last_became_active":"2024-07-24T16:24:02.424271+0000","last_became_peered":"2024-07-24T16:24:02.424271+0000","last_unstale":"2024-07-24T16:24:08.441633+0000","last_undegraded":"2024-07-24T16:24:08.441633+0000","last_fullsized":"2024-07-24T16:24:08.441633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:39:09.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663338+0000","last_change":"2024-07-24T16:24:03.415815+0000","last_active":"2024-07-24T16:24:08.663338+0000","last_peered":"2024-07-24T16:24:08.663338+0000","last_clean":"2024-07-24T16:24:08.663338+0000","last_became_active":"2024-07-24T16:24:03.415526+0000","last_became_peered":"2024-07-24T16:24:03.415526+0000","last_unstale":"2024-07-24T16:24:08.663338+0000","last_undegraded":"2024-07-24T16:24:08.663338+0000","last_fullsized":"2024-07-24T16:24:08.663338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662707+0000","last_change":"2024-07-24T16:24:07.690761+0000","last_active":"2024-07-24T16:24:08.662707+0000","last_peered":"2024-07-24T16:24:08.662707+0000","last_clean":"2024-07-24T16:24:08.662707+0000","last_became_active":"2024-07-24T16:24:07.690360+0000","last_became_peered":"2024-07-24T16:24:07.690360+0000","last_unstale":"2024-07-24T16:24:08.662707+0000","last_undegraded":"2024-07-24T16:24:08.662707+0000","last_fullsized":"2024-07-24T16:24:08.662707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:20:33.168439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663491+0000","last_change":"2024-07-24T16:24:02.417793+0000","last_active":"2024-07-24T16:24:08.663491+0000","last_peered":"2024-07-24T16:24:08.663491+0000","last_clean":"2024-07-24T16:24:08.663491+0000","last_became_active":"2024-07-24T16:24:02.417520+0000","last_became_peered":"2024-07-24T16:24:02.417520+0000","last_unstale":"2024-07-24T16:24:08.663491+0000","last_undegraded":"2024-07-24T16:24:08.663491+0000","last_fullsized":"2024-07-24T16:24:08.663491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:39:09.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441465+0000","last_change":"2024-07-24T16:24:03.431760+0000","last_active":"2024-07-24T16:24:08.441465+0000","last_peered":"2024-07-24T16:24:08.441465+0000","last_clean":"2024-07-24T16:24:08.441465+0000","last_became_active":"2024-07-24T16:24:03.431479+0000","last_became_peered":"2024-07-24T16:24:03.431479+0000","last_unstale":"2024-07-24T16:24:08.441465+0000","last_undegraded":"2024-07-24T16:24:08.441465+0000","last_fullsized":"2024-07-24T16:24:08.441465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:30:43.693386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759610+0000","last_change":"2024-07-24T16:24:07.447841+0000","last_active":"2024-07-24T16:24:08.759610+0000","last_peered":"2024-07-24T16:24:08.759610+0000","last_clean":"2024-07-24T16:24:08.759610+0000","last_became_active":"2024-07-24T16:24:07.446215+0000","last_became_peered":"2024-07-24T16:24:07.446215+0000","last_unstale":"2024-07-24T16:24:08.759610+0000","last_undegraded":"2024-07-24T16:24:08.759610+0000","last_fullsized":"2024-07-24T16:24:08.759610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:09.837609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932112+0000","last_change":"2024-07-24T16:24:02.427356+0000","last_active":"2024-07-24T16:24:08.932112+0000","last_peered":"2024-07-24T16:24:08.932112+0000","last_clean":"2024-07-24T16:24:08.932112+0000","last_became_active":"2024-07-24T16:24:02.426961+0000","last_became_peered":"2024-07-24T16:24:02.426961+0000","last_unstale":"2024-07-24T16:24:08.932112+0000","last_undegraded":"2024-07-24T16:24:08.932112+0000","last_fullsized":"2024-07-24T16:24:08.932112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:45:48.251916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441858+0000","last_change":"2024-07-24T16:24:03.410957+0000","last_active":"2024-07-24T16:24:08.441858+0000","last_peered":"2024-07-24T16:24:08.441858+0000","last_clean":"2024-07-24T16:24:08.441858+0000","last_became_active":"2024-07-24T16:24:03.410678+0000","last_became_peered":"2024-07-24T16:24:03.410678+0000","last_unstale":"2024-07-24T16:24:08.441858+0000","last_undegraded":"2024-07-24T16:24:08.441858+0000","last_fullsized":"2024-07-24T16:24:08.441858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:32:56.003382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759927+0000","last_change":"2024-07-24T16:24:07.447764+0000","last_active":"2024-07-24T16:24:08.759927+0000","last_peered":"2024-07-24T16:24:08.759927+0000","last_clean":"2024-07-24T16:24:08.759927+0000","last_became_active":"2024-07-24T16:24:07.446150+0000","last_became_peered":"2024-07-24T16:24:07.446150+0000","last_unstale":"2024-07-24T16:24:08.759927+0000","last_undegraded":"2024-07-24T16:24:08.759927+0000","last_fullsized":"2024-07-24T16:24:08.759927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:29.138058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931831+0000","last_change":"2024-07-24T16:24:02.427694+0000","last_active":"2024-07-24T16:24:08.931831+0000","last_peered":"2024-07-24T16:24:08.931831+0000","last_clean":"2024-07-24T16:24:08.931831+0000","last_became_active":"2024-07-24T16:24:02.427418+0000","last_became_peered":"2024-07-24T16:24:02.427418+0000","last_unstale":"2024-07-24T16:24:08.931831+0000","last_undegraded":"2024-07-24T16:24:08.931831+0000","last_fullsized":"2024-07-24T16:24:08.931831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:35:30.416854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442157+0000","last_change":"2024-07-24T16:24:03.411299+0000","last_active":"2024-07-24T16:24:08.442157+0000","last_peered":"2024-07-24T16:24:08.442157+0000","last_clean":"2024-07-24T16:24:08.442157+0000","last_became_active":"2024-07-24T16:24:03.410332+0000","last_became_peered":"2024-07-24T16:24:03.410332+0000","last_unstale":"2024-07-24T16:24:08.442157+0000","last_undegraded":"2024-07-24T16:24:08.442157+0000","last_fullsized":"2024-07-24T16:24:08.442157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:05.808945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759607+0000","last_change":"2024-07-24T16:24:07.449263+0000","last_active":"2024-07-24T16:24:08.759607+0000","last_peered":"2024-07-24T16:24:08.759607+0000","last_clean":"2024-07-24T16:24:08.759607+0000","last_became_active":"2024-07-24T16:24:07.448686+0000","last_became_peered":"2024-07-24T16:24:07.448686+0000","last_unstale":"2024-07-24T16:24:08.759607+0000","last_undegraded":"2024-07-24T16:24:08.759607+0000","last_fullsized":"2024-07-24T16:24:08.759607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:05.528295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931074+0000","last_change":"2024-07-24T16:24:03.420544+0000","last_active":"2024-07-24T16:24:08.931074+0000","last_peered":"2024-07-24T16:24:08.931074+0000","last_clean":"2024-07-24T16:24:08.931074+0000","last_became_active":"2024-07-24T16:24:03.419248+0000","last_became_peered":"2024-07-24T16:24:03.419248+0000","last_unstale":"2024-07-24T16:24:08.931074+0000","last_undegraded":"2024-07-24T16:24:08.931074+0000","last_fullsized":"2024-07-24T16:24:08.931074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931758+0000","last_change":"2024-07-24T16:24:02.427241+0000","last_active":"2024-07-24T16:24:08.931758+0000","last_peered":"2024-07-24T16:24:08.931758+0000","last_clean":"2024-07-24T16:24:08.931758+0000","last_became_active":"2024-07-24T16:24:02.426981+0000","last_became_peered":"2024-07-24T16:24:02.426981+0000","last_unstale":"2024-07-24T16:24:08.931758+0000","last_undegraded":"2024-07-24T16:24:08.931758+0000","last_fullsized":"2024-07-24T16:24:08.931758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760170+0000","last_change":"2024-07-24T16:24:07.453666+0000","last_active":"2024-07-24T16:24:08.760170+0000","last_peered":"2024-07-24T16:24:08.760170+0000","last_clean":"2024-07-24T16:24:08.760170+0000","last_became_active":"2024-07-24T16:24:07.453136+0000","last_became_peered":"2024-07-24T16:24:07.453136+0000","last_unstale":"2024-07-24T16:24:08.760170+0000","last_undegraded":"2024-07-24T16:24:08.760170+0000","last_fullsized":"2024-07-24T16:24:08.760170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:25.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663125+0000","last_change":"2024-07-24T16:24:03.419598+0000","last_active":"2024-07-24T16:24:08.663125+0000","last_peered":"2024-07-24T16:24:08.663125+0000","last_clean":"2024-07-24T16:24:08.663125+0000","last_became_active":"2024-07-24T16:24:03.419148+0000","last_became_peered":"2024-07-24T16:24:03.419148+0000","last_unstale":"2024-07-24T16:24:08.663125+0000","last_undegraded":"2024-07-24T16:24:08.663125+0000","last_fullsized":"2024-07-24T16:24:08.663125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:33:56.923986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930432+0000","last_change":"2024-07-24T16:24:02.412753+0000","last_active":"2024-07-24T16:24:08.930432+0000","last_peered":"2024-07-24T16:24:08.930432+0000","last_clean":"2024-07-24T16:24:08.930432+0000","last_became_active":"2024-07-24T16:24:02.412500+0000","last_became_peered":"2024-07-24T16:24:02.412500+0000","last_unstale":"2024-07-24T16:24:08.930432+0000","last_undegraded":"2024-07-24T16:24:08.930432+0000","last_fullsized":"2024-07-24T16:24:08.930432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759990+0000","last_change":"2024-07-24T16:24:07.447575+0000","last_active":"2024-07-24T16:24:08.759990+0000","last_peered":"2024-07-24T16:24:08.759990+0000","last_clean":"2024-07-24T16:24:08.759990+0000","last_became_active":"2024-07-24T16:24:07.447131+0000","last_became_peered":"2024-07-24T16:24:07.447131+0000","last_unstale":"2024-07-24T16:24:08.759990+0000","last_undegraded":"2024-07-24T16:24:08.759990+0000","last_fullsized":"2024-07-24T16:24:08.759990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:00.032046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662902+0000","last_change":"2024-07-24T16:24:03.414198+0000","last_active":"2024-07-24T16:24:08.662902+0000","last_peered":"2024-07-24T16:24:08.662902+0000","last_clean":"2024-07-24T16:24:08.662902+0000","last_became_active":"2024-07-24T16:24:03.413765+0000","last_became_peered":"2024-07-24T16:24:03.413765+0000","last_unstale":"2024-07-24T16:24:08.662902+0000","last_undegraded":"2024-07-24T16:24:08.662902+0000","last_fullsized":"2024-07-24T16:24:08.662902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:11.929285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930215+0000","last_change":"2024-07-24T16:24:02.424488+0000","last_active":"2024-07-24T16:24:08.930215+0000","last_peered":"2024-07-24T16:24:08.930215+0000","last_clean":"2024-07-24T16:24:08.930215+0000","last_became_active":"2024-07-24T16:24:02.424175+0000","last_became_peered":"2024-07-24T16:24:02.424175+0000","last_unstale":"2024-07-24T16:24:08.930215+0000","last_undegraded":"2024-07-24T16:24:08.930215+0000","last_fullsized":"2024-07-24T16:24:08.930215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930944+0000","last_change":"2024-07-24T16:24:07.689275+0000","last_active":"2024-07-24T16:24:08.930944+0000","last_peered":"2024-07-24T16:24:08.930944+0000","last_clean":"2024-07-24T16:24:08.930944+0000","last_became_active":"2024-07-24T16:24:07.688814+0000","last_became_peered":"2024-07-24T16:24:07.688814+0000","last_unstale":"2024-07-24T16:24:08.930944+0000","last_undegraded":"2024-07-24T16:24:08.930944+0000","last_fullsized":"2024-07-24T16:24:08.930944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:50:06.081975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759861+0000","last_change":"2024-07-24T16:24:03.410501+0000","last_active":"2024-07-24T16:24:08.759861+0000","last_peered":"2024-07-24T16:24:08.759861+0000","last_clean":"2024-07-24T16:24:08.759861+0000","last_became_active":"2024-07-24T16:24:03.410221+0000","last_became_peered":"2024-07-24T16:24:03.410221+0000","last_unstale":"2024-07-24T16:24:08.759861+0000","last_undegraded":"2024-07-24T16:24:08.759861+0000","last_fullsized":"2024-07-24T16:24:08.759861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:07.509173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930886+0000","last_change":"2024-07-24T16:24:02.424500+0000","last_active":"2024-07-24T16:24:08.930886+0000","last_peered":"2024-07-24T16:24:08.930886+0000","last_clean":"2024-07-24T16:24:08.930886+0000","last_became_active":"2024-07-24T16:24:02.423974+0000","last_became_peered":"2024-07-24T16:24:02.423974+0000","last_unstale":"2024-07-24T16:24:08.930886+0000","last_undegraded":"2024-07-24T16:24:08.930886+0000","last_fullsized":"2024-07-24T16:24:08.930886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760199+0000","last_change":"2024-07-24T16:24:07.446830+0000","last_active":"2024-07-24T16:24:08.760199+0000","last_peered":"2024-07-24T16:24:08.760199+0000","last_clean":"2024-07-24T16:24:08.760199+0000","last_became_active":"2024-07-24T16:24:07.446412+0000","last_became_peered":"2024-07-24T16:24:07.446412+0000","last_unstale":"2024-07-24T16:24:08.760199+0000","last_undegraded":"2024-07-24T16:24:08.760199+0000","last_fullsized":"2024-07-24T16:24:08.760199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:46.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441614+0000","last_change":"2024-07-24T16:24:03.418856+0000","last_active":"2024-07-24T16:24:08.441614+0000","last_peered":"2024-07-24T16:24:08.441614+0000","last_clean":"2024-07-24T16:24:08.441614+0000","last_became_active":"2024-07-24T16:24:03.418584+0000","last_became_peered":"2024-07-24T16:24:03.418584+0000","last_unstale":"2024-07-24T16:24:08.441614+0000","last_undegraded":"2024-07-24T16:24:08.441614+0000","last_fullsized":"2024-07-24T16:24:08.441614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931815+0000","last_change":"2024-07-24T16:24:02.424481+0000","last_active":"2024-07-24T16:24:08.931815+0000","last_peered":"2024-07-24T16:24:08.931815+0000","last_clean":"2024-07-24T16:24:08.931815+0000","last_became_active":"2024-07-24T16:24:02.424223+0000","last_became_peered":"2024-07-24T16:24:02.424223+0000","last_unstale":"2024-07-24T16:24:08.931815+0000","last_undegraded":"2024-07-24T16:24:08.931815+0000","last_fullsized":"2024-07-24T16:24:08.931815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759577+0000","last_change":"2024-07-24T16:24:07.689438+0000","last_active":"2024-07-24T16:24:08.759577+0000","last_peered":"2024-07-24T16:24:08.759577+0000","last_clean":"2024-07-24T16:24:08.759577+0000","last_became_active":"2024-07-24T16:24:07.689062+0000","last_became_peered":"2024-07-24T16:24:07.689062+0000","last_unstale":"2024-07-24T16:24:08.759577+0000","last_undegraded":"2024-07-24T16:24:08.759577+0000","last_fullsized":"2024-07-24T16:24:08.759577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:15.957949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663604+0000","last_change":"2024-07-24T16:24:03.420566+0000","last_active":"2024-07-24T16:24:08.663604+0000","last_peered":"2024-07-24T16:24:08.663604+0000","last_clean":"2024-07-24T16:24:08.663604+0000","last_became_active":"2024-07-24T16:24:03.420294+0000","last_became_peered":"2024-07-24T16:24:03.420294+0000","last_unstale":"2024-07-24T16:24:08.663604+0000","last_undegraded":"2024-07-24T16:24:08.663604+0000","last_fullsized":"2024-07-24T16:24:08.663604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:01.499631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930843+0000","last_change":"2024-07-24T16:24:02.417701+0000","last_active":"2024-07-24T16:24:08.930843+0000","last_peered":"2024-07-24T16:24:08.930843+0000","last_clean":"2024-07-24T16:24:08.930843+0000","last_became_active":"2024-07-24T16:24:02.417387+0000","last_became_peered":"2024-07-24T16:24:02.417387+0000","last_unstale":"2024-07-24T16:24:08.930843+0000","last_undegraded":"2024-07-24T16:24:08.930843+0000","last_fullsized":"2024-07-24T16:24:08.930843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662631+0000","last_change":"2024-07-24T16:24:07.692448+0000","last_active":"2024-07-24T16:24:08.662631+0000","last_peered":"2024-07-24T16:24:08.662631+0000","last_clean":"2024-07-24T16:24:08.662631+0000","last_became_active":"2024-07-24T16:24:07.691926+0000","last_became_peered":"2024-07-24T16:24:07.691926+0000","last_unstale":"2024-07-24T16:24:08.662631+0000","last_undegraded":"2024-07-24T16:24:08.662631+0000","last_fullsized":"2024-07-24T16:24:08.662631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:53:01.459934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930611+0000","last_change":"2024-07-24T16:24:03.407657+0000","last_active":"2024-07-24T16:24:08.930611+0000","last_peered":"2024-07-24T16:24:08.930611+0000","last_clean":"2024-07-24T16:24:08.930611+0000","last_became_active":"2024-07-24T16:24:03.407207+0000","last_became_peered":"2024-07-24T16:24:03.407207+0000","last_unstale":"2024-07-24T16:24:08.930611+0000","last_undegraded":"2024-07-24T16:24:08.930611+0000","last_fullsized":"2024-07-24T16:24:08.930611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932275+0000","last_change":"2024-07-24T16:24:02.424314+0000","last_active":"2024-07-24T16:24:08.932275+0000","last_peered":"2024-07-24T16:24:08.932275+0000","last_clean":"2024-07-24T16:24:08.932275+0000","last_became_active":"2024-07-24T16:24:02.424058+0000","last_became_peered":"2024-07-24T16:24:02.424058+0000","last_unstale":"2024-07-24T16:24:08.932275+0000","last_undegraded":"2024-07-24T16:24:08.932275+0000","last_fullsized":"2024-07-24T16:24:08.932275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:56:35.089759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441392+0000","last_change":"2024-07-24T16:24:07.689455+0000","last_active":"2024-07-24T16:24:08.441392+0000","last_peered":"2024-07-24T16:24:08.441392+0000","last_clean":"2024-07-24T16:24:08.441392+0000","last_became_active":"2024-07-24T16:24:07.689096+0000","last_became_peered":"2024-07-24T16:24:07.689096+0000","last_unstale":"2024-07-24T16:24:08.441392+0000","last_undegraded":"2024-07-24T16:24:08.441392+0000","last_fullsized":"2024-07-24T16:24:08.441392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:46.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442272+0000","last_change":"2024-07-24T16:24:03.418605+0000","last_active":"2024-07-24T16:24:08.442272+0000","last_peered":"2024-07-24T16:24:08.442272+0000","last_clean":"2024-07-24T16:24:08.442272+0000","last_became_active":"2024-07-24T16:24:03.417882+0000","last_became_peered":"2024-07-24T16:24:03.417882+0000","last_unstale":"2024-07-24T16:24:08.442272+0000","last_undegraded":"2024-07-24T16:24:08.442272+0000","last_fullsized":"2024-07-24T16:24:08.442272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:01.499631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930686+0000","last_change":"2024-07-24T16:24:02.414441+0000","last_active":"2024-07-24T16:24:08.930686+0000","last_peered":"2024-07-24T16:24:08.930686+0000","last_clean":"2024-07-24T16:24:08.930686+0000","last_became_active":"2024-07-24T16:24:02.414195+0000","last_became_peered":"2024-07-24T16:24:02.414195+0000","last_unstale":"2024-07-24T16:24:08.930686+0000","last_undegraded":"2024-07-24T16:24:08.930686+0000","last_fullsized":"2024-07-24T16:24:08.930686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:11:26.148830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930197+0000","last_change":"2024-07-24T16:24:07.456656+0000","last_active":"2024-07-24T16:24:08.930197+0000","last_peered":"2024-07-24T16:24:08.930197+0000","last_clean":"2024-07-24T16:24:08.930197+0000","last_became_active":"2024-07-24T16:24:07.456253+0000","last_became_peered":"2024-07-24T16:24:07.456253+0000","last_unstale":"2024-07-24T16:24:08.930197+0000","last_undegraded":"2024-07-24T16:24:08.930197+0000","last_fullsized":"2024-07-24T16:24:08.930197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:46.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760097+0000","last_change":"2024-07-24T16:24:03.419761+0000","last_active":"2024-07-24T16:24:08.760097+0000","last_peered":"2024-07-24T16:24:08.760097+0000","last_clean":"2024-07-24T16:24:08.760097+0000","last_became_active":"2024-07-24T16:24:03.419479+0000","last_became_peered":"2024-07-24T16:24:03.419479+0000","last_unstale":"2024-07-24T16:24:08.760097+0000","last_undegraded":"2024-07-24T16:24:08.760097+0000","last_fullsized":"2024-07-24T16:24:08.760097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:45:49.295282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442191+0000","last_change":"2024-07-24T16:24:02.414549+0000","last_active":"2024-07-24T16:24:08.442191+0000","last_peered":"2024-07-24T16:24:08.442191+0000","last_clean":"2024-07-24T16:24:08.442191+0000","last_became_active":"2024-07-24T16:24:02.414271+0000","last_became_peered":"2024-07-24T16:24:02.414271+0000","last_unstale":"2024-07-24T16:24:08.442191+0000","last_undegraded":"2024-07-24T16:24:08.442191+0000","last_fullsized":"2024-07-24T16:24:08.442191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930578+0000","last_change":"2024-07-24T16:24:07.446913+0000","last_active":"2024-07-24T16:24:08.930578+0000","last_peered":"2024-07-24T16:24:08.930578+0000","last_clean":"2024-07-24T16:24:08.930578+0000","last_became_active":"2024-07-24T16:24:07.446002+0000","last_became_peered":"2024-07-24T16:24:07.446002+0000","last_unstale":"2024-07-24T16:24:08.930578+0000","last_undegraded":"2024-07-24T16:24:08.930578+0000","last_fullsized":"2024-07-24T16:24:08.930578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:41.634001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930229+0000","last_change":"2024-07-24T16:24:03.406743+0000","last_active":"2024-07-24T16:24:08.930229+0000","last_peered":"2024-07-24T16:24:08.930229+0000","last_clean":"2024-07-24T16:24:08.930229+0000","last_became_active":"2024-07-24T16:24:03.406481+0000","last_became_peered":"2024-07-24T16:24:03.406481+0000","last_unstale":"2024-07-24T16:24:08.930229+0000","last_undegraded":"2024-07-24T16:24:08.930229+0000","last_fullsized":"2024-07-24T16:24:08.930229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.439757+0000","last_change":"2024-07-24T16:24:02.412920+0000","last_active":"2024-07-24T16:24:08.439757+0000","last_peered":"2024-07-24T16:24:08.439757+0000","last_clean":"2024-07-24T16:24:08.439757+0000","last_became_active":"2024-07-24T16:24:02.412548+0000","last_became_peered":"2024-07-24T16:24:02.412548+0000","last_unstale":"2024-07-24T16:24:08.439757+0000","last_undegraded":"2024-07-24T16:24:08.439757+0000","last_fullsized":"2024-07-24T16:24:08.439757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930950+0000","last_change":"2024-07-24T16:24:07.456001+0000","last_active":"2024-07-24T16:24:08.930950+0000","last_peered":"2024-07-24T16:24:08.930950+0000","last_clean":"2024-07-24T16:24:08.930950+0000","last_became_active":"2024-07-24T16:24:07.455608+0000","last_became_peered":"2024-07-24T16:24:07.455608+0000","last_unstale":"2024-07-24T16:24:08.930950+0000","last_undegraded":"2024-07-24T16:24:08.930950+0000","last_fullsized":"2024-07-24T16:24:08.930950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:48:55.180884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441022+0000","last_change":"2024-07-24T16:24:03.421468+0000","last_active":"2024-07-24T16:24:08.441022+0000","last_peered":"2024-07-24T16:24:08.441022+0000","last_clean":"2024-07-24T16:24:08.441022+0000","last_became_active":"2024-07-24T16:24:03.420885+0000","last_became_peered":"2024-07-24T16:24:03.420885+0000","last_unstale":"2024-07-24T16:24:08.441022+0000","last_undegraded":"2024-07-24T16:24:08.441022+0000","last_fullsized":"2024-07-24T16:24:08.441022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930925+0000","last_change":"2024-07-24T16:24:02.424655+0000","last_active":"2024-07-24T16:24:08.930925+0000","last_peered":"2024-07-24T16:24:08.930925+0000","last_clean":"2024-07-24T16:24:08.930925+0000","last_became_active":"2024-07-24T16:24:02.424258+0000","last_became_peered":"2024-07-24T16:24:02.424258+0000","last_unstale":"2024-07-24T16:24:08.930925+0000","last_undegraded":"2024-07-24T16:24:08.930925+0000","last_fullsized":"2024-07-24T16:24:08.930925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441444+0000","last_change":"2024-07-24T16:24:07.689063+0000","last_active":"2024-07-24T16:24:08.441444+0000","last_peered":"2024-07-24T16:24:08.441444+0000","last_clean":"2024-07-24T16:24:08.441444+0000","last_became_active":"2024-07-24T16:24:07.688668+0000","last_became_peered":"2024-07-24T16:24:07.688668+0000","last_unstale":"2024-07-24T16:24:08.441444+0000","last_undegraded":"2024-07-24T16:24:08.441444+0000","last_fullsized":"2024-07-24T16:24:08.441444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:41.279030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663032+0000","last_change":"2024-07-24T16:24:03.414611+0000","last_active":"2024-07-24T16:24:08.663032+0000","last_peered":"2024-07-24T16:24:08.663032+0000","last_clean":"2024-07-24T16:24:08.663032+0000","last_became_active":"2024-07-24T16:24:03.414234+0000","last_became_peered":"2024-07-24T16:24:03.414234+0000","last_unstale":"2024-07-24T16:24:08.663032+0000","last_undegraded":"2024-07-24T16:24:08.663032+0000","last_fullsized":"2024-07-24T16:24:08.663032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442285+0000","last_change":"2024-07-24T16:24:02.413921+0000","last_active":"2024-07-24T16:24:08.442285+0000","last_peered":"2024-07-24T16:24:08.442285+0000","last_clean":"2024-07-24T16:24:08.442285+0000","last_became_active":"2024-07-24T16:24:02.413460+0000","last_became_peered":"2024-07-24T16:24:02.413460+0000","last_unstale":"2024-07-24T16:24:08.442285+0000","last_undegraded":"2024-07-24T16:24:08.442285+0000","last_fullsized":"2024-07-24T16:24:08.442285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":117,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930636+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:24:08.930636+0000","last_peered":"2024-07-24T16:24:08.930636+0000","last_clean":"2024-07-24T16:24:08.930636+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:24:08.930636+0000","last_undegraded":"2024-07-24T16:24:08.930636+0000","last_fullsized":"2024-07-24T16:24:08.930636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931362+0000","last_change":"2024-07-24T16:24:07.691109+0000","last_active":"2024-07-24T16:24:08.931362+0000","last_peered":"2024-07-24T16:24:08.931362+0000","last_clean":"2024-07-24T16:24:08.931362+0000","last_became_active":"2024-07-24T16:24:07.690690+0000","last_became_peered":"2024-07-24T16:24:07.690690+0000","last_unstale":"2024-07-24T16:24:08.931362+0000","last_undegraded":"2024-07-24T16:24:08.931362+0000","last_fullsized":"2024-07-24T16:24:08.931362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:00.032046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931993+0000","last_change":"2024-07-24T16:24:03.425855+0000","last_active":"2024-07-24T16:24:08.931993+0000","last_peered":"2024-07-24T16:24:08.931993+0000","last_clean":"2024-07-24T16:24:08.931993+0000","last_became_active":"2024-07-24T16:24:03.425039+0000","last_became_peered":"2024-07-24T16:24:03.425039+0000","last_unstale":"2024-07-24T16:24:08.931993+0000","last_undegraded":"2024-07-24T16:24:08.931993+0000","last_fullsized":"2024-07-24T16:24:08.931993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:32:56.003382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440339+0000","last_change":"2024-07-24T16:24:02.419130+0000","last_active":"2024-07-24T16:24:08.440339+0000","last_peered":"2024-07-24T16:24:08.440339+0000","last_clean":"2024-07-24T16:24:08.440339+0000","last_became_active":"2024-07-24T16:24:02.418877+0000","last_became_peered":"2024-07-24T16:24:02.418877+0000","last_unstale":"2024-07-24T16:24:08.440339+0000","last_undegraded":"2024-07-24T16:24:08.440339+0000","last_fullsized":"2024-07-24T16:24:08.440339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:11:26.148830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931126+0000","last_change":"2024-07-24T16:24:07.689387+0000","last_active":"2024-07-24T16:24:08.931126+0000","last_peered":"2024-07-24T16:24:08.931126+0000","last_clean":"2024-07-24T16:24:08.931126+0000","last_became_active":"2024-07-24T16:24:07.688861+0000","last_became_peered":"2024-07-24T16:24:07.688861+0000","last_unstale":"2024-07-24T16:24:08.931126+0000","last_undegraded":"2024-07-24T16:24:08.931126+0000","last_fullsized":"2024-07-24T16:24:08.931126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:29.138058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442010+0000","last_change":"2024-07-24T16:24:03.414560+0000","last_active":"2024-07-24T16:24:08.442010+0000","last_peered":"2024-07-24T16:24:08.442010+0000","last_clean":"2024-07-24T16:24:08.442010+0000","last_became_active":"2024-07-24T16:24:03.414244+0000","last_became_peered":"2024-07-24T16:24:03.414244+0000","last_unstale":"2024-07-24T16:24:08.442010+0000","last_undegraded":"2024-07-24T16:24:08.442010+0000","last_fullsized":"2024-07-24T16:24:08.442010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:21.258885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930741+0000","last_change":"2024-07-24T16:24:02.414255+0000","last_active":"2024-07-24T16:24:08.930741+0000","last_peered":"2024-07-24T16:24:08.930741+0000","last_clean":"2024-07-24T16:24:08.930741+0000","last_became_active":"2024-07-24T16:24:02.413982+0000","last_became_peered":"2024-07-24T16:24:02.413982+0000","last_unstale":"2024-07-24T16:24:08.930741+0000","last_undegraded":"2024-07-24T16:24:08.930741+0000","last_fullsized":"2024-07-24T16:24:08.930741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441533+0000","last_change":"2024-07-24T16:24:07.450463+0000","last_active":"2024-07-24T16:24:08.441533+0000","last_peered":"2024-07-24T16:24:08.441533+0000","last_clean":"2024-07-24T16:24:08.441533+0000","last_became_active":"2024-07-24T16:24:07.449717+0000","last_became_peered":"2024-07-24T16:24:07.449717+0000","last_unstale":"2024-07-24T16:24:08.441533+0000","last_undegraded":"2024-07-24T16:24:08.441533+0000","last_fullsized":"2024-07-24T16:24:08.441533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:41.634001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932150+0000","last_change":"2024-07-24T16:24:03.421244+0000","last_active":"2024-07-24T16:24:08.932150+0000","last_peered":"2024-07-24T16:24:08.932150+0000","last_clean":"2024-07-24T16:24:08.932150+0000","last_became_active":"2024-07-24T16:24:03.420900+0000","last_became_peered":"2024-07-24T16:24:03.420900+0000","last_unstale":"2024-07-24T16:24:08.932150+0000","last_undegraded":"2024-07-24T16:24:08.932150+0000","last_fullsized":"2024-07-24T16:24:08.932150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:48:51.152220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440222+0000","last_change":"2024-07-24T16:24:02.413448+0000","last_active":"2024-07-24T16:24:08.440222+0000","last_peered":"2024-07-24T16:24:08.440222+0000","last_clean":"2024-07-24T16:24:08.440222+0000","last_became_active":"2024-07-24T16:24:02.412569+0000","last_became_peered":"2024-07-24T16:24:02.412569+0000","last_unstale":"2024-07-24T16:24:08.440222+0000","last_undegraded":"2024-07-24T16:24:08.440222+0000","last_fullsized":"2024-07-24T16:24:08.440222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441408+0000","last_change":"2024-07-24T16:24:07.689773+0000","last_active":"2024-07-24T16:24:08.441408+0000","last_peered":"2024-07-24T16:24:08.441408+0000","last_clean":"2024-07-24T16:24:08.441408+0000","last_became_active":"2024-07-24T16:24:07.689367+0000","last_became_peered":"2024-07-24T16:24:07.689367+0000","last_unstale":"2024-07-24T16:24:08.441408+0000","last_undegraded":"2024-07-24T16:24:08.441408+0000","last_fullsized":"2024-07-24T16:24:08.441408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:53:01.459934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932045+0000","last_change":"2024-07-24T16:24:03.420569+0000","last_active":"2024-07-24T16:24:08.932045+0000","last_peered":"2024-07-24T16:24:08.932045+0000","last_clean":"2024-07-24T16:24:08.932045+0000","last_became_active":"2024-07-24T16:24:03.420253+0000","last_became_peered":"2024-07-24T16:24:03.420253+0000","last_unstale":"2024-07-24T16:24:08.932045+0000","last_undegraded":"2024-07-24T16:24:08.932045+0000","last_fullsized":"2024-07-24T16:24:08.932045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:21.258885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760346+0000","last_change":"2024-07-24T16:24:02.417860+0000","last_active":"2024-07-24T16:24:08.760346+0000","last_peered":"2024-07-24T16:24:08.760346+0000","last_clean":"2024-07-24T16:24:08.760346+0000","last_became_active":"2024-07-24T16:24:02.417610+0000","last_became_peered":"2024-07-24T16:24:02.417610+0000","last_unstale":"2024-07-24T16:24:08.760346+0000","last_undegraded":"2024-07-24T16:24:08.760346+0000","last_fullsized":"2024-07-24T16:24:08.760346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:34:17.692339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759523+0000","last_change":"2024-07-24T16:24:07.447096+0000","last_active":"2024-07-24T16:24:08.759523+0000","last_peered":"2024-07-24T16:24:08.759523+0000","last_clean":"2024-07-24T16:24:08.759523+0000","last_became_active":"2024-07-24T16:24:07.446606+0000","last_became_peered":"2024-07-24T16:24:07.446606+0000","last_unstale":"2024-07-24T16:24:08.759523+0000","last_undegraded":"2024-07-24T16:24:08.759523+0000","last_fullsized":"2024-07-24T16:24:08.759523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:31.194762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931063+0000","last_change":"2024-07-24T16:24:03.425422+0000","last_active":"2024-07-24T16:24:08.931063+0000","last_peered":"2024-07-24T16:24:08.931063+0000","last_clean":"2024-07-24T16:24:08.931063+0000","last_became_active":"2024-07-24T16:24:03.421595+0000","last_became_peered":"2024-07-24T16:24:03.421595+0000","last_unstale":"2024-07-24T16:24:08.931063+0000","last_undegraded":"2024-07-24T16:24:08.931063+0000","last_fullsized":"2024-07-24T16:24:08.931063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:11.929285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.439657+0000","last_change":"2024-07-24T16:24:02.411221+0000","last_active":"2024-07-24T16:24:08.439657+0000","last_peered":"2024-07-24T16:24:08.439657+0000","last_clean":"2024-07-24T16:24:08.439657+0000","last_became_active":"2024-07-24T16:24:02.410863+0000","last_became_peered":"2024-07-24T16:24:02.410863+0000","last_unstale":"2024-07-24T16:24:08.439657+0000","last_undegraded":"2024-07-24T16:24:08.439657+0000","last_fullsized":"2024-07-24T16:24:08.439657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:39:09.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441228+0000","last_change":"2024-07-24T16:24:07.451699+0000","last_active":"2024-07-24T16:24:08.441228+0000","last_peered":"2024-07-24T16:24:08.441228+0000","last_clean":"2024-07-24T16:24:08.441228+0000","last_became_active":"2024-07-24T16:24:07.451312+0000","last_became_peered":"2024-07-24T16:24:07.451312+0000","last_unstale":"2024-07-24T16:24:08.441228+0000","last_undegraded":"2024-07-24T16:24:08.441228+0000","last_fullsized":"2024-07-24T16:24:08.441228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:00.032046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930892+0000","last_change":"2024-07-24T16:24:03.423978+0000","last_active":"2024-07-24T16:24:08.930892+0000","last_peered":"2024-07-24T16:24:08.930892+0000","last_clean":"2024-07-24T16:24:08.930892+0000","last_became_active":"2024-07-24T16:24:03.423695+0000","last_became_peered":"2024-07-24T16:24:03.423695+0000","last_unstale":"2024-07-24T16:24:08.930892+0000","last_undegraded":"2024-07-24T16:24:08.930892+0000","last_fullsized":"2024-07-24T16:24:08.930892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930970+0000","last_change":"2024-07-24T16:24:02.420730+0000","last_active":"2024-07-24T16:24:08.930970+0000","last_peered":"2024-07-24T16:24:08.930970+0000","last_clean":"2024-07-24T16:24:08.930970+0000","last_became_active":"2024-07-24T16:24:02.420437+0000","last_became_peered":"2024-07-24T16:24:02.420437+0000","last_unstale":"2024-07-24T16:24:08.930970+0000","last_undegraded":"2024-07-24T16:24:08.930970+0000","last_fullsized":"2024-07-24T16:24:08.930970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663486+0000","last_change":"2024-07-24T16:24:07.689640+0000","last_active":"2024-07-24T16:24:08.663486+0000","last_peered":"2024-07-24T16:24:08.663486+0000","last_clean":"2024-07-24T16:24:08.663486+0000","last_became_active":"2024-07-24T16:24:07.689279+0000","last_became_peered":"2024-07-24T16:24:07.689279+0000","last_unstale":"2024-07-24T16:24:08.663486+0000","last_undegraded":"2024-07-24T16:24:08.663486+0000","last_fullsized":"2024-07-24T16:24:08.663486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:48:40.982486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931940+0000","last_change":"2024-07-24T16:24:03.422243+0000","last_active":"2024-07-24T16:24:08.931940+0000","last_peered":"2024-07-24T16:24:08.931940+0000","last_clean":"2024-07-24T16:24:08.931940+0000","last_became_active":"2024-07-24T16:24:03.419977+0000","last_became_peered":"2024-07-24T16:24:03.419977+0000","last_unstale":"2024-07-24T16:24:08.931940+0000","last_undegraded":"2024-07-24T16:24:08.931940+0000","last_fullsized":"2024-07-24T16:24:08.931940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:33:56.923986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442330+0000","last_change":"2024-07-24T16:24:02.415148+0000","last_active":"2024-07-24T16:24:08.442330+0000","last_peered":"2024-07-24T16:24:08.442330+0000","last_clean":"2024-07-24T16:24:08.442330+0000","last_became_active":"2024-07-24T16:24:02.414888+0000","last_became_peered":"2024-07-24T16:24:02.414888+0000","last_unstale":"2024-07-24T16:24:08.442330+0000","last_undegraded":"2024-07-24T16:24:08.442330+0000","last_fullsized":"2024-07-24T16:24:08.442330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663297+0000","last_change":"2024-07-24T16:24:07.689067+0000","last_active":"2024-07-24T16:24:08.663297+0000","last_peered":"2024-07-24T16:24:08.663297+0000","last_clean":"2024-07-24T16:24:08.663297+0000","last_became_active":"2024-07-24T16:24:07.688641+0000","last_became_peered":"2024-07-24T16:24:07.688641+0000","last_unstale":"2024-07-24T16:24:08.663297+0000","last_undegraded":"2024-07-24T16:24:08.663297+0000","last_fullsized":"2024-07-24T16:24:08.663297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:25:51.738843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441338+0000","last_change":"2024-07-24T16:24:03.431327+0000","last_active":"2024-07-24T16:24:08.441338+0000","last_peered":"2024-07-24T16:24:08.441338+0000","last_clean":"2024-07-24T16:24:08.441338+0000","last_became_active":"2024-07-24T16:24:03.430853+0000","last_became_peered":"2024-07-24T16:24:03.430853+0000","last_unstale":"2024-07-24T16:24:08.441338+0000","last_undegraded":"2024-07-24T16:24:08.441338+0000","last_fullsized":"2024-07-24T16:24:08.441338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441701+0000","last_change":"2024-07-24T16:24:02.420934+0000","last_active":"2024-07-24T16:24:08.441701+0000","last_peered":"2024-07-24T16:24:08.441701+0000","last_clean":"2024-07-24T16:24:08.441701+0000","last_became_active":"2024-07-24T16:24:02.420671+0000","last_became_peered":"2024-07-24T16:24:02.420671+0000","last_unstale":"2024-07-24T16:24:08.441701+0000","last_undegraded":"2024-07-24T16:24:08.441701+0000","last_fullsized":"2024-07-24T16:24:08.441701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:34:17.692339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441875+0000","last_change":"2024-07-24T16:24:07.689105+0000","last_active":"2024-07-24T16:24:08.441875+0000","last_peered":"2024-07-24T16:24:08.441875+0000","last_clean":"2024-07-24T16:24:08.441875+0000","last_became_active":"2024-07-24T16:24:07.688653+0000","last_became_peered":"2024-07-24T16:24:07.688653+0000","last_unstale":"2024-07-24T16:24:08.441875+0000","last_undegraded":"2024-07-24T16:24:08.441875+0000","last_fullsized":"2024-07-24T16:24:08.441875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:53:17.994950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931785+0000","last_change":"2024-07-24T16:24:03.426312+0000","last_active":"2024-07-24T16:24:08.931785+0000","last_peered":"2024-07-24T16:24:08.931785+0000","last_clean":"2024-07-24T16:24:08.931785+0000","last_became_active":"2024-07-24T16:24:03.425604+0000","last_became_peered":"2024-07-24T16:24:03.425604+0000","last_unstale":"2024-07-24T16:24:08.931785+0000","last_undegraded":"2024-07-24T16:24:08.931785+0000","last_fullsized":"2024-07-24T16:24:08.931785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:25.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:12.924059+0000","last_change":"2024-07-24T16:24:02.422934+0000","last_active":"2024-07-24T16:24:12.924059+0000","last_peered":"2024-07-24T16:24:12.924059+0000","last_clean":"2024-07-24T16:24:12.924059+0000","last_became_active":"2024-07-24T16:24:02.422695+0000","last_became_peered":"2024-07-24T16:24:02.422695+0000","last_unstale":"2024-07-24T16:24:12.924059+0000","last_undegraded":"2024-07-24T16:24:12.924059+0000","last_fullsized":"2024-07-24T16:24:12.924059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930364+0000","last_change":"2024-07-24T16:24:07.456345+0000","last_active":"2024-07-24T16:24:08.930364+0000","last_peered":"2024-07-24T16:24:08.930364+0000","last_clean":"2024-07-24T16:24:08.930364+0000","last_became_active":"2024-07-24T16:24:07.455655+0000","last_became_peered":"2024-07-24T16:24:07.455655+0000","last_unstale":"2024-07-24T16:24:08.930364+0000","last_undegraded":"2024-07-24T16:24:08.930364+0000","last_fullsized":"2024-07-24T16:24:08.930364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:41.279030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760268+0000","last_change":"2024-07-24T16:24:03.421137+0000","last_active":"2024-07-24T16:24:08.760268+0000","last_peered":"2024-07-24T16:24:08.760268+0000","last_clean":"2024-07-24T16:24:08.760268+0000","last_became_active":"2024-07-24T16:24:03.420297+0000","last_became_peered":"2024-07-24T16:24:03.420297+0000","last_unstale":"2024-07-24T16:24:08.760268+0000","last_undegraded":"2024-07-24T16:24:08.760268+0000","last_fullsized":"2024-07-24T16:24:08.760268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:56:36.133125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930677+0000","last_change":"2024-07-24T16:24:02.420388+0000","last_active":"2024-07-24T16:24:08.930677+0000","last_peered":"2024-07-24T16:24:08.930677+0000","last_clean":"2024-07-24T16:24:08.930677+0000","last_became_active":"2024-07-24T16:24:02.420112+0000","last_became_peered":"2024-07-24T16:24:02.420112+0000","last_unstale":"2024-07-24T16:24:08.930677+0000","last_undegraded":"2024-07-24T16:24:08.930677+0000","last_fullsized":"2024-07-24T16:24:08.930677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759693+0000","last_change":"2024-07-24T16:24:07.448340+0000","last_active":"2024-07-24T16:24:08.759693+0000","last_peered":"2024-07-24T16:24:08.759693+0000","last_clean":"2024-07-24T16:24:08.759693+0000","last_became_active":"2024-07-24T16:24:07.447324+0000","last_became_peered":"2024-07-24T16:24:07.447324+0000","last_unstale":"2024-07-24T16:24:08.759693+0000","last_undegraded":"2024-07-24T16:24:08.759693+0000","last_fullsized":"2024-07-24T16:24:08.759693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:34:00.952650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441533+0000","last_change":"2024-07-24T16:24:03.426242+0000","last_active":"2024-07-24T16:24:08.441533+0000","last_peered":"2024-07-24T16:24:08.441533+0000","last_clean":"2024-07-24T16:24:08.441533+0000","last_became_active":"2024-07-24T16:24:03.425940+0000","last_became_peered":"2024-07-24T16:24:03.425940+0000","last_unstale":"2024-07-24T16:24:08.441533+0000","last_undegraded":"2024-07-24T16:24:08.441533+0000","last_fullsized":"2024-07-24T16:24:08.441533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442327+0000","last_change":"2024-07-24T16:24:02.419299+0000","last_active":"2024-07-24T16:24:08.442327+0000","last_peered":"2024-07-24T16:24:08.442327+0000","last_clean":"2024-07-24T16:24:08.442327+0000","last_became_active":"2024-07-24T16:24:02.419004+0000","last_became_peered":"2024-07-24T16:24:02.419004+0000","last_unstale":"2024-07-24T16:24:08.442327+0000","last_undegraded":"2024-07-24T16:24:08.442327+0000","last_fullsized":"2024-07-24T16:24:08.442327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662799+0000","last_change":"2024-07-24T16:24:07.446403+0000","last_active":"2024-07-24T16:24:08.662799+0000","last_peered":"2024-07-24T16:24:08.662799+0000","last_clean":"2024-07-24T16:24:08.662799+0000","last_became_active":"2024-07-24T16:24:07.445711+0000","last_became_peered":"2024-07-24T16:24:07.445711+0000","last_unstale":"2024-07-24T16:24:08.662799+0000","last_undegraded":"2024-07-24T16:24:08.662799+0000","last_fullsized":"2024-07-24T16:24:08.662799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:14:48.365984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441973+0000","last_change":"2024-07-24T16:24:03.421104+0000","last_active":"2024-07-24T16:24:08.441973+0000","last_peered":"2024-07-24T16:24:08.441973+0000","last_clean":"2024-07-24T16:24:08.441973+0000","last_became_active":"2024-07-24T16:24:03.420479+0000","last_became_peered":"2024-07-24T16:24:03.420479+0000","last_unstale":"2024-07-24T16:24:08.441973+0000","last_undegraded":"2024-07-24T16:24:08.441973+0000","last_fullsized":"2024-07-24T16:24:08.441973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:37.605337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931694+0000","last_change":"2024-07-24T16:24:02.424342+0000","last_active":"2024-07-24T16:24:08.931694+0000","last_peered":"2024-07-24T16:24:08.931694+0000","last_clean":"2024-07-24T16:24:08.931694+0000","last_became_active":"2024-07-24T16:24:02.424056+0000","last_became_peered":"2024-07-24T16:24:02.424056+0000","last_unstale":"2024-07-24T16:24:08.931694+0000","last_undegraded":"2024-07-24T16:24:08.931694+0000","last_fullsized":"2024-07-24T16:24:08.931694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662718+0000","last_change":"2024-07-24T16:24:07.689112+0000","last_active":"2024-07-24T16:24:08.662718+0000","last_peered":"2024-07-24T16:24:08.662718+0000","last_clean":"2024-07-24T16:24:08.662718+0000","last_became_active":"2024-07-24T16:24:07.688763+0000","last_became_peered":"2024-07-24T16:24:07.688763+0000","last_unstale":"2024-07-24T16:24:08.662718+0000","last_undegraded":"2024-07-24T16:24:08.662718+0000","last_fullsized":"2024-07-24T16:24:08.662718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:53:17.994950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441200+0000","last_change":"2024-07-24T16:24:07.689772+0000","last_active":"2024-07-24T16:24:08.441200+0000","last_peered":"2024-07-24T16:24:08.441200+0000","last_clean":"2024-07-24T16:24:08.441200+0000","last_became_active":"2024-07-24T16:24:07.689417+0000","last_became_peered":"2024-07-24T16:24:07.689417+0000","last_unstale":"2024-07-24T16:24:08.441200+0000","last_undegraded":"2024-07-24T16:24:08.441200+0000","last_fullsized":"2024-07-24T16:24:08.441200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:25.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930100+0000","last_change":"2024-07-24T16:24:03.416202+0000","last_active":"2024-07-24T16:24:08.930100+0000","last_peered":"2024-07-24T16:24:08.930100+0000","last_clean":"2024-07-24T16:24:08.930100+0000","last_became_active":"2024-07-24T16:24:03.415444+0000","last_became_peered":"2024-07-24T16:24:03.415444+0000","last_unstale":"2024-07-24T16:24:08.930100+0000","last_undegraded":"2024-07-24T16:24:08.930100+0000","last_fullsized":"2024-07-24T16:24:08.930100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441673+0000","last_change":"2024-07-24T16:24:02.416160+0000","last_active":"2024-07-24T16:24:08.441673+0000","last_peered":"2024-07-24T16:24:08.441673+0000","last_clean":"2024-07-24T16:24:08.441673+0000","last_became_active":"2024-07-24T16:24:02.415685+0000","last_became_peered":"2024-07-24T16:24:02.415685+0000","last_unstale":"2024-07-24T16:24:08.441673+0000","last_undegraded":"2024-07-24T16:24:08.441673+0000","last_fullsized":"2024-07-24T16:24:08.441673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931484+0000","last_change":"2024-07-24T16:24:07.453889+0000","last_active":"2024-07-24T16:24:08.931484+0000","last_peered":"2024-07-24T16:24:08.931484+0000","last_clean":"2024-07-24T16:24:08.931484+0000","last_became_active":"2024-07-24T16:24:07.453401+0000","last_became_peered":"2024-07-24T16:24:07.453401+0000","last_unstale":"2024-07-24T16:24:08.931484+0000","last_undegraded":"2024-07-24T16:24:08.931484+0000","last_fullsized":"2024-07-24T16:24:08.931484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:25.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662799+0000","last_change":"2024-07-24T16:24:03.422055+0000","last_active":"2024-07-24T16:24:08.662799+0000","last_peered":"2024-07-24T16:24:08.662799+0000","last_clean":"2024-07-24T16:24:08.662799+0000","last_became_active":"2024-07-24T16:24:03.420953+0000","last_became_peered":"2024-07-24T16:24:03.420953+0000","last_unstale":"2024-07-24T16:24:08.662799+0000","last_undegraded":"2024-07-24T16:24:08.662799+0000","last_fullsized":"2024-07-24T16:24:08.662799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662904+0000","last_change":"2024-07-24T16:24:02.416293+0000","last_active":"2024-07-24T16:24:08.662904+0000","last_peered":"2024-07-24T16:24:08.662904+0000","last_clean":"2024-07-24T16:24:08.662904+0000","last_became_active":"2024-07-24T16:24:02.415990+0000","last_became_peered":"2024-07-24T16:24:02.415990+0000","last_unstale":"2024-07-24T16:24:08.662904+0000","last_undegraded":"2024-07-24T16:24:08.662904+0000","last_fullsized":"2024-07-24T16:24:08.662904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931260+0000","last_change":"2024-07-24T16:24:02.421954+0000","last_active":"2024-07-24T16:24:08.931260+0000","last_peered":"2024-07-24T16:24:08.931260+0000","last_clean":"2024-07-24T16:24:08.931260+0000","last_became_active":"2024-07-24T16:24:02.421684+0000","last_became_peered":"2024-07-24T16:24:02.421684+0000","last_unstale":"2024-07-24T16:24:08.931260+0000","last_undegraded":"2024-07-24T16:24:08.931260+0000","last_fullsized":"2024-07-24T16:24:08.931260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441648+0000","last_change":"2024-07-24T16:24:03.421135+0000","last_active":"2024-07-24T16:24:08.441648+0000","last_peered":"2024-07-24T16:24:08.441648+0000","last_clean":"2024-07-24T16:24:08.441648+0000","last_became_active":"2024-07-24T16:24:03.420836+0000","last_became_peered":"2024-07-24T16:24:03.420836+0000","last_unstale":"2024-07-24T16:24:08.441648+0000","last_undegraded":"2024-07-24T16:24:08.441648+0000","last_fullsized":"2024-07-24T16:24:08.441648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:17:16.704958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440237+0000","last_change":"2024-07-24T16:24:07.456171+0000","last_active":"2024-07-24T16:24:08.440237+0000","last_peered":"2024-07-24T16:24:08.440237+0000","last_clean":"2024-07-24T16:24:08.440237+0000","last_became_active":"2024-07-24T16:24:07.455706+0000","last_became_peered":"2024-07-24T16:24:07.455706+0000","last_unstale":"2024-07-24T16:24:08.440237+0000","last_undegraded":"2024-07-24T16:24:08.440237+0000","last_fullsized":"2024-07-24T16:24:08.440237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:57:59.034419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663222+0000","last_change":"2024-07-24T16:24:02.424430+0000","last_active":"2024-07-24T16:24:08.663222+0000","last_peered":"2024-07-24T16:24:08.663222+0000","last_clean":"2024-07-24T16:24:08.663222+0000","last_became_active":"2024-07-24T16:24:02.424131+0000","last_became_peered":"2024-07-24T16:24:02.424131+0000","last_unstale":"2024-07-24T16:24:08.663222+0000","last_undegraded":"2024-07-24T16:24:08.663222+0000","last_fullsized":"2024-07-24T16:24:08.663222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:11:26.148830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759757+0000","last_change":"2024-07-24T16:24:03.405739+0000","last_active":"2024-07-24T16:24:08.759757+0000","last_peered":"2024-07-24T16:24:08.759757+0000","last_clean":"2024-07-24T16:24:08.759757+0000","last_became_active":"2024-07-24T16:24:03.405465+0000","last_became_peered":"2024-07-24T16:24:03.405465+0000","last_unstale":"2024-07-24T16:24:08.759757+0000","last_undegraded":"2024-07-24T16:24:08.759757+0000","last_fullsized":"2024-07-24T16:24:08.759757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:17.143178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663324+0000","last_change":"2024-07-24T16:24:07.451902+0000","last_active":"2024-07-24T16:24:08.663324+0000","last_peered":"2024-07-24T16:24:08.663324+0000","last_clean":"2024-07-24T16:24:08.663324+0000","last_became_active":"2024-07-24T16:24:07.451243+0000","last_became_peered":"2024-07-24T16:24:07.451243+0000","last_unstale":"2024-07-24T16:24:08.663324+0000","last_undegraded":"2024-07-24T16:24:08.663324+0000","last_fullsized":"2024-07-24T16:24:08.663324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:32:02.239427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930768+0000","last_change":"2024-07-24T16:24:03.426344+0000","last_active":"2024-07-24T16:24:08.930768+0000","last_peered":"2024-07-24T16:24:08.930768+0000","last_clean":"2024-07-24T16:24:08.930768+0000","last_became_active":"2024-07-24T16:24:03.426064+0000","last_became_peered":"2024-07-24T16:24:03.426064+0000","last_unstale":"2024-07-24T16:24:08.930768+0000","last_undegraded":"2024-07-24T16:24:08.930768+0000","last_fullsized":"2024-07-24T16:24:08.930768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:17:16.704958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.439822+0000","last_change":"2024-07-24T16:24:03.414954+0000","last_active":"2024-07-24T16:24:08.439822+0000","last_peered":"2024-07-24T16:24:08.439822+0000","last_clean":"2024-07-24T16:24:08.439822+0000","last_became_active":"2024-07-24T16:24:03.414684+0000","last_became_peered":"2024-07-24T16:24:03.414684+0000","last_unstale":"2024-07-24T16:24:08.439822+0000","last_undegraded":"2024-07-24T16:24:08.439822+0000","last_fullsized":"2024-07-24T16:24:08.439822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:17.143178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441834+0000","last_change":"2024-07-24T16:24:03.420882+0000","last_active":"2024-07-24T16:24:08.441834+0000","last_peered":"2024-07-24T16:24:08.441834+0000","last_clean":"2024-07-24T16:24:08.441834+0000","last_became_active":"2024-07-24T16:24:03.420555+0000","last_became_peered":"2024-07-24T16:24:03.420555+0000","last_unstale":"2024-07-24T16:24:08.441834+0000","last_undegraded":"2024-07-24T16:24:08.441834+0000","last_fullsized":"2024-07-24T16:24:08.441834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:37.250366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441536+0000","last_change":"2024-07-24T16:24:03.419648+0000","last_active":"2024-07-24T16:24:08.441536+0000","last_peered":"2024-07-24T16:24:08.441536+0000","last_clean":"2024-07-24T16:24:08.441536+0000","last_became_active":"2024-07-24T16:24:03.419390+0000","last_became_peered":"2024-07-24T16:24:03.419390+0000","last_unstale":"2024-07-24T16:24:08.441536+0000","last_undegraded":"2024-07-24T16:24:08.441536+0000","last_fullsized":"2024-07-24T16:24:08.441536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663423+0000","last_change":"2024-07-24T16:24:03.420527+0000","last_active":"2024-07-24T16:24:08.663423+0000","last_peered":"2024-07-24T16:24:08.663423+0000","last_clean":"2024-07-24T16:24:08.663423+0000","last_became_active":"2024-07-24T16:24:03.419368+0000","last_became_peered":"2024-07-24T16:24:03.419368+0000","last_unstale":"2024-07-24T16:24:08.663423+0000","last_undegraded":"2024-07-24T16:24:08.663423+0000","last_fullsized":"2024-07-24T16:24:08.663423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:25.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930580+0000","last_change":"2024-07-24T16:24:03.416673+0000","last_active":"2024-07-24T16:24:08.930580+0000","last_peered":"2024-07-24T16:24:08.930580+0000","last_clean":"2024-07-24T16:24:08.930580+0000","last_became_active":"2024-07-24T16:24:03.416375+0000","last_became_peered":"2024-07-24T16:24:03.416375+0000","last_unstale":"2024-07-24T16:24:08.930580+0000","last_undegraded":"2024-07-24T16:24:08.930580+0000","last_fullsized":"2024-07-24T16:24:08.930580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931645+0000","last_change":"2024-07-24T16:24:03.424087+0000","last_active":"2024-07-24T16:24:08.931645+0000","last_peered":"2024-07-24T16:24:08.931645+0000","last_clean":"2024-07-24T16:24:08.931645+0000","last_became_active":"2024-07-24T16:24:03.423409+0000","last_became_peered":"2024-07-24T16:24:03.423409+0000","last_unstale":"2024-07-24T16:24:08.931645+0000","last_undegraded":"2024-07-24T16:24:08.931645+0000","last_fullsized":"2024-07-24T16:24:08.931645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663596+0000","last_change":"2024-07-24T16:24:03.418712+0000","last_active":"2024-07-24T16:24:08.663596+0000","last_peered":"2024-07-24T16:24:08.663596+0000","last_clean":"2024-07-24T16:24:08.663596+0000","last_became_active":"2024-07-24T16:24:03.418419+0000","last_became_peered":"2024-07-24T16:24:03.418419+0000","last_unstale":"2024-07-24T16:24:08.663596+0000","last_undegraded":"2024-07-24T16:24:08.663596+0000","last_fullsized":"2024-07-24T16:24:08.663596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441633+0000","last_change":"2024-07-24T16:24:03.418720+0000","last_active":"2024-07-24T16:24:08.441633+0000","last_peered":"2024-07-24T16:24:08.441633+0000","last_clean":"2024-07-24T16:24:08.441633+0000","last_became_active":"2024-07-24T16:24:03.418318+0000","last_became_peered":"2024-07-24T16:24:03.418318+0000","last_unstale":"2024-07-24T16:24:08.441633+0000","last_undegraded":"2024-07-24T16:24:08.441633+0000","last_fullsized":"2024-07-24T16:24:08.441633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:11.929285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662844+0000","last_change":"2024-07-24T16:24:03.418662+0000","last_active":"2024-07-24T16:24:08.662844+0000","last_peered":"2024-07-24T16:24:08.662844+0000","last_clean":"2024-07-24T16:24:08.662844+0000","last_became_active":"2024-07-24T16:24:03.418378+0000","last_became_peered":"2024-07-24T16:24:03.418378+0000","last_unstale":"2024-07-24T16:24:08.662844+0000","last_undegraded":"2024-07-24T16:24:08.662844+0000","last_fullsized":"2024-07-24T16:24:08.662844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441710+0000","last_change":"2024-07-24T16:24:03.418038+0000","last_active":"2024-07-24T16:24:08.441710+0000","last_peered":"2024-07-24T16:24:08.441710+0000","last_clean":"2024-07-24T16:24:08.441710+0000","last_became_active":"2024-07-24T16:24:03.417007+0000","last_became_peered":"2024-07-24T16:24:03.417007+0000","last_unstale":"2024-07-24T16:24:08.441710+0000","last_undegraded":"2024-07-24T16:24:08.441710+0000","last_fullsized":"2024-07-24T16:24:08.441710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:42.549780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441338+0000","last_change":"2024-07-24T16:24:03.431911+0000","last_active":"2024-07-24T16:24:08.441338+0000","last_peered":"2024-07-24T16:24:08.441338+0000","last_clean":"2024-07-24T16:24:08.441338+0000","last_became_active":"2024-07-24T16:24:03.431609+0000","last_became_peered":"2024-07-24T16:24:03.431609+0000","last_unstale":"2024-07-24T16:24:08.441338+0000","last_undegraded":"2024-07-24T16:24:08.441338+0000","last_fullsized":"2024-07-24T16:24:08.441338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:48:51.593685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931556+0000","last_change":"2024-07-24T16:24:03.421743+0000","last_active":"2024-07-24T16:24:08.931556+0000","last_peered":"2024-07-24T16:24:08.931556+0000","last_clean":"2024-07-24T16:24:08.931556+0000","last_became_active":"2024-07-24T16:24:03.419448+0000","last_became_peered":"2024-07-24T16:24:03.419448+0000","last_unstale":"2024-07-24T16:24:08.931556+0000","last_undegraded":"2024-07-24T16:24:08.931556+0000","last_fullsized":"2024-07-24T16:24:08.931556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932230+0000","last_change":"2024-07-24T16:24:03.426083+0000","last_active":"2024-07-24T16:24:08.932230+0000","last_peered":"2024-07-24T16:24:08.932230+0000","last_clean":"2024-07-24T16:24:08.932230+0000","last_became_active":"2024-07-24T16:24:03.425305+0000","last_became_peered":"2024-07-24T16:24:03.425305+0000","last_unstale":"2024-07-24T16:24:08.932230+0000","last_undegraded":"2024-07-24T16:24:08.932230+0000","last_fullsized":"2024-07-24T16:24:08.932230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:37.250366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440125+0000","last_change":"2024-07-24T16:24:03.414343+0000","last_active":"2024-07-24T16:24:08.440125+0000","last_peered":"2024-07-24T16:24:08.440125+0000","last_clean":"2024-07-24T16:24:08.440125+0000","last_became_active":"2024-07-24T16:24:03.414057+0000","last_became_peered":"2024-07-24T16:24:03.414057+0000","last_unstale":"2024-07-24T16:24:08.440125+0000","last_undegraded":"2024-07-24T16:24:08.440125+0000","last_fullsized":"2024-07-24T16:24:08.440125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:45:49.295282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442181+0000","last_change":"2024-07-24T16:24:03.420932+0000","last_active":"2024-07-24T16:24:08.442181+0000","last_peered":"2024-07-24T16:24:08.442181+0000","last_clean":"2024-07-24T16:24:08.442181+0000","last_became_active":"2024-07-24T16:24:03.420642+0000","last_became_peered":"2024-07-24T16:24:03.420642+0000","last_unstale":"2024-07-24T16:24:08.442181+0000","last_undegraded":"2024-07-24T16:24:08.442181+0000","last_fullsized":"2024-07-24T16:24:08.442181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441303+0000","last_change":"2024-07-24T16:24:03.425237+0000","last_active":"2024-07-24T16:24:08.441303+0000","last_peered":"2024-07-24T16:24:08.441303+0000","last_clean":"2024-07-24T16:24:08.441303+0000","last_became_active":"2024-07-24T16:24:03.424915+0000","last_became_peered":"2024-07-24T16:24:03.424915+0000","last_unstale":"2024-07-24T16:24:08.441303+0000","last_undegraded":"2024-07-24T16:24:08.441303+0000","last_fullsized":"2024-07-24T16:24:08.441303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930172+0000","last_change":"2024-07-24T16:24:03.404488+0000","last_active":"2024-07-24T16:24:08.930172+0000","last_peered":"2024-07-24T16:24:08.930172+0000","last_clean":"2024-07-24T16:24:08.930172+0000","last_became_active":"2024-07-24T16:24:03.404145+0000","last_became_peered":"2024-07-24T16:24:03.404145+0000","last_unstale":"2024-07-24T16:24:08.930172+0000","last_undegraded":"2024-07-24T16:24:08.930172+0000","last_fullsized":"2024-07-24T16:24:08.930172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441452+0000","last_change":"2024-07-24T16:24:03.421865+0000","last_active":"2024-07-24T16:24:08.441452+0000","last_peered":"2024-07-24T16:24:08.441452+0000","last_clean":"2024-07-24T16:24:08.441452+0000","last_became_active":"2024-07-24T16:24:03.421569+0000","last_became_peered":"2024-07-24T16:24:03.421569+0000","last_unstale":"2024-07-24T16:24:08.441452+0000","last_undegraded":"2024-07-24T16:24:08.441452+0000","last_fullsized":"2024-07-24T16:24:08.441452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663120+0000","last_change":"2024-07-24T16:24:03.414078+0000","last_active":"2024-07-24T16:24:08.663120+0000","last_peered":"2024-07-24T16:24:08.663120+0000","last_clean":"2024-07-24T16:24:08.663120+0000","last_became_active":"2024-07-24T16:24:03.413790+0000","last_became_peered":"2024-07-24T16:24:03.413790+0000","last_unstale":"2024-07-24T16:24:08.663120+0000","last_undegraded":"2024-07-24T16:24:08.663120+0000","last_fullsized":"2024-07-24T16:24:08.663120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:05.808945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760147+0000","last_change":"2024-07-24T16:24:03.415097+0000","last_active":"2024-07-24T16:24:08.760147+0000","last_peered":"2024-07-24T16:24:08.760147+0000","last_clean":"2024-07-24T16:24:08.760147+0000","last_became_active":"2024-07-24T16:24:03.413714+0000","last_became_peered":"2024-07-24T16:24:03.413714+0000","last_unstale":"2024-07-24T16:24:08.760147+0000","last_undegraded":"2024-07-24T16:24:08.760147+0000","last_fullsized":"2024-07-24T16:24:08.760147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:35:31.460220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931494+0000","last_change":"2024-07-24T16:24:03.414407+0000","last_active":"2024-07-24T16:24:08.931494+0000","last_peered":"2024-07-24T16:24:08.931494+0000","last_clean":"2024-07-24T16:24:08.931494+0000","last_became_active":"2024-07-24T16:24:03.414130+0000","last_became_peered":"2024-07-24T16:24:03.414130+0000","last_unstale":"2024-07-24T16:24:08.931494+0000","last_undegraded":"2024-07-24T16:24:08.931494+0000","last_fullsized":"2024-07-24T16:24:08.931494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931527+0000","last_change":"2024-07-24T16:24:03.423751+0000","last_active":"2024-07-24T16:24:08.931527+0000","last_peered":"2024-07-24T16:24:08.931527+0000","last_clean":"2024-07-24T16:24:08.931527+0000","last_became_active":"2024-07-24T16:24:03.423474+0000","last_became_peered":"2024-07-24T16:24:03.423474+0000","last_unstale":"2024-07-24T16:24:08.931527+0000","last_undegraded":"2024-07-24T16:24:08.931527+0000","last_fullsized":"2024-07-24T16:24:08.931527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932077+0000","last_change":"2024-07-24T16:24:03.427935+0000","last_active":"2024-07-24T16:24:08.932077+0000","last_peered":"2024-07-24T16:24:08.932077+0000","last_clean":"2024-07-24T16:24:08.932077+0000","last_became_active":"2024-07-24T16:24:03.427533+0000","last_became_peered":"2024-07-24T16:24:03.427533+0000","last_unstale":"2024-07-24T16:24:08.932077+0000","last_undegraded":"2024-07-24T16:24:08.932077+0000","last_fullsized":"2024-07-24T16:24:08.932077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:37.605337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662710+0000","last_change":"2024-07-24T16:24:03.426562+0000","last_active":"2024-07-24T16:24:08.662710+0000","last_peered":"2024-07-24T16:24:08.662710+0000","last_clean":"2024-07-24T16:24:08.662710+0000","last_became_active":"2024-07-24T16:24:03.426289+0000","last_became_peered":"2024-07-24T16:24:03.426289+0000","last_unstale":"2024-07-24T16:24:08.662710+0000","last_undegraded":"2024-07-24T16:24:08.662710+0000","last_fullsized":"2024-07-24T16:24:08.662710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930924+0000","last_change":"2024-07-24T16:24:03.425133+0000","last_active":"2024-07-24T16:24:08.930924+0000","last_peered":"2024-07-24T16:24:08.930924+0000","last_clean":"2024-07-24T16:24:08.930924+0000","last_became_active":"2024-07-24T16:24:03.424694+0000","last_became_peered":"2024-07-24T16:24:03.424694+0000","last_unstale":"2024-07-24T16:24:08.930924+0000","last_undegraded":"2024-07-24T16:24:08.930924+0000","last_fullsized":"2024-07-24T16:24:08.930924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:05.808945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441560+0000","last_change":"2024-07-24T16:24:03.424756+0000","last_active":"2024-07-24T16:24:08.441560+0000","last_peered":"2024-07-24T16:24:08.441560+0000","last_clean":"2024-07-24T16:24:08.441560+0000","last_became_active":"2024-07-24T16:24:03.424496+0000","last_became_peered":"2024-07-24T16:24:03.424496+0000","last_unstale":"2024-07-24T16:24:08.441560+0000","last_undegraded":"2024-07-24T16:24:08.441560+0000","last_fullsized":"2024-07-24T16:24:08.441560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:25.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931259+0000","last_change":"2024-07-24T16:24:03.424754+0000","last_active":"2024-07-24T16:24:08.931259+0000","last_peered":"2024-07-24T16:24:08.931259+0000","last_clean":"2024-07-24T16:24:08.931259+0000","last_became_active":"2024-07-24T16:24:03.421220+0000","last_became_peered":"2024-07-24T16:24:03.421220+0000","last_unstale":"2024-07-24T16:24:08.931259+0000","last_undegraded":"2024-07-24T16:24:08.931259+0000","last_fullsized":"2024-07-24T16:24:08.931259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:01.499631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441829+0000","last_change":"2024-07-24T16:24:03.419695+0000","last_active":"2024-07-24T16:24:08.441829+0000","last_peered":"2024-07-24T16:24:08.441829+0000","last_clean":"2024-07-24T16:24:08.441829+0000","last_became_active":"2024-07-24T16:24:03.416727+0000","last_became_peered":"2024-07-24T16:24:03.416727+0000","last_unstale":"2024-07-24T16:24:08.441829+0000","last_undegraded":"2024-07-24T16:24:08.441829+0000","last_fullsized":"2024-07-24T16:24:08.441829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:33:56.923986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441260+0000","last_change":"2024-07-24T16:24:03.422051+0000","last_active":"2024-07-24T16:24:08.441260+0000","last_peered":"2024-07-24T16:24:08.441260+0000","last_clean":"2024-07-24T16:24:08.441260+0000","last_became_active":"2024-07-24T16:24:03.421771+0000","last_became_peered":"2024-07-24T16:24:03.421771+0000","last_unstale":"2024-07-24T16:24:08.441260+0000","last_undegraded":"2024-07-24T16:24:08.441260+0000","last_fullsized":"2024-07-24T16:24:08.441260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:07:14.015059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930778+0000","last_change":"2024-07-24T16:24:03.419502+0000","last_active":"2024-07-24T16:24:08.930778+0000","last_peered":"2024-07-24T16:24:08.930778+0000","last_clean":"2024-07-24T16:24:08.930778+0000","last_became_active":"2024-07-24T16:24:03.419206+0000","last_became_peered":"2024-07-24T16:24:03.419206+0000","last_unstale":"2024-07-24T16:24:08.930778+0000","last_undegraded":"2024-07-24T16:24:08.930778+0000","last_fullsized":"2024-07-24T16:24:08.930778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931978+0000","last_change":"2024-07-24T16:24:03.419857+0000","last_active":"2024-07-24T16:24:08.931978+0000","last_peered":"2024-07-24T16:24:08.931978+0000","last_clean":"2024-07-24T16:24:08.931978+0000","last_became_active":"2024-07-24T16:24:03.419599+0000","last_became_peered":"2024-07-24T16:24:03.419599+0000","last_unstale":"2024-07-24T16:24:08.931978+0000","last_undegraded":"2024-07-24T16:24:08.931978+0000","last_fullsized":"2024-07-24T16:24:08.931978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:42.549780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:24:23.849 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-07-24T16:24:23.849 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-07-24T16:24:23.850 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-07-24T16:24:23.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.986+0000 7f6c318be640 1 -- 172.21.15.159:0/2015937678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c2c0d0fc0 msgr2=0x7f6c2c071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.986+0000 7f6c318be640 1 --2- 172.21.15.159:0/2015937678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c2c0d0fc0 0x7f6c2c071ca0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6c14005fd0 tx=0x7f6c1402a4a0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.986+0000 7f6c318be640 1 -- 172.21.15.159:0/2015937678 shutdown_connections 2024-07-24T16:24:23.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.986+0000 7f6c318be640 1 --2- 172.21.15.159:0/2015937678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c2c0d0fc0 0x7f6c2c071ca0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.986+0000 7f6c318be640 1 --2- 172.21.15.159:0/2015937678 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6c2c0b66e0 0x7f6c2c15bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.986+0000 7f6c318be640 1 -- 172.21.15.159:0/2015937678 >> 172.21.15.159:0/2015937678 conn(0x7f6c2c0b33c0 msgr2=0x7f6c2c0b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:23.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.986+0000 7f6c318be640 1 -- 172.21.15.159:0/2015937678 shutdown_connections 2024-07-24T16:24:23.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.986+0000 7f6c318be640 1 -- 172.21.15.159:0/2015937678 wait complete. 2024-07-24T16:24:23.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.987+0000 7f6c318be640 1 Processor -- start 2024-07-24T16:24:23.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.987+0000 7f6c318be640 1 -- start start 2024-07-24T16:24:23.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c318be640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c2c0721e0 0x7f6c2c150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:23.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c318be640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6c2c0b66e0 0x7f6c2c155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:23.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c318be640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c2c0d0fc0 0x7f6c2c1f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:23.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c318be640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c074430 con 0x7f6c2c0d0fc0 2024-07-24T16:24:23.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c318be640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c0742b0 con 0x7f6c2c0721e0 2024-07-24T16:24:23.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c318be640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6c2c0cf4c0 con 0x7f6c2c0b66e0 2024-07-24T16:24:23.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c2b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c2c0d0fc0 0x7f6c2c1f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:23.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c2b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c2c0d0fc0 0x7f6c2c1f4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59706/0 (socket says 172.21.15.159:59706) 2024-07-24T16:24:23.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c2b7fe640 1 -- 172.21.15.159:0/2575018670 learned_addr learned my addr 172.21.15.159:0/2575018670 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:23.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c23fff640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6c2c0b66e0 0x7f6c2c155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:23.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c2affd640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c2c0721e0 0x7f6c2c150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:23.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c2b7fe640 1 -- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6c2c0b66e0 msgr2=0x7f6c2c155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c2b7fe640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6c2c0b66e0 0x7f6c2c155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c2b7fe640 1 -- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c2c0721e0 msgr2=0x7f6c2c150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:23.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c2b7fe640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c2c0721e0 0x7f6c2c150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:23.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c2b7fe640 1 -- 172.21.15.159:0/2575018670 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c0cb9f0 con 0x7f6c2c0d0fc0 2024-07-24T16:24:23.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c23fff640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6c2c0b66e0 0x7f6c2c155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:23.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c2affd640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c2c0721e0 0x7f6c2c150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:23.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.988+0000 7f6c2b7fe640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c2c0d0fc0 0x7f6c2c1f4190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c780 tx=0x7f6c2400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:23.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.989+0000 7f6c28ff9640 1 -- 172.21.15.159:0/2575018670 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c24004b60 con 0x7f6c2c0d0fc0 2024-07-24T16:24:23.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.989+0000 7f6c28ff9640 1 -- 172.21.15.159:0/2575018670 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c24004df0 con 0x7f6c2c0d0fc0 2024-07-24T16:24:23.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.989+0000 7f6c318be640 1 -- 172.21.15.159:0/2575018670 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2c154770 con 0x7f6c2c0d0fc0 2024-07-24T16:24:23.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.989+0000 7f6c28ff9640 1 -- 172.21.15.159:0/2575018670 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400aa10 con 0x7f6c2c0d0fc0 2024-07-24T16:24:23.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.989+0000 7f6c318be640 1 -- 172.21.15.159:0/2575018670 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2c151610 con 0x7f6c2c0d0fc0 2024-07-24T16:24:23.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.990+0000 7f6c318be640 1 -- 172.21.15.159:0/2575018670 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c2c15bae0 con 0x7f6c2c0d0fc0 2024-07-24T16:24:23.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.990+0000 7f6c28ff9640 1 -- 172.21.15.159:0/2575018670 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6c2400abb0 con 0x7f6c2c0d0fc0 2024-07-24T16:24:23.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.991+0000 7f6c28ff9640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6c0c077010 0x7f6c0c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:23.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.991+0000 7f6c28ff9640 1 -- 172.21.15.159:0/2575018670 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6c24098e50 con 0x7f6c2c0d0fc0 2024-07-24T16:24:23.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.991+0000 7f6c2affd640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6c0c077010 0x7f6c0c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:23.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.992+0000 7f6c2affd640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6c0c077010 0x7f6c0c0794d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00abe0 tx=0x7f6c1c00a5c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:23.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:23.995+0000 7f6c28ff9640 1 -- 172.21.15.159:0/2575018670 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f6c24020070 con 0x7f6c2c0d0fc0 2024-07-24T16:24:24.180 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.178+0000 7f6c318be640 1 -- 172.21.15.159:0/2575018670 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f6c2c0cdef0 con 0x7f6c2c0d0fc0 2024-07-24T16:24:24.181 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.178+0000 7f6c28ff9640 1 -- 172.21.15.159:0/2575018670 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f6c24061e30 con 0x7f6c2c0d0fc0 2024-07-24T16:24:24.181 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:24.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.180+0000 7f6c318be640 1 -- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6c0c077010 msgr2=0x7f6c0c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.180+0000 7f6c318be640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6c0c077010 0x7f6c0c0794d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c00abe0 tx=0x7f6c1c00a5c0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.180+0000 7f6c318be640 1 -- 172.21.15.159:0/2575018670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c2c0d0fc0 msgr2=0x7f6c2c1f4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.180+0000 7f6c318be640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c2c0d0fc0 0x7f6c2c1f4190 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400c780 tx=0x7f6c2400cc40 comp rx=0 tx=0).stop 2024-07-24T16:24:24.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.181+0000 7f6c318be640 1 -- 172.21.15.159:0/2575018670 shutdown_connections 2024-07-24T16:24:24.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.181+0000 7f6c318be640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6c0c077010 0x7f6c0c0794d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.181+0000 7f6c318be640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6c2c0d0fc0 0x7f6c2c1f4190 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.181+0000 7f6c318be640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6c2c0b66e0 0x7f6c2c155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.181+0000 7f6c318be640 1 --2- 172.21.15.159:0/2575018670 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6c2c0721e0 0x7f6c2c150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.181+0000 7f6c318be640 1 -- 172.21.15.159:0/2575018670 >> 172.21.15.159:0/2575018670 conn(0x7f6c2c0b33c0 msgr2=0x7f6c2c0b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:24.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.181+0000 7f6c318be640 1 -- 172.21.15.159:0/2575018670 shutdown_connections 2024-07-24T16:24:24.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.181+0000 7f6c318be640 1 -- 172.21.15.159:0/2575018670 wait complete. 2024-07-24T16:24:24.194 INFO:teuthology.orchestra.run.smithi159.stdout:[{"version":27,"timestamp":"2024-07-24T16:23:56.516634+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"4804.732208"}]}] 2024-07-24T16:24:24.194 INFO:tasks.ceph_manager:config epoch is 27 2024-07-24T16:24:24.194 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-07-24T16:24:24.194 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-07-24T16:24:24.195 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-07-24T16:24:24.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.294+0000 7f69fbfc6640 1 -- 172.21.15.159:0/2012986084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f409af50 msgr2=0x7f69f415f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.294+0000 7f69fbfc6640 1 --2- 172.21.15.159:0/2012986084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f409af50 0x7f69f415f290 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f69f40cf050 tx=0x7f69e802ab40 comp rx=0 tx=0).stop 2024-07-24T16:24:24.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.294+0000 7f69fbfc6640 1 -- 172.21.15.159:0/2012986084 shutdown_connections 2024-07-24T16:24:24.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.294+0000 7f69fbfc6640 1 --2- 172.21.15.159:0/2012986084 >> v2:172.21.15.193:3300/0 conn(0x7f69f415b8b0 0x7f69f415f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.294+0000 7f69fbfc6640 1 --2- 172.21.15.159:0/2012986084 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f409af50 0x7f69f415f290 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.294+0000 7f69fbfc6640 1 -- 172.21.15.159:0/2012986084 >> 172.21.15.159:0/2012986084 conn(0x7f69f409aa20 msgr2=0x7f69f40d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:24.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.294+0000 7f69fbfc6640 1 -- 172.21.15.159:0/2012986084 shutdown_connections 2024-07-24T16:24:24.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.294+0000 7f69fbfc6640 1 -- 172.21.15.159:0/2012986084 wait complete. 2024-07-24T16:24:24.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.296+0000 7f69fbfc6640 1 Processor -- start 2024-07-24T16:24:24.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.296+0000 7f69fbfc6640 1 -- start start 2024-07-24T16:24:24.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.296+0000 7f69fbfc6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69f409af50 0x7f69f406f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:24.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.296+0000 7f69fbfc6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f415b4d0 0x7f69f41538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:24.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.296+0000 7f69fbfc6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69f415b8b0 0x7f69f40c6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:24.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.296+0000 7f69fbfc6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f69f40aee70 con 0x7f69f415b4d0 2024-07-24T16:24:24.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.296+0000 7f69fbfc6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f69f40aecf0 con 0x7f69f415b8b0 2024-07-24T16:24:24.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.296+0000 7f69fbfc6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f69f40aeff0 con 0x7f69f409af50 2024-07-24T16:24:24.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.296+0000 7f69f9561640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f415b4d0 0x7f69f41538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:24.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.296+0000 7f69f9561640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f415b4d0 0x7f69f41538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59714/0 (socket says 172.21.15.159:59714) 2024-07-24T16:24:24.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.296+0000 7f69f9561640 1 -- 172.21.15.159:0/661687511 learned_addr learned my addr 172.21.15.159:0/661687511 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:24.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69fa563640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69f415b8b0 0x7f69f40c6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:24.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69f9d62640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69f409af50 0x7f69f406f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:24.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69f9561640 1 -- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69f409af50 msgr2=0x7f69f406f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69f9561640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69f409af50 0x7f69f406f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69f9561640 1 -- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69f415b8b0 msgr2=0x7f69f40c6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69f9561640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69f415b8b0 0x7f69f40c6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69f9561640 1 -- 172.21.15.159:0/661687511 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f415eae0 con 0x7f69f415b4d0 2024-07-24T16:24:24.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69fa563640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69f415b8b0 0x7f69f40c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:24.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69f9561640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f415b4d0 0x7f69f41538f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009bf0 tx=0x7f69e802c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:24.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69f27fc640 1 -- 172.21.15.159:0/661687511 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8044070 con 0x7f69f415b4d0 2024-07-24T16:24:24.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69f27fc640 1 -- 172.21.15.159:0/661687511 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69e8004250 con 0x7f69f415b4d0 2024-07-24T16:24:24.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69f27fc640 1 -- 172.21.15.159:0/661687511 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e80046a0 con 0x7f69f415b4d0 2024-07-24T16:24:24.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69fbfc6640 1 -- 172.21.15.159:0/661687511 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f415edc0 con 0x7f69f415b4d0 2024-07-24T16:24:24.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.297+0000 7f69fbfc6640 1 -- 172.21.15.159:0/661687511 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f40c6380 con 0x7f69f415b4d0 2024-07-24T16:24:24.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.298+0000 7f69fbfc6640 1 -- 172.21.15.159:0/661687511 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f4070750 con 0x7f69f415b4d0 2024-07-24T16:24:24.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.299+0000 7f69f27fc640 1 -- 172.21.15.159:0/661687511 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f69e8036400 con 0x7f69f415b4d0 2024-07-24T16:24:24.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.299+0000 7f69f27fc640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69e0077010 0x7f69e00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:24.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.299+0000 7f69f27fc640 1 -- 172.21.15.159:0/661687511 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f69e80b92e0 con 0x7f69f415b4d0 2024-07-24T16:24:24.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.299+0000 7f69f9d62640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69e0077010 0x7f69e00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:24.303 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.300+0000 7f69f9d62640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69e0077010 0x7f69e00794d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f69ec001640 tx=0x7f69ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:24.306 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.303+0000 7f69f27fc640 1 -- 172.21.15.159:0/661687511 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f69e8032030 con 0x7f69f415b4d0 2024-07-24T16:24:24.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.540+0000 7f69fbfc6640 1 -- 172.21.15.159:0/661687511 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f69f40b3ee0 con 0x7f69f415b4d0 2024-07-24T16:24:24.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.542+0000 7f69f27fc640 1 -- 172.21.15.159:0/661687511 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+191107 (secure 0 0 0) 0x7f69e8082230 con 0x7f69f415b4d0 2024-07-24T16:24:24.547 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:24.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.545+0000 7f69fbfc6640 1 -- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69e0077010 msgr2=0x7f69e00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.545+0000 7f69fbfc6640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69e0077010 0x7f69e00794d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f69ec001640 tx=0x7f69ec009040 comp rx=0 tx=0).stop 2024-07-24T16:24:24.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.545+0000 7f69fbfc6640 1 -- 172.21.15.159:0/661687511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f415b4d0 msgr2=0x7f69f41538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.545+0000 7f69fbfc6640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f415b4d0 0x7f69f41538f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f69e8009bf0 tx=0x7f69e802c8b0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.545+0000 7f69fbfc6640 1 -- 172.21.15.159:0/661687511 shutdown_connections 2024-07-24T16:24:24.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.545+0000 7f69fbfc6640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69e0077010 0x7f69e00794d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.545+0000 7f69fbfc6640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69f415b8b0 0x7f69f40c6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.545+0000 7f69fbfc6640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69f415b4d0 0x7f69f41538f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.545+0000 7f69fbfc6640 1 --2- 172.21.15.159:0/661687511 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69f409af50 0x7f69f406f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.545+0000 7f69fbfc6640 1 -- 172.21.15.159:0/661687511 >> 172.21.15.159:0/661687511 conn(0x7f69f409aa20 msgr2=0x7f69f40cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:24.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.545+0000 7f69fbfc6640 1 -- 172.21.15.159:0/661687511 shutdown_connections 2024-07-24T16:24:24.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.545+0000 7f69fbfc6640 1 -- 172.21.15.159:0/661687511 wait complete. 2024-07-24T16:24:24.558 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6832","nonce":222319347},{"type":"v1","addr":"172.21.15.193:6833","nonce":222319347}]},"active_addr":"172.21.15.193:6833/222319347","active_change":"2024-07-24T16:23:50.353480+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4123,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":3580844224}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":1903087136}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":1332350307}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.193:0","nonce":3685404778}]}]} 2024-07-24T16:24:24.562 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-07-24T16:24:24.562 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-07-24T16:24:24.562 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:24.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.662+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/221641111 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7e8815d680 msgr2=0x7f7e880b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.662+0000 7f7e8ea5e640 1 --2- 172.21.15.159:0/221641111 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7e8815d680 0x7f7e880b3ed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009830 tx=0x7f7e7802a510 comp rx=0 tx=0).stop 2024-07-24T16:24:24.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.662+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/221641111 shutdown_connections 2024-07-24T16:24:24.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.662+0000 7f7e8ea5e640 1 --2- 172.21.15.159:0/221641111 >> v2:172.21.15.193:3300/0 conn(0x7f7e880b4b20 0x7f7e880b4410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.662+0000 7f7e8ea5e640 1 --2- 172.21.15.159:0/221641111 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7e8815d680 0x7f7e880b3ed0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.662+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/221641111 >> 172.21.15.159:0/221641111 conn(0x7f7e8806d450 msgr2=0x7f7e8806d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:24.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.663+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/221641111 shutdown_connections 2024-07-24T16:24:24.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.663+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/221641111 wait complete. 2024-07-24T16:24:24.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.664+0000 7f7e8ea5e640 1 Processor -- start 2024-07-24T16:24:24.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.664+0000 7f7e8ea5e640 1 -- start start 2024-07-24T16:24:24.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e8ea5e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e880af380 0x7f7e8814b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:24.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e8ea5e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e880b4b20 0x7f7e880cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:24.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e8ea5e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7e8815d680 0x7f7e8814e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:24.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e8ea5e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7e880adfa0 con 0x7f7e880af380 2024-07-24T16:24:24.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e8ea5e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7e88070550 con 0x7f7e880b4b20 2024-07-24T16:24:24.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e8ea5e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7e880ae120 con 0x7f7e8815d680 2024-07-24T16:24:24.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e87fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e880af380 0x7f7e8814b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:24.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e87fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e880af380 0x7f7e8814b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59720/0 (socket says 172.21.15.159:59720) 2024-07-24T16:24:24.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e87fff640 1 -- 172.21.15.159:0/2814907639 learned_addr learned my addr 172.21.15.159:0/2814907639 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:24.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e8cffb640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7e8815d680 0x7f7e8814e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:24.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e877fe640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e880b4b20 0x7f7e880cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:24.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e87fff640 1 -- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7e8815d680 msgr2=0x7f7e8814e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e87fff640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7e8815d680 0x7f7e8814e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e87fff640 1 -- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e880b4b20 msgr2=0x7f7e880cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e87fff640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e880b4b20 0x7f7e880cd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e87fff640 1 -- 172.21.15.159:0/2814907639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e8814b7a0 con 0x7f7e880af380 2024-07-24T16:24:24.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e87fff640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e880af380 0x7f7e8814b260 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e78000c00 tx=0x7f7e78033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:24.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e84ff9640 1 -- 172.21.15.159:0/2814907639 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78031d60 con 0x7f7e880af380 2024-07-24T16:24:24.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e84ff9640 1 -- 172.21.15.159:0/2814907639 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e78033e10 con 0x7f7e880af380 2024-07-24T16:24:24.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/2814907639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e880cc820 con 0x7f7e880af380 2024-07-24T16:24:24.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e84ff9640 1 -- 172.21.15.159:0/2814907639 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78033310 con 0x7f7e880af380 2024-07-24T16:24:24.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.665+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/2814907639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e880ccde0 con 0x7f7e880af380 2024-07-24T16:24:24.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.666+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/2814907639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e880ae5d0 con 0x7f7e880af380 2024-07-24T16:24:24.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.667+0000 7f7e84ff9640 1 -- 172.21.15.159:0/2814907639 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f7e780334b0 con 0x7f7e880af380 2024-07-24T16:24:24.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.667+0000 7f7e84ff9640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7e74077040 0x7f7e74079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:24.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.668+0000 7f7e84ff9640 1 -- 172.21.15.159:0/2814907639 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7e780b9cd0 con 0x7f7e880af380 2024-07-24T16:24:24.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.668+0000 7f7e877fe640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7e74077040 0x7f7e74079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:24.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.668+0000 7f7e877fe640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7e74077040 0x7f7e74079500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7e8814bff0 tx=0x7f7e7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:24.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.671+0000 7f7e84ff9640 1 -- 172.21.15.159:0/2814907639 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f7e7803f030 con 0x7f7e880af380 2024-07-24T16:24:24.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.855+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/2814907639 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e8806da40 con 0x7f7e880af380 2024-07-24T16:24:24.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.856+0000 7f7e84ff9640 1 -- 172.21.15.159:0/2814907639 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f7e780825d0 con 0x7f7e880af380 2024-07-24T16:24:24.859 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:24.859 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:07.801757+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:00.757174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:01.708421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-24T16:24:05.423097+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:24.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.858+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7e74077040 msgr2=0x7f7e74079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.858+0000 7f7e8ea5e640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7e74077040 0x7f7e74079500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7e8814bff0 tx=0x7f7e7c009040 comp rx=0 tx=0).stop 2024-07-24T16:24:24.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.858+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/2814907639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e880af380 msgr2=0x7f7e8814b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.858+0000 7f7e8ea5e640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e880af380 0x7f7e8814b260 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7e78000c00 tx=0x7f7e78033c20 comp rx=0 tx=0).stop 2024-07-24T16:24:24.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.858+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/2814907639 shutdown_connections 2024-07-24T16:24:24.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.858+0000 7f7e8ea5e640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7e74077040 0x7f7e74079500 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.858+0000 7f7e8ea5e640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7e8815d680 0x7f7e8814e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.858+0000 7f7e8ea5e640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7e880b4b20 0x7f7e880cd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.858+0000 7f7e8ea5e640 1 --2- 172.21.15.159:0/2814907639 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7e880af380 0x7f7e8814b260 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.858+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/2814907639 >> 172.21.15.159:0/2814907639 conn(0x7f7e8806d450 msgr2=0x7f7e880ad890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:24.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.858+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/2814907639 shutdown_connections 2024-07-24T16:24:24.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.858+0000 7f7e8ea5e640 1 -- 172.21.15.159:0/2814907639 wait complete. 2024-07-24T16:24:24.872 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-07-24T16:24:24.872 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:24.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.973+0000 7fcbd28e4640 1 -- 172.21.15.159:0/2834988585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbb4003a00 msgr2=0x7fcbb4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.973+0000 7fcbd28e4640 1 --2- 172.21.15.159:0/2834988585 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbb4003a00 0x7fcbb4003e20 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc009d00 tx=0x7fcbb4005830 comp rx=0 tx=0).stop 2024-07-24T16:24:24.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.973+0000 7fcbd0e81640 1 -- 172.21.15.159:0/2834988585 reap_dead start 2024-07-24T16:24:24.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.973+0000 7fcbd28e4640 1 -- 172.21.15.159:0/2834988585 shutdown_connections 2024-07-24T16:24:24.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.973+0000 7fcbd28e4640 1 -- 172.21.15.159:0/2834988585 >> 172.21.15.159:0/2834988585 conn(0x7fcbcc0b2230 msgr2=0x7fcbcc0b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:24.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.973+0000 7fcbd28e4640 1 -- 172.21.15.159:0/2834988585 shutdown_connections 2024-07-24T16:24:24.976 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.973+0000 7fcbd28e4640 1 -- 172.21.15.159:0/2834988585 wait complete. 2024-07-24T16:24:24.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.974+0000 7fcbd28e4640 1 Processor -- start 2024-07-24T16:24:24.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.974+0000 7fcbd28e4640 1 -- start start 2024-07-24T16:24:24.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.975+0000 7fcbd28e4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcbb4003a00 0x7fcbcc0aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:24.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.975+0000 7fcbd28e4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbcc15c9c0 0x7fcbcc0cba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:24.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.975+0000 7fcbd28e4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbcc0cbfa0 0x7fcbcc1f1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:24.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.975+0000 7fcbd28e4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc0cd220 con 0x7fcbcc0cbfa0 2024-07-24T16:24:24.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.975+0000 7fcbd28e4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcbcc0703f0 con 0x7fcbcc15c9c0 2024-07-24T16:24:24.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.975+0000 7fcbd28e4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcbcc0cd3a0 con 0x7fcbb4003a00 2024-07-24T16:24:24.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.975+0000 7fcbd0e81640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbcc0cbfa0 0x7fcbcc1f1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:24.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.975+0000 7fcbd0e81640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbcc0cbfa0 0x7fcbcc1f1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59732/0 (socket says 172.21.15.159:59732) 2024-07-24T16:24:24.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.975+0000 7fcbd0e81640 1 -- 172.21.15.159:0/355934799 learned_addr learned my addr 172.21.15.159:0/355934799 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:24.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.975+0000 7fcbcb7fe640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbcc15c9c0 0x7fcbcc0cba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:24.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.975+0000 7fcbcbfff640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcbb4003a00 0x7fcbcc0aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:24.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.976+0000 7fcbd0e81640 1 -- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcbb4003a00 msgr2=0x7fcbcc0aee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.976+0000 7fcbd0e81640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcbb4003a00 0x7fcbcc0aee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.976+0000 7fcbd0e81640 1 -- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbcc15c9c0 msgr2=0x7fcbcc0cba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:24.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.976+0000 7fcbd0e81640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbcc15c9c0 0x7fcbcc0cba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:24.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.976+0000 7fcbd0e81640 1 -- 172.21.15.159:0/355934799 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbcc15cf80 con 0x7fcbcc0cbfa0 2024-07-24T16:24:24.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.976+0000 7fcbd0e81640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbcc0cbfa0 0x7fcbcc1f1810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4005fd0 tx=0x7fcbc400f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:24.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.976+0000 7fcbc8ff9640 1 -- 172.21.15.159:0/355934799 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4004b20 con 0x7fcbcc0cbfa0 2024-07-24T16:24:24.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.976+0000 7fcbc8ff9640 1 -- 172.21.15.159:0/355934799 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcbc4004cc0 con 0x7fcbcc0cbfa0 2024-07-24T16:24:24.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.976+0000 7fcbc8ff9640 1 -- 172.21.15.159:0/355934799 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbc4003bd0 con 0x7fcbcc0cbfa0 2024-07-24T16:24:24.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.976+0000 7fcbd28e4640 1 -- 172.21.15.159:0/355934799 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbcc15d260 con 0x7fcbcc0cbfa0 2024-07-24T16:24:24.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.976+0000 7fcbd28e4640 1 -- 172.21.15.159:0/355934799 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbcc15d820 con 0x7fcbcc0cbfa0 2024-07-24T16:24:24.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.977+0000 7fcbd28e4640 1 -- 172.21.15.159:0/355934799 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbcc0cfed0 con 0x7fcbcc0cbfa0 2024-07-24T16:24:24.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.978+0000 7fcbc8ff9640 1 -- 172.21.15.159:0/355934799 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fcbc4004030 con 0x7fcbcc0cbfa0 2024-07-24T16:24:24.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.978+0000 7fcbc8ff9640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcbb8077010 0x7fcbb80794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:24.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.978+0000 7fcbc8ff9640 1 -- 172.21.15.159:0/355934799 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcbc4099350 con 0x7fcbcc0cbfa0 2024-07-24T16:24:24.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.978+0000 7fcbcbfff640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcbb8077010 0x7fcbb80794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:24.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.979+0000 7fcbcbfff640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcbb8077010 0x7fcbb80794d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc035000 tx=0x7fcbbc0046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:24.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:24.982+0000 7fcbc8ff9640 1 -- 172.21.15.159:0/355934799 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fcbc4061ce0 con 0x7fcbcc0cbfa0 2024-07-24T16:24:25.169 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.166+0000 7fcbd28e4640 1 -- 172.21.15.159:0/355934799 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcbcc1f5080 con 0x7fcbcc0cbfa0 2024-07-24T16:24:25.170 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.167+0000 7fcbc8ff9640 1 -- 172.21.15.159:0/355934799 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7fcbc4066230 con 0x7fcbcc0cbfa0 2024-07-24T16:24:25.170 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:25.170 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:07.801757+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:00.757174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:01.708421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-24T16:24:05.423097+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.170+0000 7fcbd28e4640 1 -- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcbb8077010 msgr2=0x7fcbb80794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.170+0000 7fcbd28e4640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcbb8077010 0x7fcbb80794d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc035000 tx=0x7fcbbc0046c0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.170+0000 7fcbd28e4640 1 -- 172.21.15.159:0/355934799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbcc0cbfa0 msgr2=0x7fcbcc1f1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.170+0000 7fcbd28e4640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbcc0cbfa0 0x7fcbcc1f1810 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcbc4005fd0 tx=0x7fcbc400f3c0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.170+0000 7fcbd28e4640 1 -- 172.21.15.159:0/355934799 shutdown_connections 2024-07-24T16:24:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.170+0000 7fcbd28e4640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcbb8077010 0x7fcbb80794d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.170+0000 7fcbd28e4640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcbcc0cbfa0 0x7fcbcc1f1810 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.170+0000 7fcbd28e4640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcbcc15c9c0 0x7fcbcc0cba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.170+0000 7fcbd28e4640 1 --2- 172.21.15.159:0/355934799 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcbb4003a00 0x7fcbcc0aee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.170+0000 7fcbd28e4640 1 -- 172.21.15.159:0/355934799 >> 172.21.15.159:0/355934799 conn(0x7fcbcc0b2230 msgr2=0x7fcbcc072b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.170+0000 7fcbd28e4640 1 -- 172.21.15.159:0/355934799 shutdown_connections 2024-07-24T16:24:25.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.170+0000 7fcbd28e4640 1 -- 172.21.15.159:0/355934799 wait complete. 2024-07-24T16:24:25.184 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-07-24T16:24:25.184 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-07-24T16:24:25.185 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-07-24T16:24:25.185 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-07-24T16:24:25.185 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-07-24T16:24:25.186 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-07-24T16:24:25.186 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-07-24T16:24:25.187 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-07-24T16:24:25.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.359+0000 7ff696ffd640 1 -- 172.21.15.159:0/3175799647 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6880047a0 con 0x7ff69806f240 2024-07-24T16:24:25.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.360+0000 7ff69e761640 1 -- 172.21.15.159:0/3175799647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff69806f240 msgr2=0x7ff69806e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.363 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.360+0000 7ff69e761640 1 --2- 172.21.15.159:0/3175799647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff69806f240 0x7ff69806e1f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff688005fd0 tx=0x7ff68802a540 comp rx=0 tx=0).stop 2024-07-24T16:24:25.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7f01e20d0640 1 -- 172.21.15.159:0/2688192132 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01d40e68a0 msgr2=0x7f01d40e6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7f01e20d0640 1 --2- 172.21.15.159:0/2688192132 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01d40e68a0 0x7f01d40e6c80 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f01d8009900 tx=0x7f01d802a650 comp rx=0 tx=0).stop 2024-07-24T16:24:25.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7ff69e761640 1 -- 172.21.15.159:0/3175799647 shutdown_connections 2024-07-24T16:24:25.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7ff69e761640 1 --2- 172.21.15.159:0/3175799647 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff698071590 0x7ff698071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7ff69e761640 1 --2- 172.21.15.159:0/3175799647 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff69806f240 0x7ff69806e1f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7ff69e761640 1 -- 172.21.15.159:0/3175799647 >> 172.21.15.159:0/3175799647 conn(0x7ff6980b36f0 msgr2=0x7ff6980b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7ff69e761640 1 -- 172.21.15.159:0/3175799647 shutdown_connections 2024-07-24T16:24:25.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7f01e20d0640 1 -- 172.21.15.159:0/2688192132 shutdown_connections 2024-07-24T16:24:25.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7f01e20d0640 1 --2- 172.21.15.159:0/2688192132 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01d40e68a0 0x7f01d40e6c80 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7ff69e761640 1 -- 172.21.15.159:0/3175799647 wait complete. 2024-07-24T16:24:25.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7f892394b640 1 -- 172.21.15.159:0/906005956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f891c06ff20 msgr2=0x7f891c153570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7f892394b640 1 --2- 172.21.15.159:0/906005956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f891c06ff20 0x7f891c153570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8914005fd0 tx=0x7f891402a810 comp rx=0 tx=0).stop 2024-07-24T16:24:25.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7f892394b640 1 -- 172.21.15.159:0/906005956 shutdown_connections 2024-07-24T16:24:25.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7f892394b640 1 --2- 172.21.15.159:0/906005956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f891c06ff20 0x7f891c153570 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7f892394b640 1 --2- 172.21.15.159:0/906005956 >> v2:172.21.15.193:3300/0 conn(0x7f891c15eee0 0x7f891c153030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7f892394b640 1 -- 172.21.15.159:0/906005956 >> 172.21.15.159:0/906005956 conn(0x7f891c06cbc0 msgr2=0x7f891c0b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7f01e20d0640 1 -- 172.21.15.159:0/2688192132 >> 172.21.15.159:0/2688192132 conn(0x7f01d4055350 msgr2=0x7f01d4055760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.361+0000 7f01e20d0640 1 -- 172.21.15.159:0/2688192132 shutdown_connections 2024-07-24T16:24:25.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.362+0000 7f892394b640 1 -- 172.21.15.159:0/906005956 shutdown_connections 2024-07-24T16:24:25.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.362+0000 7f0cee72c640 1 -- 172.21.15.159:0/1715232001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce80cf7e0 msgr2=0x7f0ce80b2f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.362+0000 7f0cee72c640 1 --2- 172.21.15.159:0/1715232001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce80cf7e0 0x7f0ce80b2f10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8073e30 tx=0x7f0ce002a980 comp rx=0 tx=0).stop 2024-07-24T16:24:25.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.362+0000 7f0cee72c640 1 -- 172.21.15.159:0/1715232001 shutdown_connections 2024-07-24T16:24:25.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.362+0000 7f0cee72c640 1 --2- 172.21.15.159:0/1715232001 >> v2:172.21.15.193:3300/0 conn(0x7f0ce8074710 0x7f0ce8161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.362+0000 7f0cee72c640 1 --2- 172.21.15.159:0/1715232001 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce80cf7e0 0x7f0ce80b2f10 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8073e30 tx=0x7f0ce002a980 comp rx=0 tx=0).stop 2024-07-24T16:24:25.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.362+0000 7f0cee72c640 1 -- 172.21.15.159:0/1715232001 >> 172.21.15.159:0/1715232001 conn(0x7f0ce806e1a0 msgr2=0x7f0ce806e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.362+0000 7f01e20d0640 1 -- 172.21.15.159:0/2688192132 wait complete. 2024-07-24T16:24:25.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.363+0000 7f0cee72c640 1 -- 172.21.15.159:0/1715232001 shutdown_connections 2024-07-24T16:24:25.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.363+0000 7f0cee72c640 1 -- 172.21.15.159:0/1715232001 wait complete. 2024-07-24T16:24:25.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.363+0000 7ff69e761640 1 Processor -- start 2024-07-24T16:24:25.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.363+0000 7ff69e761640 1 -- start start 2024-07-24T16:24:25.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.362+0000 7f892394b640 1 -- 172.21.15.159:0/906005956 wait complete. 2024-07-24T16:24:25.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.363+0000 7f892394b640 1 Processor -- start 2024-07-24T16:24:25.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.363+0000 7f892394b640 1 -- start start 2024-07-24T16:24:25.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.364+0000 7f01e20d0640 1 Processor -- start 2024-07-24T16:24:25.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.364+0000 7ff69e761640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff69806f240 0x7ff6981450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.364+0000 7ff69e761640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff698071590 0x7ff698161400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.364+0000 7ff69e761640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff69815de30 0x7ff698161940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.364+0000 7f0cee72c640 1 Processor -- start 2024-07-24T16:24:25.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7ff69e761640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff698070310 con 0x7ff698071590 2024-07-24T16:24:25.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7ff69e761640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff698070190 con 0x7ff69815de30 2024-07-24T16:24:25.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7ff69e761640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff698070490 con 0x7ff69806f240 2024-07-24T16:24:25.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f0cee72c640 1 -- start start 2024-07-24T16:24:25.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7ff6977fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff698071590 0x7ff698161400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f892394b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f891c06fb40 0x7f891c154b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7ff6977fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff698071590 0x7ff698161400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59754/0 (socket says 172.21.15.159:59754) 2024-07-24T16:24:25.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7ff6977fe640 1 -- 172.21.15.159:0/973809134 learned_addr learned my addr 172.21.15.159:0/973809134 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7ff69ccfe640 1 --2- 172.21.15.159:0/973809134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff69815de30 0x7ff698161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f892394b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f891c06ff20 0x7f891c14af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7fbade9ae640 1 -- 172.21.15.159:0/1542660494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbad8072e50 msgr2=0x7fbad815be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7fbade9ae640 1 --2- 172.21.15.159:0/1542660494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbad8072e50 0x7fbad815be60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbac8005fd0 tx=0x7fbac802a8d0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7fbade9ae640 1 -- 172.21.15.159:0/1542660494 shutdown_connections 2024-07-24T16:24:25.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7fbade9ae640 1 --2- 172.21.15.159:0/1542660494 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbad8072e50 0x7fbad815be60 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbac8005fd0 tx=0x7fbac802a8d0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7fbade9ae640 1 --2- 172.21.15.159:0/1542660494 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbad8073c50 0x7fbad8072910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.364+0000 7f01e20d0640 1 -- start start 2024-07-24T16:24:25.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7fbade9ae640 1 -- 172.21.15.159:0/1542660494 >> 172.21.15.159:0/1542660494 conn(0x7fbad806c560 msgr2=0x7fbad806c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f01e20d0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01d4006f20 0x7f01d40525b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f8920ee6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f891c06ff20 0x7f891c14af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f8920ee6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f891c06ff20 0x7f891c14af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59756/0 (socket says 172.21.15.159:59756) 2024-07-24T16:24:25.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f89216e7640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f891c06fb40 0x7f891c154b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f89216e7640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f891c06fb40 0x7f891c154b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:33946/0 (socket says 172.21.15.159:33946) 2024-07-24T16:24:25.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f01e20d0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01d4056f90 0x7f01d40dac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f8920ee6640 1 -- 172.21.15.159:0/3255526136 learned_addr learned my addr 172.21.15.159:0/3255526136 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f892394b640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f891c15eee0 0x7f891c204720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e10ce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01d4006f20 0x7f01d40525b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e10ce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01d4006f20 0x7f01d40525b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59772/0 (socket says 172.21.15.159:59772) 2024-07-24T16:24:25.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e08cd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01d4056f90 0x7f01d40dac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e08cd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01d4056f90 0x7f01d40dac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:33948/0 (socket says 172.21.15.159:33948) 2024-07-24T16:24:25.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f892394b640 1 -- 172.21.15.159:0/3255526136 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f891c06e5b0 con 0x7f891c06ff20 2024-07-24T16:24:25.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f8921ee8640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f891c15eee0 0x7f891c204720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e20d0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01d40e68a0 0x7f01d40db190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e20d0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f01d40e3fd0 con 0x7f01d4006f20 2024-07-24T16:24:25.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e20d0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f01d40e3e50 con 0x7f01d40e68a0 2024-07-24T16:24:25.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e20d0640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f01d40e4150 con 0x7f01d4056f90 2024-07-24T16:24:25.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e10ce640 1 -- 172.21.15.159:0/952492291 learned_addr learned my addr 172.21.15.159:0/952492291 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f892394b640 1 -- 172.21.15.159:0/3255526136 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f891c153d80 con 0x7f891c15eee0 2024-07-24T16:24:25.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f892394b640 1 -- 172.21.15.159:0/3255526136 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f891c06e730 con 0x7f891c06fb40 2024-07-24T16:24:25.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f0cee72c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce8074710 0x7f0ce81f7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7ff6977fe640 1 -- 172.21.15.159:0/973809134 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff69806f240 msgr2=0x7ff6981450d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T16:24:25.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7ff6977fe640 1 --2- 172.21.15.159:0/973809134 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff69806f240 0x7ff6981450d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7ff6977fe640 1 -- 172.21.15.159:0/973809134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff69815de30 msgr2=0x7ff698161940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7ff6977fe640 1 --2- 172.21.15.159:0/973809134 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff69815de30 0x7ff698161940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7ff6977fe640 1 -- 172.21.15.159:0/973809134 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff698159590 con 0x7ff698071590 2024-07-24T16:24:25.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e18cf640 1 --2- 172.21.15.159:0/952492291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01d40e68a0 0x7f01d40db190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f0cee72c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0ce8161650 0x7f0ce8150200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f0cee72c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ce81509a0 0x7f0ce80aecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f4a03c38640 1 -- 172.21.15.159:0/1675002307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49e4003a80 msgr2=0x7f49e4003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f0cee72c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce815e230 con 0x7f0ce8074710 2024-07-24T16:24:25.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f0cee72c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0ce80b3660 con 0x7f0ce81509a0 2024-07-24T16:24:25.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f0cee72c640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0ce815e3b0 con 0x7f0ce8161650 2024-07-24T16:24:25.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f4a03c38640 1 --2- 172.21.15.159:0/1675002307 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49e4003a80 0x7f49e4003ea0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f49f4006fb0 tx=0x7f49e4005830 comp rx=0 tx=0).stop 2024-07-24T16:24:25.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f4a021d5640 1 -- 172.21.15.159:0/1675002307 reap_dead start 2024-07-24T16:24:25.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e08cd640 1 -- 172.21.15.159:0/952492291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01d40e68a0 msgr2=0x7f01d40db190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e08cd640 1 --2- 172.21.15.159:0/952492291 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01d40e68a0 0x7f01d40db190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e08cd640 1 -- 172.21.15.159:0/952492291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01d4006f20 msgr2=0x7f01d40525b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e08cd640 1 --2- 172.21.15.159:0/952492291 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01d4006f20 0x7f01d40525b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f832658b640 1 -- 172.21.15.159:0/1671675383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8320071310 msgr2=0x7f8320071780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f832658b640 1 --2- 172.21.15.159:0/1671675383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8320071310 0x7f8320071780 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8318005fd0 tx=0x7f831802a8b0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f832658b640 1 -- 172.21.15.159:0/1671675383 shutdown_connections 2024-07-24T16:24:25.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f832658b640 1 --2- 172.21.15.159:0/1671675383 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8320071310 0x7f8320071780 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f832658b640 1 --2- 172.21.15.159:0/1671675383 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f832006fd50 0x7f8320070130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.365+0000 7f832658b640 1 -- 172.21.15.159:0/1671675383 >> 172.21.15.159:0/1671675383 conn(0x7f83200d1490 msgr2=0x7f83200d1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e08cd640 1 -- 172.21.15.159:0/952492291 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d40500f0 con 0x7f01d4056f90 2024-07-24T16:24:25.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f832658b640 1 -- 172.21.15.159:0/1671675383 shutdown_connections 2024-07-24T16:24:25.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f832658b640 1 -- 172.21.15.159:0/1671675383 wait complete. 2024-07-24T16:24:25.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7fbade9ae640 1 -- 172.21.15.159:0/1542660494 shutdown_connections 2024-07-24T16:24:25.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f4a03c38640 1 -- 172.21.15.159:0/1675002307 shutdown_connections 2024-07-24T16:24:25.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f4a03c38640 1 -- 172.21.15.159:0/1675002307 >> 172.21.15.159:0/1675002307 conn(0x7f49fc06c560 msgr2=0x7f49fc06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f01e08cd640 1 --2- 172.21.15.159:0/952492291 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01d4056f90 0x7f01d40dac50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00c430 tx=0x7f01cc00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f0ceccc9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ce81509a0 0x7f0ce80aecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f0ceccc9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ce81509a0 0x7f0ce80aecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:56740/0 (socket says 172.21.15.159:56740) 2024-07-24T16:24:25.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f0ceccc9640 1 -- 172.21.15.159:0/786075008 learned_addr learned my addr 172.21.15.159:0/786075008 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f0ce77fe640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0ce8161650 0x7f0ce8150200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f8920ee6640 1 -- 172.21.15.159:0/3255526136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f891c06fb40 msgr2=0x7f891c154b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f8920ee6640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f891c06fb40 0x7f891c154b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f8920ee6640 1 -- 172.21.15.159:0/3255526136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f891c15eee0 msgr2=0x7f891c204720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f8920ee6640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f891c15eee0 0x7f891c204720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.366+0000 7f8920ee6640 1 -- 172.21.15.159:0/3255526136 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891c155060 con 0x7f891c06ff20 2024-07-24T16:24:25.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f89216e7640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f891c06fb40 0x7f891c154b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:25.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f8921ee8640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f891c15eee0 0x7f891c204720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:25.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7fbade9ae640 1 -- 172.21.15.159:0/1542660494 wait complete. 2024-07-24T16:24:25.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f01d1ffb640 1 -- 172.21.15.159:0/952492291 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc017070 con 0x7f01d4056f90 2024-07-24T16:24:25.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f8920ee6640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f891c06ff20 0x7f891c14af00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f890c00e9f0 tx=0x7f890c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f0ce7fff640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce8074710 0x7f0ce81f7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f4a03c38640 1 -- 172.21.15.159:0/1675002307 shutdown_connections 2024-07-24T16:24:25.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f0ceccc9640 1 -- 172.21.15.159:0/786075008 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0ce8161650 msgr2=0x7f0ce8150200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f0ceccc9640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0ce8161650 0x7f0ce8150200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f0ceccc9640 1 -- 172.21.15.159:0/786075008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce8074710 msgr2=0x7f0ce81f7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f0ceccc9640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0ce8074710 0x7f0ce81f7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f0ceccc9640 1 -- 172.21.15.159:0/786075008 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ce81f8180 con 0x7f0ce81509a0 2024-07-24T16:24:25.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f8911ffb640 1 -- 172.21.15.159:0/3255526136 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c00cb70 con 0x7f891c06ff20 2024-07-24T16:24:25.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f8911ffb640 1 -- 172.21.15.159:0/3255526136 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f890c00ce00 con 0x7f891c06ff20 2024-07-24T16:24:25.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f892394b640 1 -- 172.21.15.159:0/3255526136 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891c205170 con 0x7f891c06ff20 2024-07-24T16:24:25.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f01e20d0640 1 -- 172.21.15.159:0/952492291 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d4181400 con 0x7f01d4056f90 2024-07-24T16:24:25.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7f01e20d0640 1 -- 172.21.15.159:0/952492291 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d4181ee0 con 0x7f01d4056f90 2024-07-24T16:24:25.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.367+0000 7ff6977fe640 1 --2- 172.21.15.159:0/973809134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff698071590 0x7ff698161400 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00c370 tx=0x7ff68c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.368+0000 7f832658b640 1 Processor -- start 2024-07-24T16:24:25.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.368+0000 7f832658b640 1 -- start start 2024-07-24T16:24:25.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.368+0000 7f8911ffb640 1 -- 172.21.15.159:0/3255526136 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f890c010690 con 0x7f891c06ff20 2024-07-24T16:24:25.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.368+0000 7f4a03c38640 1 -- 172.21.15.159:0/1675002307 wait complete. 2024-07-24T16:24:25.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.368+0000 7f0ceccc9640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ce81509a0 0x7f0ce80aecb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00b410 tx=0x7f0cdc00b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.368+0000 7f01d1ffb640 1 -- 172.21.15.159:0/952492291 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01cc0052f0 con 0x7f01d4056f90 2024-07-24T16:24:25.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.368+0000 7f892394b640 1 -- 172.21.15.159:0/3255526136 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f891c154320 con 0x7f891c06ff20 2024-07-24T16:24:25.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.369+0000 7f832658b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f832006fd50 0x7f83200b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.369+0000 7f832658b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8320071310 0x7f832015bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.369+0000 7f832658b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83200b4540 0x7f8320150410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.369+0000 7f832658b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f83200b5e00 con 0x7f8320071310 2024-07-24T16:24:25.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.369+0000 7f832658b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8320071cc0 con 0x7f832006fd50 2024-07-24T16:24:25.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.369+0000 7f832658b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f83201fc3f0 con 0x7f83200b4540 2024-07-24T16:24:25.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.369+0000 7ff694ff9640 1 -- 172.21.15.159:0/973809134 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c017070 con 0x7ff698071590 2024-07-24T16:24:25.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.369+0000 7ff694ff9640 1 -- 172.21.15.159:0/973809134 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff68c0053c0 con 0x7ff698071590 2024-07-24T16:24:25.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.369+0000 7ff694ff9640 1 -- 172.21.15.159:0/973809134 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff68c003850 con 0x7ff698071590 2024-07-24T16:24:25.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.368+0000 7f01d1ffb640 1 -- 172.21.15.159:0/952492291 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01cc003850 con 0x7f01d4056f90 2024-07-24T16:24:25.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.369+0000 7fbade9ae640 1 Processor -- start 2024-07-24T16:24:25.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.369+0000 7f01c77fe640 1 -- 172.21.15.159:0/952492291 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f01bc001030 con 0x7f01d4056f90 2024-07-24T16:24:25.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.369+0000 7fbade9ae640 1 -- start start 2024-07-24T16:24:25.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f8324d88640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8320071310 0x7f832015bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f8324d88640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8320071310 0x7f832015bae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59788/0 (socket says 172.21.15.159:59788) 2024-07-24T16:24:25.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f8911ffb640 1 -- 172.21.15.159:0/3255526136 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f890c010830 con 0x7f891c06ff20 2024-07-24T16:24:25.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f8324d88640 1 -- 172.21.15.159:0/3959076462 learned_addr learned my addr 172.21.15.159:0/3959076462 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f8325589640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f832006fd50 0x7f83200b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f8325d8a640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83200b4540 0x7f8320150410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f8324d88640 1 -- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83200b4540 msgr2=0x7f8320150410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f8324d88640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83200b4540 0x7f8320150410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f8324d88640 1 -- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f832006fd50 msgr2=0x7f83200b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f8324d88640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f832006fd50 0x7f83200b3960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f8324d88640 1 -- 172.21.15.159:0/3959076462 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f832015f7f0 con 0x7f8320071310 2024-07-24T16:24:25.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f4a03c38640 1 Processor -- start 2024-07-24T16:24:25.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f4a03c38640 1 -- start start 2024-07-24T16:24:25.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7ff69e761640 1 -- 172.21.15.159:0/973809134 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff698159850 con 0x7ff698071590 2024-07-24T16:24:25.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7ff69e761640 1 -- 172.21.15.159:0/973809134 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff698159e10 con 0x7ff698071590 2024-07-24T16:24:25.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f0ce4ff9640 1 -- 172.21.15.159:0/786075008 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc015030 con 0x7f0ce81509a0 2024-07-24T16:24:25.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f0cee72c640 1 -- 172.21.15.159:0/786075008 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ce81f8460 con 0x7f0ce81509a0 2024-07-24T16:24:25.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f0cee72c640 1 -- 172.21.15.159:0/786075008 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ce8150740 con 0x7f0ce81509a0 2024-07-24T16:24:25.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.371+0000 7f8911ffb640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f89000770e0 0x7f89000795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.371+0000 7f8324d88640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8320071310 0x7f832015bae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8310001eb0 tx=0x7f831000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f0ce4ff9640 1 -- 172.21.15.159:0/786075008 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0cdc004020 con 0x7f0ce81509a0 2024-07-24T16:24:25.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.370+0000 7f0ce4ff9640 1 -- 172.21.15.159:0/786075008 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc004470 con 0x7f0ce81509a0 2024-07-24T16:24:25.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.371+0000 7f8911ffb640 1 -- 172.21.15.159:0/3255526136 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f890c0994e0 con 0x7f891c06ff20 2024-07-24T16:24:25.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.371+0000 7f89216e7640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f89000770e0 0x7f89000795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.371+0000 7f01d1ffb640 1 -- 172.21.15.159:0/952492291 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f01cc01a070 con 0x7f01d4056f90 2024-07-24T16:24:25.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.371+0000 7f149f59e640 1 -- 172.21.15.159:0/1754845277 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14a00b2850 msgr2=0x7f14a0074090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.371+0000 7f149f59e640 1 --2- 172.21.15.159:0/1754845277 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14a00b2850 0x7f14a0074090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1494009820 tx=0x7f149402a500 comp rx=0 tx=0).stop 2024-07-24T16:24:25.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f0cee72c640 1 -- 172.21.15.159:0/786075008 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0cc8001030 con 0x7f0ce81509a0 2024-07-24T16:24:25.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f892394b640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] conn(0x7f891c204c60 0x7f891c0b0630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f8315ffb640 1 -- 172.21.15.159:0/3959076462 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310011790 con 0x7f8320071310 2024-07-24T16:24:25.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f8315ffb640 1 -- 172.21.15.159:0/3959076462 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8310017070 con 0x7f8320071310 2024-07-24T16:24:25.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f8315ffb640 1 -- 172.21.15.159:0/3959076462 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8310011ca0 con 0x7f8320071310 2024-07-24T16:24:25.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f892394b640 1 -- 172.21.15.159:0/3255526136 --> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f891c0ae9d0 con 0x7f891c204c60 2024-07-24T16:24:25.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f89216e7640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f89000770e0 0x7f89000795a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8918007fd0 tx=0x7f8918009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f832658b640 1 -- 172.21.15.159:0/3959076462 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83201fbda0 con 0x7f8320071310 2024-07-24T16:24:25.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f8921ee8640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] conn(0x7f891c204c60 0x7f891c0b0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f832658b640 1 -- 172.21.15.159:0/3959076462 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8320152470 con 0x7f8320071310 2024-07-24T16:24:25.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f01d1ffb640 1 --2- 172.21.15.159:0/952492291 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f01c00770e0 0x7f01c00795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7fbade9ae640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbad8073c50 0x7fbad8157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7ff69e761640 1 -- 172.21.15.159:0/973809134 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff698070960 con 0x7ff698071590 2024-07-24T16:24:25.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f01d1ffb640 1 -- 172.21.15.159:0/952492291 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f01cc097d00 con 0x7f01d4056f90 2024-07-24T16:24:25.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7fbade9ae640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbad815eec0 0x7fbad80ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7fbad7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbad8073c50 0x7fbad8157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f4a03c38640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49e4003a80 0x7f49fc1334d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f4a03c38640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f49fc1328e0 0x7f49fc0b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f4a03c38640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49fc0b1b70 0x7f49fc167520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f4a03c38640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc15a820 con 0x7f49fc0b1b70 2024-07-24T16:24:25.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f4a03c38640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f49fc15a6a0 con 0x7f49e4003a80 2024-07-24T16:24:25.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f4a03c38640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f49fc06fd90 con 0x7f49fc1328e0 2024-07-24T16:24:25.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.372+0000 7f4a011d3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f49fc1328e0 0x7f49fc0b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f01d1ffb640 1 --2- 172.21.15.159:0/952492291 >> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] conn(0x7f01c0080860 0x7f01c0082ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f4a019d4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49e4003a80 0x7f49fc1334d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f4a019d4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49e4003a80 0x7f49fc1334d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:56770/0 (socket says 172.21.15.159:56770) 2024-07-24T16:24:25.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f4a019d4640 1 -- 172.21.15.159:0/3272935015 learned_addr learned my addr 172.21.15.159:0/3272935015 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f01d1ffb640 1 -- 172.21.15.159:0/952492291 --> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01cc016ec0 con 0x7f01c0080860 2024-07-24T16:24:25.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f01d1ffb640 1 -- 172.21.15.159:0/952492291 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f01cc09a360 con 0x7f01d4056f90 2024-07-24T16:24:25.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7fbad7fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbad8073c50 0x7fbad8157970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:56782/0 (socket says 172.21.15.159:56782) 2024-07-24T16:24:25.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7fbad77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbad815eec0 0x7fbad80ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7fbad77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbad815eec0 0x7fbad80ab2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59800/0 (socket says 172.21.15.159:59800) 2024-07-24T16:24:25.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f149f59e640 1 -- 172.21.15.159:0/1754845277 shutdown_connections 2024-07-24T16:24:25.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f149f59e640 1 --2- 172.21.15.159:0/1754845277 >> v2:172.21.15.193:3300/0 conn(0x7f14a006d930 0x7f14a006dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f149f59e640 1 --2- 172.21.15.159:0/1754845277 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14a00b2850 0x7f14a0074090 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f149f59e640 1 -- 172.21.15.159:0/1754845277 >> 172.21.15.159:0/1754845277 conn(0x7f14a006c560 msgr2=0x7f14a006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7fbade9ae640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbad80ab810 0x7fbad80aef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f4a021d5640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49fc0b1b70 0x7f49fc167520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f4a019d4640 1 -- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f49fc1328e0 msgr2=0x7f49fc0b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f4a019d4640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f49fc1328e0 0x7f49fc0b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7fbad7fff640 1 -- 172.21.15.159:0/156309308 learned_addr learned my addr 172.21.15.159:0/156309308 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f4a019d4640 1 -- 172.21.15.159:0/3272935015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49fc0b1b70 msgr2=0x7f49fc167520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7fbadcf4b640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbad80ab810 0x7fbad80aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7fbade9ae640 1 -- 172.21.15.159:0/156309308 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbad80cf770 con 0x7fbad815eec0 2024-07-24T16:24:25.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7fbade9ae640 1 -- 172.21.15.159:0/156309308 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbad80aea40 con 0x7fbad8073c50 2024-07-24T16:24:25.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f4a019d4640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49fc0b1b70 0x7f49fc167520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f4a019d4640 1 -- 172.21.15.159:0/3272935015 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49fc0b2000 con 0x7f49e4003a80 2024-07-24T16:24:25.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f4a021d5640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f49fc0b1b70 0x7f49fc167520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:25.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f149f59e640 1 -- 172.21.15.159:0/1754845277 shutdown_connections 2024-07-24T16:24:25.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f832658b640 1 -- 172.21.15.159:0/3959076462 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8320070130 con 0x7f8320071310 2024-07-24T16:24:25.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7fbade9ae640 1 -- 172.21.15.159:0/156309308 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbad80cf8f0 con 0x7fbad80ab810 2024-07-24T16:24:25.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.373+0000 7f149f59e640 1 -- 172.21.15.159:0/1754845277 wait complete. 2024-07-24T16:24:25.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7f4a019d4640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49e4003a80 0x7f49fc1334d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f49f4006fb0 tx=0x7f49f4004830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7f8921ee8640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] conn(0x7f891c204c60 0x7f891c0b0630 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7f01e10ce640 1 --2- 172.21.15.159:0/952492291 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f01c00770e0 0x7f01c00795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7fbadcf4b640 1 -- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbad8073c50 msgr2=0x7fbad8157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7fbadcf4b640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbad8073c50 0x7fbad8157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7fbadcf4b640 1 -- 172.21.15.159:0/156309308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbad815eec0 msgr2=0x7fbad80ab2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7fbadcf4b640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbad815eec0 0x7fbad80ab2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7fbadcf4b640 1 -- 172.21.15.159:0/156309308 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad80afc70 con 0x7fbad80ab810 2024-07-24T16:24:25.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7f49fa7fc640 1 -- 172.21.15.159:0/3272935015 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f4004db0 con 0x7f49e4003a80 2024-07-24T16:24:25.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7f49fa7fc640 1 -- 172.21.15.159:0/3272935015 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49f40060c0 con 0x7f49e4003a80 2024-07-24T16:24:25.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7f49fa7fc640 1 -- 172.21.15.159:0/3272935015 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f402e6d0 con 0x7f49e4003a80 2024-07-24T16:24:25.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7fbad7fff640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbad8073c50 0x7fbad8157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:24:25.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7ff694ff9640 1 -- 172.21.15.159:0/973809134 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff68c01a070 con 0x7ff698071590 2024-07-24T16:24:25.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.374+0000 7fbadcf4b640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbad80ab810 0x7fbad80aef40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbad000c3f0 tx=0x7fbad000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7f8315ffb640 1 -- 172.21.15.159:0/3959076462 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f831001c460 con 0x7f8320071310 2024-07-24T16:24:25.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7ff694ff9640 1 --2- 172.21.15.159:0/973809134 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff684077010 0x7ff6840794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7ff694ff9640 1 -- 172.21.15.159:0/973809134 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff68c098010 con 0x7ff698071590 2024-07-24T16:24:25.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7ff694ff9640 1 --2- 172.21.15.159:0/973809134 >> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] conn(0x7ff684080710 0x7ff684082b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7ff694ff9640 1 -- 172.21.15.159:0/973809134 --> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff684083220 con 0x7ff684080710 2024-07-24T16:24:25.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7ff694ff9640 1 -- 172.21.15.159:0/973809134 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff68c09f050 con 0x7ff698071590 2024-07-24T16:24:25.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7f0ce4ff9640 1 -- 172.21.15.159:0/786075008 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0cdc018070 con 0x7f0ce81509a0 2024-07-24T16:24:25.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7f0ce4ff9640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0cd40770e0 0x7f0cd40795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7f8911ffb640 1 -- 172.21.15.159:0/3255526136 <== osd.3 v2:172.21.15.159:6800/1890079338 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f891c0ae9d0 con 0x7f891c204c60 2024-07-24T16:24:25.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7fbad4ff9640 1 -- 172.21.15.159:0/156309308 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad0017070 con 0x7fbad80ab810 2024-07-24T16:24:25.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7fbad4ff9640 1 -- 172.21.15.159:0/156309308 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbad00035f0 con 0x7fbad80ab810 2024-07-24T16:24:25.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7fbad4ff9640 1 -- 172.21.15.159:0/156309308 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbad0003a80 con 0x7fbad80ab810 2024-07-24T16:24:25.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7fbade9ae640 1 -- 172.21.15.159:0/156309308 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad80aff50 con 0x7fbad80ab810 2024-07-24T16:24:25.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7fbad77fe640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbad815eec0 0x7fbad80ab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:25.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7fbade9ae640 1 -- 172.21.15.159:0/156309308 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad80b0510 con 0x7fbad80ab810 2024-07-24T16:24:25.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7f149f59e640 1 Processor -- start 2024-07-24T16:24:25.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7f8315ffb640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f83040770e0 0x7f83040795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7f8315ffb640 1 -- 172.21.15.159:0/3959076462 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8310098990 con 0x7f8320071310 2024-07-24T16:24:25.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.376+0000 7f8315ffb640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] conn(0x7f83040807e0 0x7f8304082c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.376+0000 7f8315ffb640 1 -- 172.21.15.159:0/3959076462 --> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83040832f0 con 0x7f83040807e0 2024-07-24T16:24:25.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7f149f59e640 1 -- start start 2024-07-24T16:24:25.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7f4a03c38640 1 -- 172.21.15.159:0/3272935015 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49fc141f10 con 0x7f49e4003a80 2024-07-24T16:24:25.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7f4a03c38640 1 -- 172.21.15.159:0/3272935015 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49fc072bf0 con 0x7f49e4003a80 2024-07-24T16:24:25.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7f01e10ce640 1 --2- 172.21.15.159:0/952492291 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f01c00770e0 0x7f01c00795a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f01d8034040 tx=0x7f01d8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.375+0000 7f01e18cf640 1 --2- 172.21.15.159:0/952492291 >> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] conn(0x7f01c0080860 0x7f01c0082ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.376+0000 7f01e18cf640 1 --2- 172.21.15.159:0/952492291 >> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] conn(0x7f01c0080860 0x7f01c0082ca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.376+0000 7f8315ffb640 1 -- 172.21.15.159:0/3959076462 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f831005d810 con 0x7f8320071310 2024-07-24T16:24:25.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.376+0000 7f8325589640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f83040770e0 0x7f83040795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.376+0000 7f8325d8a640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] conn(0x7f83040807e0 0x7f8304082c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.376+0000 7f4a03c38640 1 -- 172.21.15.159:0/3272935015 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49fc141cc0 con 0x7f49e4003a80 2024-07-24T16:24:25.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.376+0000 7fbade9ae640 1 -- 172.21.15.159:0/156309308 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbad80b0880 con 0x7fbad80ab810 2024-07-24T16:24:25.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.376+0000 7ff69ccfe640 1 --2- 172.21.15.159:0/973809134 >> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] conn(0x7ff684080710 0x7ff684082b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.377+0000 7ff697fff640 1 --2- 172.21.15.159:0/973809134 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff684077010 0x7ff6840794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.376+0000 7f0ce4ff9640 1 -- 172.21.15.159:0/786075008 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0cdc098d10 con 0x7f0ce81509a0 2024-07-24T16:24:25.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.376+0000 7f0ce4ff9640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] conn(0x7f0cd4080860 0x7f0cd4082ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.376+0000 7f0ce4ff9640 1 -- 172.21.15.159:0/786075008 --> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0cd4083370 con 0x7f0cd4080860 2024-07-24T16:24:25.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.376+0000 7f0ce4ff9640 1 -- 172.21.15.159:0/786075008 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0cdc099100 con 0x7f0ce81509a0 2024-07-24T16:24:25.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.377+0000 7f0ce77fe640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] conn(0x7f0cd4080860 0x7f0cd4082ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.377+0000 7f0ce7fff640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0cd40770e0 0x7f0cd40795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.377+0000 7f8325589640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f83040770e0 0x7f83040795a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f831c009bd0 tx=0x7f831c005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.377+0000 7f0ce77fe640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] conn(0x7f0cd4080860 0x7f0cd4082ca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.377+0000 7f01d1ffb640 1 -- 172.21.15.159:0/952492291 <== osd.2 v2:172.21.15.159:6810/3425927328 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f01cc016ec0 con 0x7f01c0080860 2024-07-24T16:24:25.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.377+0000 7ff69ccfe640 1 --2- 172.21.15.159:0/973809134 >> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] conn(0x7ff684080710 0x7ff684082b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.377+0000 7f8325d8a640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] conn(0x7f83040807e0 0x7f8304082c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f8315ffb640 1 -- 172.21.15.159:0/3959076462 <== osd.6 v2:172.21.15.193:6812/2474946218 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83040832f0 con 0x7f83040807e0 2024-07-24T16:24:25.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7ff697fff640 1 --2- 172.21.15.159:0/973809134 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff684077010 0x7ff6840794d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff688033000 tx=0x7ff688004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7fbad4ff9640 1 -- 172.21.15.159:0/156309308 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fbad001a070 con 0x7fbad80ab810 2024-07-24T16:24:25.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7fbad4ff9640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbab80770e0 0x7fbab80795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7ff694ff9640 1 -- 172.21.15.159:0/973809134 <== osd.0 v2:172.21.15.159:6811/1335917367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff684083220 con 0x7ff684080710 2024-07-24T16:24:25.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f49fa7fc640 1 -- 172.21.15.159:0/3272935015 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f49f4035020 con 0x7f49e4003a80 2024-07-24T16:24:25.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f0ce4ff9640 1 -- 172.21.15.159:0/786075008 <== osd.1 v2:172.21.15.159:6808/3830259864 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0cd4083370 con 0x7f0cd4080860 2024-07-24T16:24:25.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7fbad7fff640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbab80770e0 0x7fbab80795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149f59e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14a006d930 0x7f14a00caf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149f59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14a006f850 0x7f14a01587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149f59e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14a00b2850 0x7f14a00a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149f59e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f14a00cb980 con 0x7f14a006f850 2024-07-24T16:24:25.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149f59e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14a00cb800 con 0x7f14a006d930 2024-07-24T16:24:25.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149f59e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f14a00cbb00 con 0x7f14a00b2850 2024-07-24T16:24:25.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149dd9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14a006f850 0x7f14a01587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149dd9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14a006f850 0x7f14a01587b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59818/0 (socket says 172.21.15.159:59818) 2024-07-24T16:24:25.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149dd9b640 1 -- 172.21.15.159:0/1376064745 learned_addr learned my addr 172.21.15.159:0/1376064745 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149e59c640 1 --2- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14a006d930 0x7f14a00caf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149dd9b640 1 -- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14a00b2850 msgr2=0x7f14a00a9480 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-07-24T16:24:25.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149dd9b640 1 --2- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14a00b2850 0x7f14a00a9480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149dd9b640 1 -- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14a006d930 msgr2=0x7f14a00caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149dd9b640 1 --2- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14a006d930 0x7f14a00caf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.378+0000 7f149dd9b640 1 -- 172.21.15.159:0/1376064745 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a0154260 con 0x7f14a006f850 2024-07-24T16:24:25.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f0ce7fff640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0cd40770e0 0x7f0cd40795a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0035000 tx=0x7f0ce0004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7fbad4ff9640 1 -- 172.21.15.159:0/156309308 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbad0097c80 con 0x7fbad80ab810 2024-07-24T16:24:25.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f49fa7fc640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f49e8077110 0x7f49e80795d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7fbad7fff640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbab80770e0 0x7fbab80795a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbac00058c0 tx=0x7fbac000a380 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f149dd9b640 1 --2- 172.21.15.159:0/1376064745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14a006f850 0x7f14a01587b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1494000c00 tx=0x7f1494005340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f49fa7fc640 1 -- 172.21.15.159:0/3272935015 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f49f40b93a0 con 0x7f49e4003a80 2024-07-24T16:24:25.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7fbad4ff9640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] conn(0x7fbab8080860 0x7fbab8082ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7fbad4ff9640 1 -- 172.21.15.159:0/156309308 --> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbab8083370 con 0x7fbab8080860 2024-07-24T16:24:25.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7fbad4ff9640 1 -- 172.21.15.159:0/156309308 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbad0098070 con 0x7fbad80ab810 2024-07-24T16:24:25.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f49fa7fc640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] conn(0x7f49e8080880 0x7f49e8082cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f148effd640 1 -- 172.21.15.159:0/1376064745 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494040070 con 0x7f14a006f850 2024-07-24T16:24:25.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f148effd640 1 -- 172.21.15.159:0/1376064745 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1494004310 con 0x7f14a006f850 2024-07-24T16:24:25.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f148effd640 1 -- 172.21.15.159:0/1376064745 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1494004a00 con 0x7f14a006f850 2024-07-24T16:24:25.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f149f59e640 1 -- 172.21.15.159:0/1376064745 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a0153f80 con 0x7f14a006f850 2024-07-24T16:24:25.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f149f59e640 1 -- 172.21.15.159:0/1376064745 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a0157fb0 con 0x7f14a006f850 2024-07-24T16:24:25.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f49fa7fc640 1 -- 172.21.15.159:0/3272935015 --> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49f4006270 con 0x7f49e8080880 2024-07-24T16:24:25.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f49fa7fc640 1 -- 172.21.15.159:0/3272935015 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f49f40b9790 con 0x7f49e4003a80 2024-07-24T16:24:25.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.379+0000 7f4a011d3640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f49e8077110 0x7f49e80795d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.380+0000 7f4a011d3640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f49e8077110 0x7f49e80795d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f49fc15d2d0 tx=0x7f49f0006b90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.380+0000 7fbad77fe640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] conn(0x7fbab8080860 0x7fbab8082ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.380+0000 7f149f59e640 1 -- 172.21.15.159:0/1376064745 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14a006dd30 con 0x7f14a006f850 2024-07-24T16:24:25.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.381+0000 7f4a021d5640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] conn(0x7f49e8080880 0x7f49e8082cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.381+0000 7fbad77fe640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] conn(0x7fbab8080860 0x7fbab8082ca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.382+0000 7f4a021d5640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] conn(0x7f49e8080880 0x7f49e8082cc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.382+0000 7fbad4ff9640 1 -- 172.21.15.159:0/156309308 <== osd.4 v2:172.21.15.193:6824/2092166389 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbab8083370 con 0x7fbab8080860 2024-07-24T16:24:25.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.382+0000 7f148effd640 1 -- 172.21.15.159:0/1376064745 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1494039040 con 0x7f14a006f850 2024-07-24T16:24:25.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.382+0000 7f148effd640 1 --2- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f14800770e0 0x7f14800795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.383+0000 7f148effd640 1 -- 172.21.15.159:0/1376064745 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f14940ba4e0 con 0x7f14a006f850 2024-07-24T16:24:25.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.383+0000 7f148effd640 1 --2- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] conn(0x7f1480080860 0x7f1480082ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.383+0000 7f148effd640 1 -- 172.21.15.159:0/1376064745 --> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1494001d30 con 0x7f1480080860 2024-07-24T16:24:25.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.383+0000 7f148effd640 1 -- 172.21.15.159:0/1376064745 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f14940ba8d0 con 0x7f14a006f850 2024-07-24T16:24:25.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.382+0000 7f49fa7fc640 1 -- 172.21.15.159:0/3272935015 <== osd.7 v2:172.21.15.193:6808/745996008 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49f4006270 con 0x7f49e8080880 2024-07-24T16:24:25.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.383+0000 7f149e59c640 1 --2- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f14800770e0 0x7f14800795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.383+0000 7f149ed9d640 1 --2- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] conn(0x7f1480080860 0x7f1480082ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.384+0000 7f149ed9d640 1 --2- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] conn(0x7f1480080860 0x7f1480082ca0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.384+0000 7f149e59c640 1 --2- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f14800770e0 0x7f14800795a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f14900046b0 tx=0x7f1490009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.385+0000 7f148effd640 1 -- 172.21.15.159:0/1376064745 <== osd.5 v2:172.21.15.193:6800/262722874 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1494001d30 con 0x7f1480080860 2024-07-24T16:24:25.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.407+0000 7f892394b640 1 -- 172.21.15.159:0/3255526136 --> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f891c160a60 con 0x7f891c204c60 2024-07-24T16:24:25.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.408+0000 7f8911ffb640 1 -- 172.21.15.159:0/3255526136 <== osd.3 v2:172.21.15.159:6800/1890079338 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f891c160a60 con 0x7f891c204c60 2024-07-24T16:24:25.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.409+0000 7f89077fe640 1 -- 172.21.15.159:0/3255526136 >> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] conn(0x7f891c204c60 msgr2=0x7f891c0b0630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.409+0000 7f89077fe640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] conn(0x7f891c204c60 0x7f891c0b0630 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.409+0000 7f01c77fe640 1 -- 172.21.15.159:0/952492291 --> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f01bc002dd0 con 0x7f01c0080860 2024-07-24T16:24:25.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.409+0000 7ff69e761640 1 -- 172.21.15.159:0/973809134 --> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff698161030 con 0x7ff684080710 2024-07-24T16:24:25.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.409+0000 7f01d1ffb640 1 -- 172.21.15.159:0/952492291 <== osd.2 v2:172.21.15.159:6810/3425927328 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f01bc002dd0 con 0x7f01c0080860 2024-07-24T16:24:25.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.409+0000 7f89077fe640 1 -- 172.21.15.159:0/3255526136 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f89000770e0 msgr2=0x7f89000795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.409+0000 7f89077fe640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f89000770e0 0x7f89000795a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8918007fd0 tx=0x7f8918009040 comp rx=0 tx=0).stop 2024-07-24T16:24:25.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7f89077fe640 1 -- 172.21.15.159:0/3255526136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f891c06ff20 msgr2=0x7f891c14af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7f89077fe640 1 --2- 172.21.15.159:0/3255526136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f891c06ff20 0x7f891c14af00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f890c00e9f0 tx=0x7f890c00eeb0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7f8921ee8640 1 -- 172.21.15.159:0/3255526136 reap_dead start 2024-07-24T16:24:25.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7f89077fe640 1 -- 172.21.15.159:0/3255526136 shutdown_connections 2024-07-24T16:24:25.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7f89077fe640 1 -- 172.21.15.159:0/3255526136 >> 172.21.15.159:0/3255526136 conn(0x7f891c06cbc0 msgr2=0x7f891c15f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7f01e20d0640 1 -- 172.21.15.159:0/952492291 >> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] conn(0x7f01c0080860 msgr2=0x7f01c0082ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7f01e20d0640 1 --2- 172.21.15.159:0/952492291 >> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] conn(0x7f01c0080860 0x7f01c0082ca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7f89077fe640 1 -- 172.21.15.159:0/3255526136 shutdown_connections 2024-07-24T16:24:25.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7f89077fe640 1 -- 172.21.15.159:0/3255526136 wait complete. 2024-07-24T16:24:25.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7f01e20d0640 1 -- 172.21.15.159:0/952492291 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f01c00770e0 msgr2=0x7f01c00795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7f01e20d0640 1 --2- 172.21.15.159:0/952492291 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f01c00770e0 0x7f01c00795a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f01d8034040 tx=0x7f01d8004730 comp rx=0 tx=0).stop 2024-07-24T16:24:25.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7f01e20d0640 1 -- 172.21.15.159:0/952492291 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01d4056f90 msgr2=0x7f01d40dac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7f01e20d0640 1 --2- 172.21.15.159:0/952492291 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01d4056f90 0x7f01d40dac50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f01cc00c430 tx=0x7f01cc00c8f0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7f01e18cf640 1 -- 172.21.15.159:0/952492291 reap_dead start 2024-07-24T16:24:25.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7f832658b640 1 -- 172.21.15.159:0/3959076462 --> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f83200723c0 con 0x7f83040807e0 2024-07-24T16:24:25.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.410+0000 7ff694ff9640 1 -- 172.21.15.159:0/973809134 <== osd.0 v2:172.21.15.159:6811/1335917367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff698161030 con 0x7ff684080710 2024-07-24T16:24:25.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7f01e20d0640 1 -- 172.21.15.159:0/952492291 shutdown_connections 2024-07-24T16:24:25.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7f01e20d0640 1 -- 172.21.15.159:0/952492291 >> 172.21.15.159:0/952492291 conn(0x7f01d4055350 msgr2=0x7f01d40df3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7ff69e761640 1 -- 172.21.15.159:0/973809134 >> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] conn(0x7ff684080710 msgr2=0x7ff684082b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7ff69e761640 1 --2- 172.21.15.159:0/973809134 >> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] conn(0x7ff684080710 0x7ff684082b50 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7f01e20d0640 1 -- 172.21.15.159:0/952492291 shutdown_connections 2024-07-24T16:24:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7f01e20d0640 1 -- 172.21.15.159:0/952492291 wait complete. 2024-07-24T16:24:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7ff69e761640 1 -- 172.21.15.159:0/973809134 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff684077010 msgr2=0x7ff6840794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7ff69e761640 1 --2- 172.21.15.159:0/973809134 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff684077010 0x7ff6840794d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff688033000 tx=0x7ff688004730 comp rx=0 tx=0).stop 2024-07-24T16:24:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7ff69e761640 1 -- 172.21.15.159:0/973809134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff698071590 msgr2=0x7ff698161400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7ff69e761640 1 --2- 172.21.15.159:0/973809134 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff698071590 0x7ff698161400 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff68c00c370 tx=0x7ff68c00c830 comp rx=0 tx=0).stop 2024-07-24T16:24:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7ff69ccfe640 1 -- 172.21.15.159:0/973809134 reap_dead start 2024-07-24T16:24:25.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7f8315ffb640 1 -- 172.21.15.159:0/3959076462 <== osd.6 v2:172.21.15.193:6812/2474946218 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f83200723c0 con 0x7f83040807e0 2024-07-24T16:24:25.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.411+0000 7f0cee72c640 1 -- 172.21.15.159:0/786075008 --> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0cc8002dd0 con 0x7f0cd4080860 2024-07-24T16:24:25.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.412+0000 7f832658b640 1 -- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] conn(0x7f83040807e0 msgr2=0x7f8304082c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.412+0000 7f832658b640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] conn(0x7f83040807e0 0x7f8304082c20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.412+0000 7f832658b640 1 -- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f83040770e0 msgr2=0x7f83040795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.412+0000 7f832658b640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f83040770e0 0x7f83040795a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f831c009bd0 tx=0x7f831c005f90 comp rx=0 tx=0).stop 2024-07-24T16:24:25.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.412+0000 7f832658b640 1 -- 172.21.15.159:0/3959076462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8320071310 msgr2=0x7f832015bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.412+0000 7f832658b640 1 --2- 172.21.15.159:0/3959076462 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8320071310 0x7f832015bae0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8310001eb0 tx=0x7f831000c890 comp rx=0 tx=0).stop 2024-07-24T16:24:25.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.412+0000 7f8325d8a640 1 -- 172.21.15.159:0/3959076462 reap_dead start 2024-07-24T16:24:25.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.412+0000 7f0ce4ff9640 1 -- 172.21.15.159:0/786075008 <== osd.1 v2:172.21.15.159:6808/3830259864 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0cc8002dd0 con 0x7f0cd4080860 2024-07-24T16:24:25.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.412+0000 7f832658b640 1 -- 172.21.15.159:0/3959076462 shutdown_connections 2024-07-24T16:24:25.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.412+0000 7f832658b640 1 -- 172.21.15.159:0/3959076462 >> 172.21.15.159:0/3959076462 conn(0x7f83200d1490 msgr2=0x7f83200b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.412+0000 7f832658b640 1 -- 172.21.15.159:0/3959076462 shutdown_connections 2024-07-24T16:24:25.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.412+0000 7f832658b640 1 -- 172.21.15.159:0/3959076462 wait complete. 2024-07-24T16:24:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7ff69e761640 1 -- 172.21.15.159:0/973809134 shutdown_connections 2024-07-24T16:24:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7f0cee72c640 1 -- 172.21.15.159:0/786075008 >> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] conn(0x7f0cd4080860 msgr2=0x7f0cd4082ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7f0cee72c640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] conn(0x7f0cd4080860 0x7f0cd4082ca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7ff69e761640 1 -- 172.21.15.159:0/973809134 >> 172.21.15.159:0/973809134 conn(0x7ff6980b36f0 msgr2=0x7ff6980b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7f0cee72c640 1 -- 172.21.15.159:0/786075008 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0cd40770e0 msgr2=0x7f0cd40795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7f0cee72c640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0cd40770e0 0x7f0cd40795a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0ce0035000 tx=0x7f0ce0004ab0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7f0cee72c640 1 -- 172.21.15.159:0/786075008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ce81509a0 msgr2=0x7f0ce80aecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7f0cee72c640 1 --2- 172.21.15.159:0/786075008 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0ce81509a0 0x7f0ce80aecb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00b410 tx=0x7f0cdc00b8d0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7ff69e761640 1 -- 172.21.15.159:0/973809134 shutdown_connections 2024-07-24T16:24:25.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7ff69e761640 1 -- 172.21.15.159:0/973809134 wait complete. 2024-07-24T16:24:25.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7f0ceccc9640 1 -- 172.21.15.159:0/786075008 reap_dead start 2024-07-24T16:24:25.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7f0cee72c640 1 -- 172.21.15.159:0/786075008 shutdown_connections 2024-07-24T16:24:25.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7f0cee72c640 1 -- 172.21.15.159:0/786075008 >> 172.21.15.159:0/786075008 conn(0x7f0ce806e1a0 msgr2=0x7f0ce815b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7f0cee72c640 1 -- 172.21.15.159:0/786075008 shutdown_connections 2024-07-24T16:24:25.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.413+0000 7f0cee72c640 1 -- 172.21.15.159:0/786075008 wait complete. 2024-07-24T16:24:25.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.414+0000 7f4a03c38640 1 -- 172.21.15.159:0/3272935015 --> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49fc15c460 con 0x7f49e8080880 2024-07-24T16:24:25.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.415+0000 7f49fa7fc640 1 -- 172.21.15.159:0/3272935015 <== osd.7 v2:172.21.15.193:6808/745996008 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f49fc15c460 con 0x7f49e8080880 2024-07-24T16:24:25.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.416+0000 7fbade9ae640 1 -- 172.21.15.159:0/156309308 --> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbad80724f0 con 0x7fbab8080860 2024-07-24T16:24:25.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.416+0000 7f49dbfff640 1 -- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] conn(0x7f49e8080880 msgr2=0x7f49e8082cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.416+0000 7f149f59e640 1 -- 172.21.15.159:0/1376064745 --> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f14a0158430 con 0x7f1480080860 2024-07-24T16:24:25.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.416+0000 7f49dbfff640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] conn(0x7f49e8080880 0x7f49e8082cc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.450 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.416+0000 7f49dbfff640 1 -- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f49e8077110 msgr2=0x7f49e80795d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.416+0000 7f49dbfff640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f49e8077110 0x7f49e80795d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f49fc15d2d0 tx=0x7f49f0006b90 comp rx=0 tx=0).stop 2024-07-24T16:24:25.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.416+0000 7f49dbfff640 1 -- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49e4003a80 msgr2=0x7f49fc1334d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.416+0000 7f49dbfff640 1 --2- 172.21.15.159:0/3272935015 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f49e4003a80 0x7f49fc1334d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f49f4006fb0 tx=0x7f49f4004830 comp rx=0 tx=0).stop 2024-07-24T16:24:25.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.417+0000 7f4a021d5640 1 -- 172.21.15.159:0/3272935015 reap_dead start 2024-07-24T16:24:25.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.417+0000 7f49dbfff640 1 -- 172.21.15.159:0/3272935015 shutdown_connections 2024-07-24T16:24:25.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.417+0000 7f148effd640 1 -- 172.21.15.159:0/1376064745 <== osd.5 v2:172.21.15.193:6800/262722874 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f14a0158430 con 0x7f1480080860 2024-07-24T16:24:25.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.417+0000 7f49dbfff640 1 -- 172.21.15.159:0/3272935015 >> 172.21.15.159:0/3272935015 conn(0x7f49fc06c560 msgr2=0x7f49fc15b360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.417+0000 7f49dbfff640 1 -- 172.21.15.159:0/3272935015 shutdown_connections 2024-07-24T16:24:25.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.417+0000 7f49dbfff640 1 -- 172.21.15.159:0/3272935015 wait complete. 2024-07-24T16:24:25.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.417+0000 7fbad4ff9640 1 -- 172.21.15.159:0/156309308 <== osd.4 v2:172.21.15.193:6824/2092166389 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbad80724f0 con 0x7fbab8080860 2024-07-24T16:24:25.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.418+0000 7f149f59e640 1 -- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] conn(0x7f1480080860 msgr2=0x7f1480082ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.418+0000 7f149f59e640 1 --2- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] conn(0x7f1480080860 0x7f1480082ca0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.418+0000 7f149f59e640 1 -- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f14800770e0 msgr2=0x7f14800795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.418+0000 7f149f59e640 1 --2- 172.21.15.159:0/1376064745 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f14800770e0 0x7f14800795a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f14900046b0 tx=0x7f1490009040 comp rx=0 tx=0).stop 2024-07-24T16:24:25.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.418+0000 7f149f59e640 1 -- 172.21.15.159:0/1376064745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14a006f850 msgr2=0x7f14a01587b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.418+0000 7f149f59e640 1 --2- 172.21.15.159:0/1376064745 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14a006f850 0x7f14a01587b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1494000c00 tx=0x7f1494005340 comp rx=0 tx=0).stop 2024-07-24T16:24:25.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.419+0000 7f149ed9d640 1 -- 172.21.15.159:0/1376064745 reap_dead start 2024-07-24T16:24:25.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.419+0000 7f149f59e640 1 -- 172.21.15.159:0/1376064745 shutdown_connections 2024-07-24T16:24:25.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.419+0000 7f149f59e640 1 -- 172.21.15.159:0/1376064745 >> 172.21.15.159:0/1376064745 conn(0x7f14a006c560 msgr2=0x7f14a0159ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.419+0000 7f149f59e640 1 -- 172.21.15.159:0/1376064745 shutdown_connections 2024-07-24T16:24:25.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.419+0000 7f149f59e640 1 -- 172.21.15.159:0/1376064745 wait complete. 2024-07-24T16:24:25.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.419+0000 7fbace7fc640 1 -- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] conn(0x7fbab8080860 msgr2=0x7fbab8082ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.420+0000 7fbace7fc640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] conn(0x7fbab8080860 0x7fbab8082ca0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.420+0000 7fbace7fc640 1 -- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbab80770e0 msgr2=0x7fbab80795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.420+0000 7fbace7fc640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbab80770e0 0x7fbab80795a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fbac00058c0 tx=0x7fbac000a380 comp rx=0 tx=0).stop 2024-07-24T16:24:25.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.420+0000 7fbace7fc640 1 -- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbad80ab810 msgr2=0x7fbad80aef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.420+0000 7fbace7fc640 1 --2- 172.21.15.159:0/156309308 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbad80ab810 0x7fbad80aef40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbad000c3f0 tx=0x7fbad000c8b0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.420+0000 7fbadcf4b640 1 -- 172.21.15.159:0/156309308 reap_dead start 2024-07-24T16:24:25.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.422+0000 7fbace7fc640 1 -- 172.21.15.159:0/156309308 shutdown_connections 2024-07-24T16:24:25.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.422+0000 7fbace7fc640 1 -- 172.21.15.159:0/156309308 >> 172.21.15.159:0/156309308 conn(0x7fbad806c560 msgr2=0x7fbad80ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.422+0000 7fbace7fc640 1 -- 172.21.15.159:0/156309308 shutdown_connections 2024-07-24T16:24:25.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.422+0000 7fbace7fc640 1 -- 172.21.15.159:0/156309308 wait complete. 2024-07-24T16:24:25.457 INFO:teuthology.orchestra.run.smithi159.stdout:55834574856 2024-07-24T16:24:25.457 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-07-24T16:24:25.458 INFO:teuthology.orchestra.run.smithi159.stdout:55834574856 2024-07-24T16:24:25.458 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-07-24T16:24:25.459 INFO:teuthology.orchestra.run.smithi159.stdout:55834574855 2024-07-24T16:24:25.459 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-07-24T16:24:25.462 INFO:teuthology.orchestra.run.smithi159.stdout:55834574855 2024-07-24T16:24:25.462 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-07-24T16:24:25.463 INFO:teuthology.orchestra.run.smithi159.stdout:55834574856 2024-07-24T16:24:25.464 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-07-24T16:24:25.464 INFO:teuthology.orchestra.run.smithi159.stdout:55834574855 2024-07-24T16:24:25.465 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-07-24T16:24:25.465 INFO:teuthology.orchestra.run.smithi159.stdout:55834574855 2024-07-24T16:24:25.466 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-07-24T16:24:25.467 INFO:teuthology.orchestra.run.smithi159.stdout:55834574856 2024-07-24T16:24:25.467 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-07-24T16:24:25.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.671+0000 7f9257a4e640 1 -- 172.21.15.159:0/3900451898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f923c004800 msgr2=0x7f923c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.671+0000 7f9257a4e640 1 --2- 172.21.15.159:0/3900451898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f923c004800 0x7f923c004c80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f92400016c0 tx=0x7f923c005830 comp rx=0 tx=0).stop 2024-07-24T16:24:25.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.672+0000 7fbe9a272640 1 -- 172.21.15.159:0/2009153747 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe80006490 msgr2=0x7fbe80006f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.672+0000 7f9257a4e640 1 -- 172.21.15.159:0/3900451898 shutdown_connections 2024-07-24T16:24:25.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.672+0000 7f9257a4e640 1 --2- 172.21.15.159:0/3900451898 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f923c004800 0x7f923c004c80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.672+0000 7f9257a4e640 1 -- 172.21.15.159:0/3900451898 >> 172.21.15.159:0/3900451898 conn(0x7f92500b4a20 msgr2=0x7f92500b4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.672+0000 7f9257a4e640 1 -- 172.21.15.159:0/3900451898 shutdown_connections 2024-07-24T16:24:25.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.672+0000 7fbe9a272640 1 --2- 172.21.15.159:0/2009153747 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe80006490 0x7fbe80006f50 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbe90006f40 tx=0x7fbe80007a40 comp rx=0 tx=0).stop 2024-07-24T16:24:25.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.673+0000 7f9257a4e640 1 -- 172.21.15.159:0/3900451898 wait complete. 2024-07-24T16:24:25.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.673+0000 7ff7d9608640 1 -- 172.21.15.159:0/1213592749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7d40d30d0 msgr2=0x7ff7d40b6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.674+0000 7ff7d9608640 1 --2- 172.21.15.159:0/1213592749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7d40d30d0 0x7ff7d40b6740 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff7d406c6a0 tx=0x7ff7cc02a8b0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.674+0000 7fbe9a272640 1 -- 172.21.15.159:0/2009153747 shutdown_connections 2024-07-24T16:24:25.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.674+0000 7fbe9a272640 1 --2- 172.21.15.159:0/2009153747 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe80006490 0x7fbe80006f50 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.674+0000 7fbe9a272640 1 -- 172.21.15.159:0/2009153747 >> 172.21.15.159:0/2009153747 conn(0x7fbe8c01e8d0 msgr2=0x7fbe8c0556c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.675+0000 7fbe9a272640 1 -- 172.21.15.159:0/2009153747 shutdown_connections 2024-07-24T16:24:25.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.675+0000 7ff7d9608640 1 -- 172.21.15.159:0/1213592749 shutdown_connections 2024-07-24T16:24:25.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.675+0000 7ff7d9608640 1 --2- 172.21.15.159:0/1213592749 >> v2:172.21.15.193:3300/0 conn(0x7ff7d40b5c50 0x7ff7d40ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.675+0000 7ff7d9608640 1 --2- 172.21.15.159:0/1213592749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7d40d30d0 0x7ff7d40b6740 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.675+0000 7ff7d9608640 1 -- 172.21.15.159:0/1213592749 >> 172.21.15.159:0/1213592749 conn(0x7ff7d40d0550 msgr2=0x7ff7d40d0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.675+0000 7f6e36ffd640 1 -- 172.21.15.159:0/2229600213 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30031a20 con 0x7f6e380b75e0 2024-07-24T16:24:25.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.674+0000 7f9257a4e640 1 Processor -- start 2024-07-24T16:24:25.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.674+0000 7f9257a4e640 1 -- start start 2024-07-24T16:24:25.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.675+0000 7fbe9a272640 1 -- 172.21.15.159:0/2009153747 wait complete. 2024-07-24T16:24:25.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f9257a4e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f923c004800 0x7f9250071760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f9257a4e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f925013e490 0x7f9250071ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f9257a4e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9250129500 0x7f9250129980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f9257a4e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f92500b3da0 con 0x7f925013e490 2024-07-24T16:24:25.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f9257a4e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f92500b3c20 con 0x7f9250129500 2024-07-24T16:24:25.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f9257a4e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f92500b3f20 con 0x7f923c004800 2024-07-24T16:24:25.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.675+0000 7ff7d9608640 1 -- 172.21.15.159:0/1213592749 shutdown_connections 2024-07-24T16:24:25.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f92557ea640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f923c004800 0x7f9250071760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7ff7d9608640 1 -- 172.21.15.159:0/1213592749 wait complete. 2024-07-24T16:24:25.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f9254fe9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f925013e490 0x7f9250071ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f9254fe9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f925013e490 0x7f9250071ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59886/0 (socket says 172.21.15.159:59886) 2024-07-24T16:24:25.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f9254fe9640 1 -- 172.21.15.159:0/3255680488 learned_addr learned my addr 172.21.15.159:0/3255680488 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f9255feb640 1 --2- 172.21.15.159:0/3255680488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9250129500 0x7f9250129980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/2229600213 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6e380b75e0 msgr2=0x7f6e380d21d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f6e3cfa4640 1 --2- 172.21.15.159:0/2229600213 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6e380b75e0 0x7f6e380d21d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6e30005fd0 tx=0x7f6e3002a8a0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/2229600213 shutdown_connections 2024-07-24T16:24:25.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f6e3cfa4640 1 --2- 172.21.15.159:0/2229600213 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6e380b75e0 0x7f6e380d21d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f6e3cfa4640 1 --2- 172.21.15.159:0/2229600213 >> v2:172.21.15.159:3300/0 conn(0x7f6e3806cb90 0x7f6e3806cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/2229600213 >> 172.21.15.159:0/2229600213 conn(0x7f6e380d35f0 msgr2=0x7f6e380d39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7fbe9a272640 1 Processor -- start 2024-07-24T16:24:25.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7f9254fe9640 1 -- 172.21.15.159:0/3255680488 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f923c004800 msgr2=0x7f9250071760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7f9254fe9640 1 --2- 172.21.15.159:0/3255680488 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f923c004800 0x7f9250071760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7f9254fe9640 1 -- 172.21.15.159:0/3255680488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9250129500 msgr2=0x7f9250129980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7f9254fe9640 1 --2- 172.21.15.159:0/3255680488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9250129500 0x7f9250129980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7f9254fe9640 1 -- 172.21.15.159:0/3255680488 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92501f87a0 con 0x7f925013e490 2024-07-24T16:24:25.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/2229600213 shutdown_connections 2024-07-24T16:24:25.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7fbca50cb640 1 -- 172.21.15.159:0/1279311531 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbca015adc0 msgr2=0x7fbca00cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7fbca50cb640 1 --2- 172.21.15.159:0/1279311531 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbca015adc0 0x7fbca00cf880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009830 tx=0x7fbc9002a540 comp rx=0 tx=0).stop 2024-07-24T16:24:25.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7fbca50cb640 1 -- 172.21.15.159:0/1279311531 shutdown_connections 2024-07-24T16:24:25.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7fbca50cb640 1 --2- 172.21.15.159:0/1279311531 >> v2:172.21.15.159:3300/0 conn(0x7fbca006c560 0x7fbca0068ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7f9254fe9640 1 --2- 172.21.15.159:0/3255680488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f925013e490 0x7f9250071ca0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f92400017e0 tx=0x7f92400063c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7fbca50cb640 1 --2- 172.21.15.159:0/1279311531 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbca015adc0 0x7fbca00cf880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.686 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7fbca50cb640 1 -- 172.21.15.159:0/1279311531 >> 172.21.15.159:0/1279311531 conn(0x7fbca006e1a0 msgr2=0x7fbca006e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7fbe9a272640 1 -- start start 2024-07-24T16:24:25.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.677+0000 7f9245ffb640 1 -- 172.21.15.159:0/3255680488 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240003a00 con 0x7f925013e490 2024-07-24T16:24:25.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7f9245ffb640 1 -- 172.21.15.159:0/3255680488 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9240039070 con 0x7f925013e490 2024-07-24T16:24:25.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7f9245ffb640 1 -- 172.21.15.159:0/3255680488 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9240033420 con 0x7f925013e490 2024-07-24T16:24:25.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7f9257a4e640 1 -- 172.21.15.159:0/3255680488 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92501f8a80 con 0x7f925013e490 2024-07-24T16:24:25.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7f2f70928640 1 -- 172.21.15.159:0/30418919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f5c003b70 msgr2=0x7f2f5c003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7f2f70928640 1 --2- 172.21.15.159:0/30418919 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f5c003b70 0x7f2f5c003f50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2f60006df0 tx=0x7f2f5c005830 comp rx=0 tx=0).stop 2024-07-24T16:24:25.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7f2f6bfff640 1 -- 172.21.15.159:0/30418919 reap_dead start 2024-07-24T16:24:25.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7fbca50cb640 1 -- 172.21.15.159:0/1279311531 shutdown_connections 2024-07-24T16:24:25.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7f2f70928640 1 -- 172.21.15.159:0/30418919 shutdown_connections 2024-07-24T16:24:25.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7f2f70928640 1 -- 172.21.15.159:0/30418919 >> 172.21.15.159:0/30418919 conn(0x7f2f6403a3c0 msgr2=0x7f2f6403a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7fbca50cb640 1 -- 172.21.15.159:0/1279311531 wait complete. 2024-07-24T16:24:25.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7f2f70928640 1 -- 172.21.15.159:0/30418919 shutdown_connections 2024-07-24T16:24:25.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7fbe9a272640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe80006490 0x7fbe8c04f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7fbe9a272640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe8c053580 0x7fbe8c0d5710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7fbe9a272640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe8c054b20 0x7fbe8c04d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7fbe9a272640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c056160 con 0x7fbe8c054b20 2024-07-24T16:24:25.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7fbe9a272640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8c055fe0 con 0x7fbe8c053580 2024-07-24T16:24:25.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7fbe9a272640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbe8c0562e0 con 0x7fbe80006490 2024-07-24T16:24:25.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.676+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/2229600213 wait complete. 2024-07-24T16:24:25.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7f6e3cfa4640 1 Processor -- start 2024-07-24T16:24:25.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7ff7d9608640 1 Processor -- start 2024-07-24T16:24:25.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7f6e3cfa4640 1 -- start start 2024-07-24T16:24:25.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7ff7d9608640 1 -- start start 2024-07-24T16:24:25.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7fbe99a71640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe8c054b20 0x7fbe8c04d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7fbe99270640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe80006490 0x7fbe8c04f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7fbe99a71640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe8c054b20 0x7fbe8c04d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59900/0 (socket says 172.21.15.159:59900) 2024-07-24T16:24:25.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7fbe98a6f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe8c053580 0x7fbe8c0d5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7fbe99270640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe80006490 0x7fbe8c04f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:34080/0 (socket says 172.21.15.159:34080) 2024-07-24T16:24:25.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7fbe99270640 1 -- 172.21.15.159:0/1686290175 learned_addr learned my addr 172.21.15.159:0/1686290175 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7f9257a4e640 1 -- 172.21.15.159:0/3255680488 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92501f9040 con 0x7f925013e490 2024-07-24T16:24:25.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7fbe99a71640 1 -- 172.21.15.159:0/1686290175 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe80006490 msgr2=0x7fbe8c04f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7fbe99a71640 1 --2- 172.21.15.159:0/1686290175 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe80006490 0x7fbe8c04f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7fbe99a71640 1 -- 172.21.15.159:0/1686290175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe8c053580 msgr2=0x7fbe8c0d5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7fbe99a71640 1 --2- 172.21.15.159:0/1686290175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe8c053580 0x7fbe8c0d5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7fbe99a71640 1 -- 172.21.15.159:0/1686290175 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8c053a80 con 0x7fbe8c054b20 2024-07-24T16:24:25.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7fbe99270640 1 --2- 172.21.15.159:0/1686290175 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe80006490 0x7fbe8c04f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:24:25.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7f1bcd3df640 1 -- 172.21.15.159:0/4145775943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc806da80 msgr2=0x7f1bc8072130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.679+0000 7f1bcd3df640 1 --2- 172.21.15.159:0/4145775943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc806da80 0x7f1bc8072130 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8009830 tx=0x7f1bb802a480 comp rx=0 tx=0).stop 2024-07-24T16:24:25.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7fbe99a71640 1 --2- 172.21.15.159:0/1686290175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe8c054b20 0x7fbe8c04d110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbe94076a00 tx=0x7fbe94075b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.695 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.678+0000 7f2f70928640 1 -- 172.21.15.159:0/30418919 wait complete. 2024-07-24T16:24:25.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7ff7d9608640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d40b5c50 0x7ff7d40cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7f2f70928640 1 Processor -- start 2024-07-24T16:24:25.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7f6e3cfa4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6e3806cb90 0x7f6e38071b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7ff7d9608640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff7d40d30d0 0x7ff7d40aa890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7f6e3cfa4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e380b7170 0x7f6e381609f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7f1bcd3df640 1 -- 172.21.15.159:0/4145775943 shutdown_connections 2024-07-24T16:24:25.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7f1bcd3df640 1 --2- 172.21.15.159:0/4145775943 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bc806fc60 0x7f1bc80b36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7f1bcd3df640 1 --2- 172.21.15.159:0/4145775943 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc806da80 0x7f1bc8072130 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7f1bcd3df640 1 -- 172.21.15.159:0/4145775943 >> 172.21.15.159:0/4145775943 conn(0x7f1bc80b1530 msgr2=0x7f1bc80b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7ff7d2ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d40b5c50 0x7ff7d40cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7f9257a4e640 1 -- 172.21.15.159:0/3255680488 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f925006d930 con 0x7f925013e490 2024-07-24T16:24:25.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7ff7d2ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d40b5c50 0x7ff7d40cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:56894/0 (socket says 172.21.15.159:56894) 2024-07-24T16:24:25.699 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7fbe89ffb640 1 -- 172.21.15.159:0/1686290175 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe940517c0 con 0x7fbe8c054b20 2024-07-24T16:24:25.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7ff7d27fc640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff7d40d30d0 0x7ff7d40aa890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7ff7d27fc640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff7d40d30d0 0x7ff7d40aa890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:34084/0 (socket says 172.21.15.159:34084) 2024-07-24T16:24:25.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7f2f70928640 1 -- start start 2024-07-24T16:24:25.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7ff7d2ffd640 1 -- 172.21.15.159:0/1835851822 learned_addr learned my addr 172.21.15.159:0/1835851822 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7f6e3cfa4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e380b75e0 0x7f6e380d18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7ff7d9608640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7d415d610 0x7ff7d41596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7f6e3cfa4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6e380b26a0 con 0x7f6e380b7170 2024-07-24T16:24:25.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7ff7d9608640 1 -- 172.21.15.159:0/1835851822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d40b7010 con 0x7ff7d415d610 2024-07-24T16:24:25.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7f6e37fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e380b75e0 0x7f6e380d18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7f6e37fff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e380b75e0 0x7f6e380d18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:56910/0 (socket says 172.21.15.159:56910) 2024-07-24T16:24:25.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7f6e37fff640 1 -- 172.21.15.159:0/3862827158 learned_addr learned my addr 172.21.15.159:0/3862827158 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7ff7d9608640 1 -- 172.21.15.159:0/1835851822 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff7d40b6e90 con 0x7ff7d40b5c50 2024-07-24T16:24:25.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/3862827158 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6e380b2520 con 0x7f6e380b75e0 2024-07-24T16:24:25.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7ff7d9608640 1 -- 172.21.15.159:0/1835851822 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff7d40b7190 con 0x7ff7d40d30d0 2024-07-24T16:24:25.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/3862827158 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6e380d2710 con 0x7f6e3806cb90 2024-07-24T16:24:25.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7f6e377fe640 1 --2- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6e3806cb90 0x7f6e38071b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7f1bcd3df640 1 -- 172.21.15.159:0/4145775943 shutdown_connections 2024-07-24T16:24:25.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7f1bcd3df640 1 -- 172.21.15.159:0/4145775943 wait complete. 2024-07-24T16:24:25.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.680+0000 7fbe9a272640 1 -- 172.21.15.159:0/1686290175 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe8c053d60 con 0x7fbe8c054b20 2024-07-24T16:24:25.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7fbe9a272640 1 -- 172.21.15.159:0/1686290175 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8c054320 con 0x7fbe8c054b20 2024-07-24T16:24:25.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7fbe89ffb640 1 -- 172.21.15.159:0/1686290175 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe940008d0 con 0x7fbe8c054b20 2024-07-24T16:24:25.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7fbe89ffb640 1 -- 172.21.15.159:0/1686290175 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9406a0e0 con 0x7fbe8c054b20 2024-07-24T16:24:25.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7f2f70928640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f6404e9f0 0x7f2f6403cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f2f70928640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f6400b950 0x7f2f6400d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7fbca50cb640 1 Processor -- start 2024-07-24T16:24:25.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7fbca50cb640 1 -- start start 2024-07-24T16:24:25.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f2f70928640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f640e1730 0x7f2f640e1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f2f6affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f6400b950 0x7f2f6400d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f2f6affd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f6400b950 0x7f2f6400d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:56912/0 (socket says 172.21.15.159:56912) 2024-07-24T16:24:25.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f9245ffb640 1 -- 172.21.15.159:0/3255680488 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f9240044020 con 0x7f925013e490 2024-07-24T16:24:25.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7ff7d37fe640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7d415d610 0x7ff7d41596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7ff7d37fe640 1 -- 172.21.15.159:0/1835851822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff7d40d30d0 msgr2=0x7ff7d40aa890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7ff7d37fe640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff7d40d30d0 0x7ff7d40aa890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7ff7d37fe640 1 -- 172.21.15.159:0/1835851822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d40b5c50 msgr2=0x7ff7d40cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7ff7d37fe640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d40b5c50 0x7ff7d40cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7ff7d37fe640 1 -- 172.21.15.159:0/1835851822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7d41f3a00 con 0x7ff7d415d610 2024-07-24T16:24:25.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7fbe9a272640 1 -- 172.21.15.159:0/1686290175 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe8c008ae0 con 0x7fbe8c054b20 2024-07-24T16:24:25.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f2f6bfff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f640e1730 0x7f2f640e1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f2f6b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f6404e9f0 0x7f2f6403cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f2f6bfff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f640e1730 0x7f2f640e1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:34094/0 (socket says 172.21.15.159:34094) 2024-07-24T16:24:25.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f2f6b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f6404e9f0 0x7f2f6403cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59920/0 (socket says 172.21.15.159:59920) 2024-07-24T16:24:25.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.683+0000 7f2f6affd640 1 -- 172.21.15.159:0/3249883881 learned_addr learned my addr 172.21.15.159:0/3249883881 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7f25c359e640 1 -- 172.21.15.159:0/423336165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac003aa0 msgr2=0x7f25ac003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.681+0000 7f25c359e640 1 --2- 172.21.15.159:0/423336165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac003aa0 0x7f25ac003ee0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f25b4006f90 tx=0x7f25ac005830 comp rx=0 tx=0).stop 2024-07-24T16:24:25.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.683+0000 7f2f70928640 1 -- 172.21.15.159:0/3249883881 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2f640e6ec0 con 0x7f2f6404e9f0 2024-07-24T16:24:25.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.683+0000 7f9245ffb640 1 --2- 172.21.15.159:0/3255680488 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f92340770e0 0x7f92340795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.683+0000 7f2f70928640 1 -- 172.21.15.159:0/3249883881 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2f640e6d40 con 0x7f2f6400b950 2024-07-24T16:24:25.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.683+0000 7f2f70928640 1 -- 172.21.15.159:0/3249883881 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f2f64057340 con 0x7f2f640e1730 2024-07-24T16:24:25.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.683+0000 7f9245ffb640 1 -- 172.21.15.159:0/3255680488 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f92400b8290 con 0x7f925013e490 2024-07-24T16:24:25.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.683+0000 7fbca50cb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbca006c560 0x7fbca01e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f6e37fff640 1 -- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6e3806cb90 msgr2=0x7f6e38071b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f6e37fff640 1 --2- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6e3806cb90 0x7f6e38071b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f6e37fff640 1 -- 172.21.15.159:0/3862827158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e380b7170 msgr2=0x7f6e381609f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.683+0000 7f25c359e640 1 -- 172.21.15.159:0/423336165 shutdown_connections 2024-07-24T16:24:25.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.683+0000 7f1bcd3df640 1 Processor -- start 2024-07-24T16:24:25.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.683+0000 7f25c359e640 1 --2- 172.21.15.159:0/423336165 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25ac003aa0 0x7f25ac003ee0 secure :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f25b4006f90 tx=0x7f25ac005830 comp rx=0 tx=0).stop 2024-07-24T16:24:25.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.683+0000 7f25c359e640 1 -- 172.21.15.159:0/423336165 >> 172.21.15.159:0/423336165 conn(0x7f25c40d14d0 msgr2=0x7f25c40d18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:25.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f6e37fff640 1 --2- 172.21.15.159:0/3862827158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e380b7170 0x7f6e381609f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbca50cb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbca006c9c0 0x7fbca01484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f6e37fff640 1 -- 172.21.15.159:0/3862827158 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e38201860 con 0x7f6e380b75e0 2024-07-24T16:24:25.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f6e37fff640 1 --2- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e380b75e0 0x7f6e380d18e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009cd0 tx=0x7f6e30032d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7f1bcd3df640 1 -- start start 2024-07-24T16:24:25.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbc9ed9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbca006c560 0x7fbca01e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbca50cb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbca015adc0 0x7fbca0159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbc9ed9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbca006c560 0x7fbca01e4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:56924/0 (socket says 172.21.15.159:56924) 2024-07-24T16:24:25.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f6e34ff9640 1 -- 172.21.15.159:0/3862827158 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30041070 con 0x7f6e380b75e0 2024-07-24T16:24:25.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f6e34ff9640 1 -- 172.21.15.159:0/3862827158 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e30004450 con 0x7f6e380b75e0 2024-07-24T16:24:25.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbc9ed9d640 1 -- 172.21.15.159:0/2932383663 learned_addr learned my addr 172.21.15.159:0/2932383663 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbc97fff640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbca006c9c0 0x7fbca01484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7f6e34ff9640 1 -- 172.21.15.159:0/3862827158 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e30031430 con 0x7f6e380b75e0 2024-07-24T16:24:25.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbc9f59e640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbca015adc0 0x7fbca0159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbca50cb640 1 -- 172.21.15.159:0/2932383663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbca0069170 con 0x7fbca006c9c0 2024-07-24T16:24:25.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbca50cb640 1 -- 172.21.15.159:0/2932383663 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbca0072ce0 con 0x7fbca006c560 2024-07-24T16:24:25.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbca50cb640 1 -- 172.21.15.159:0/2932383663 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbca015b2c0 con 0x7fbca015adc0 2024-07-24T16:24:25.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbe89ffb640 1 -- 172.21.15.159:0/1686290175 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fbe94074040 con 0x7fbe8c054b20 2024-07-24T16:24:25.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7f25c359e640 1 -- 172.21.15.159:0/423336165 shutdown_connections 2024-07-24T16:24:25.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7f25c359e640 1 -- 172.21.15.159:0/423336165 wait complete. 2024-07-24T16:24:25.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7f92557ea640 1 --2- 172.21.15.159:0/3255680488 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f92340770e0 0x7f92340795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7f2f6b7fe640 1 -- 172.21.15.159:0/3249883881 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f640e1730 msgr2=0x7f2f640e1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7f2f6b7fe640 1 --2- 172.21.15.159:0/3249883881 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f640e1730 0x7f2f640e1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7f2f6b7fe640 1 -- 172.21.15.159:0/3249883881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f6400b950 msgr2=0x7f2f6400d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7f2f6b7fe640 1 --2- 172.21.15.159:0/3249883881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f6400b950 0x7f2f6400d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7f2f6b7fe640 1 -- 172.21.15.159:0/3249883881 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f6400c030 con 0x7f2f6404e9f0 2024-07-24T16:24:25.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/3862827158 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e380737b0 con 0x7f6e380b75e0 2024-07-24T16:24:25.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbc97fff640 1 -- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbca015adc0 msgr2=0x7fbca0159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbc97fff640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbca015adc0 0x7fbca0159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbc97fff640 1 -- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbca006c560 msgr2=0x7fbca01e4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7f2f6b7fe640 1 --2- 172.21.15.159:0/3249883881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f6404e9f0 0x7f2f6403cc90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00c380 tx=0x7f2f600010d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.685+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/3862827158 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e380710b0 con 0x7f6e380b75e0 2024-07-24T16:24:25.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.685+0000 7fbe89ffb640 1 --2- 172.21.15.159:0/1686290175 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbe78077050 0x7fbe78079510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.685+0000 7fbe89ffb640 1 -- 172.21.15.159:0/1686290175 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbe94112f50 con 0x7fbe8c054b20 2024-07-24T16:24:25.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.685+0000 7fbe99270640 1 --2- 172.21.15.159:0/1686290175 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbe78077050 0x7fbe78079510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbc97fff640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbca006c560 0x7fbca01e4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.684+0000 7fbc97fff640 1 -- 172.21.15.159:0/2932383663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbca0149620 con 0x7fbca006c9c0 2024-07-24T16:24:25.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.685+0000 7fbc9f59e640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbca015adc0 0x7fbca0159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:25.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.685+0000 7fbc97fff640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbca006c9c0 0x7fbca01484a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800bd90 tx=0x7fbc88007590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.685+0000 7f92557ea640 1 --2- 172.21.15.159:0/3255680488 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f92340770e0 0x7f92340795a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9248001be0 tx=0x7f9248002040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.682+0000 7ff7d37fe640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7d415d610 0x7ff7d41596e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009000 tx=0x7ff7cc032f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.685+0000 7f1bcd3df640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bc806da80 0x7f1bc80ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.685+0000 7f1bcd3df640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc806fc60 0x7f1bc814ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.685+0000 7f1bcd3df640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bc815a6b0 0x7f1bc81f0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.685+0000 7f1bc7fff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bc806da80 0x7f1bc80ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7fbe99270640 1 --2- 172.21.15.159:0/1686290175 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbe78077050 0x7fbe78079510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe84006690 tx=0x7fbe84006350 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bc7fff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bc806da80 0x7f1bc80ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:34104/0 (socket says 172.21.15.159:34104) 2024-07-24T16:24:25.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bc77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc806fc60 0x7f1bc814ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bc77fe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc806fc60 0x7f1bc814ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:56932/0 (socket says 172.21.15.159:56932) 2024-07-24T16:24:25.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bc7fff640 1 -- 172.21.15.159:0/1660707914 learned_addr learned my addr 172.21.15.159:0/1660707914 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bccbde640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bc815a6b0 0x7f1bc81f0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bcd3df640 1 -- 172.21.15.159:0/1660707914 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc80759e0 con 0x7f1bc815a6b0 2024-07-24T16:24:25.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bcd3df640 1 -- 172.21.15.159:0/1660707914 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1bc80702e0 con 0x7f1bc806fc60 2024-07-24T16:24:25.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bcd3df640 1 -- 172.21.15.159:0/1660707914 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1bc80b3c20 con 0x7f1bc806da80 2024-07-24T16:24:25.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f25c359e640 1 Processor -- start 2024-07-24T16:24:25.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/3862827158 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e380b2a70 con 0x7f6e380b75e0 2024-07-24T16:24:25.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f25c359e640 1 -- start start 2024-07-24T16:24:25.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bccbde640 1 -- 172.21.15.159:0/1660707914 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bc806da80 msgr2=0x7f1bc80ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bccbde640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bc806da80 0x7f1bc80ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bccbde640 1 -- 172.21.15.159:0/1660707914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc806fc60 msgr2=0x7f1bc814ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bccbde640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc806fc60 0x7f1bc814ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bccbde640 1 -- 172.21.15.159:0/1660707914 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bc80ad0a0 con 0x7f1bc815a6b0 2024-07-24T16:24:25.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bc77fe640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc806fc60 0x7f1bc814ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:24:25.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f6e34ff9640 1 -- 172.21.15.159:0/3862827158 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6e30044070 con 0x7f6e380b75e0 2024-07-24T16:24:25.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.686+0000 7f1bccbde640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bc815a6b0 0x7f1bc81f0bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000efc0 tx=0x7f1bc000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.687+0000 7f6e34ff9640 1 --2- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6e18077060 0x7f6e18079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.687+0000 7f6e34ff9640 1 -- 172.21.15.159:0/3862827158 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6e3002e020 con 0x7f6e380b75e0 2024-07-24T16:24:25.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.687+0000 7f6e377fe640 1 --2- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6e18077060 0x7f6e18079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.688+0000 7f6e377fe640 1 --2- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6e18077060 0x7f6e18079520 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6e28005fd0 tx=0x7f6e28009260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.688+0000 7f25c359e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f25c415e3f0 0x7f25c414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.688+0000 7f25c359e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25c415e7d0 0x7f25c414c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.688+0000 7f25c259c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f25c415e3f0 0x7f25c414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.688+0000 7f25c259c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f25c415e3f0 0x7f25c414fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:34108/0 (socket says 172.21.15.159:34108) 2024-07-24T16:24:25.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.688+0000 7f25c1d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25c415e7d0 0x7f25c414c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.688+0000 7f25c1d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25c415e7d0 0x7f25c414c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59942/0 (socket says 172.21.15.159:59942) 2024-07-24T16:24:25.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.688+0000 7f25c259c640 1 -- 172.21.15.159:0/1990951039 learned_addr learned my addr 172.21.15.159:0/1990951039 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:25.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.688+0000 7f25c359e640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25c414cef0 0x7f25c415bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.688+0000 7f25c359e640 1 -- 172.21.15.159:0/1990951039 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f25c40cfd20 con 0x7f25c415e7d0 2024-07-24T16:24:25.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.688+0000 7f25c359e640 1 -- 172.21.15.159:0/1990951039 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f25c40719e0 con 0x7f25c414cef0 2024-07-24T16:24:25.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.688+0000 7f25c359e640 1 -- 172.21.15.159:0/1990951039 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f25c40cfea0 con 0x7f25c415e3f0 2024-07-24T16:24:25.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.688+0000 7f25c2d9d640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25c414cef0 0x7f25c415bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.689+0000 7f25c259c640 1 -- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25c414cef0 msgr2=0x7f25c415bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.689+0000 7f25c259c640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25c414cef0 0x7f25c415bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.689+0000 7f25c259c640 1 -- 172.21.15.159:0/1990951039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25c415e7d0 msgr2=0x7f25c414c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:25.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.689+0000 7f25c259c640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25c415e7d0 0x7f25c414c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:25.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.689+0000 7f25c259c640 1 -- 172.21.15.159:0/1990951039 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c414d370 con 0x7f25c415e3f0 2024-07-24T16:24:25.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.689+0000 7f25c259c640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f25c415e3f0 0x7f25c414fc30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f25b4000c00 tx=0x7f25b4004df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.689+0000 7f25b2ffd640 1 -- 172.21.15.159:0/1990951039 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b4006bb0 con 0x7f25c415e3f0 2024-07-24T16:24:25.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.689+0000 7f25b2ffd640 1 -- 172.21.15.159:0/1990951039 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25b4006530 con 0x7f25c415e3f0 2024-07-24T16:24:25.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.689+0000 7f25b2ffd640 1 -- 172.21.15.159:0/1990951039 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25b40016f0 con 0x7f25c415e3f0 2024-07-24T16:24:25.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.689+0000 7f25c359e640 1 -- 172.21.15.159:0/1990951039 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c41f0920 con 0x7f25c415e3f0 2024-07-24T16:24:25.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.689+0000 7f25c359e640 1 -- 172.21.15.159:0/1990951039 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c414f430 con 0x7f25c415e3f0 2024-07-24T16:24:25.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.690+0000 7f9245ffb640 1 -- 172.21.15.159:0/3255680488 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f92500cbd00 con 0x7f925013e490 2024-07-24T16:24:25.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.690+0000 7f25c359e640 1 -- 172.21.15.159:0/1990951039 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c40d0400 con 0x7f25c415e3f0 2024-07-24T16:24:25.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.691+0000 7f25b2ffd640 1 -- 172.21.15.159:0/1990951039 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f25b4035020 con 0x7f25c415e3f0 2024-07-24T16:24:25.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.692+0000 7f6e34ff9640 1 -- 172.21.15.159:0/3862827158 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f6e3004b020 con 0x7f6e380b75e0 2024-07-24T16:24:25.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.692+0000 7f25b2ffd640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f25a4077040 0x7f25a4079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.692+0000 7f25b2ffd640 1 -- 172.21.15.159:0/1990951039 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f25b40b8e20 con 0x7f25c415e3f0 2024-07-24T16:24:25.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.692+0000 7f25c1d9b640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f25a4077040 0x7f25a4079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.693+0000 7f25c1d9b640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f25a4077040 0x7f25a4079500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f25c415e110 tx=0x7f25b8005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.695+0000 7f2f57fff640 1 -- 172.21.15.159:0/3249883881 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f600062e0 con 0x7f2f6404e9f0 2024-07-24T16:24:25.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.695+0000 7ff7bb7fe640 1 -- 172.21.15.159:0/1835851822 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc043dc0 con 0x7ff7d415d610 2024-07-24T16:24:25.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.695+0000 7f2f70928640 1 -- 172.21.15.159:0/3249883881 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f6400c310 con 0x7f2f6404e9f0 2024-07-24T16:24:25.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.695+0000 7ff7d9608640 1 -- 172.21.15.159:0/1835851822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7d41f3ce0 con 0x7ff7d415d610 2024-07-24T16:24:25.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.695+0000 7ff7d9608640 1 -- 172.21.15.159:0/1835851822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7d40cd8b0 con 0x7ff7d415d610 2024-07-24T16:24:25.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.695+0000 7fbe89ffb640 1 -- 172.21.15.159:0/1686290175 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fbe9409b030 con 0x7fbe8c054b20 2024-07-24T16:24:25.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.695+0000 7fbc977fe640 1 -- 172.21.15.159:0/2932383663 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88019420 con 0x7fbca006c9c0 2024-07-24T16:24:25.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.695+0000 7fbc977fe640 1 -- 172.21.15.159:0/2932383663 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc8801e070 con 0x7fbca006c9c0 2024-07-24T16:24:25.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.695+0000 7fbc977fe640 1 -- 172.21.15.159:0/2932383663 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88019840 con 0x7fbca006c9c0 2024-07-24T16:24:25.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.695+0000 7fbca50cb640 1 -- 172.21.15.159:0/2932383663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbca014cf50 con 0x7fbca006c9c0 2024-07-24T16:24:25.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.695+0000 7f2f57fff640 1 -- 172.21.15.159:0/3249883881 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f60033a70 con 0x7f2f6404e9f0 2024-07-24T16:24:25.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.696+0000 7fbca50cb640 1 -- 172.21.15.159:0/2932383663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbca01e5800 con 0x7fbca006c9c0 2024-07-24T16:24:25.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.696+0000 7f2f70928640 1 -- 172.21.15.159:0/3249883881 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f6400c8d0 con 0x7f2f6404e9f0 2024-07-24T16:24:25.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.695+0000 7ff7bb7fe640 1 -- 172.21.15.159:0/1835851822 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff7cc003ba0 con 0x7ff7d415d610 2024-07-24T16:24:25.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.695+0000 7ff7bb7fe640 1 -- 172.21.15.159:0/1835851822 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0317e0 con 0x7ff7d415d610 2024-07-24T16:24:25.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.697+0000 7f25b2ffd640 1 -- 172.21.15.159:0/1990951039 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f25b40816a0 con 0x7f25c415e3f0 2024-07-24T16:24:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.697+0000 7f2f57fff640 1 -- 172.21.15.159:0/3249883881 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f60006480 con 0x7f2f6404e9f0 2024-07-24T16:24:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.697+0000 7fbca50cb640 1 -- 172.21.15.159:0/2932383663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbca015b680 con 0x7fbca006c9c0 2024-07-24T16:24:25.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.698+0000 7ff7bb7fe640 1 -- 172.21.15.159:0/1835851822 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff7cc039040 con 0x7ff7d415d610 2024-07-24T16:24:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.698+0000 7f2f55ffb640 1 -- 172.21.15.159:0/3249883881 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f64056c30 con 0x7f2f6404e9f0 2024-07-24T16:24:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.698+0000 7f1bc4ff9640 1 -- 172.21.15.159:0/1660707914 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0003970 con 0x7f1bc815a6b0 2024-07-24T16:24:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.698+0000 7f1bc4ff9640 1 -- 172.21.15.159:0/1660707914 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1bc0003c20 con 0x7f1bc815a6b0 2024-07-24T16:24:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.698+0000 7f1bc4ff9640 1 -- 172.21.15.159:0/1660707914 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0004280 con 0x7f1bc815a6b0 2024-07-24T16:24:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.699+0000 7f1bcd3df640 1 -- 172.21.15.159:0/1660707914 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bc80ad380 con 0x7f1bc815a6b0 2024-07-24T16:24:25.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.699+0000 7f1bcd3df640 1 -- 172.21.15.159:0/1660707914 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bc80ad940 con 0x7f1bc815a6b0 2024-07-24T16:24:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.699+0000 7ff7bb7fe640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff7c0077010 0x7ff7c00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.699+0000 7ff7bb7fe640 1 -- 172.21.15.159:0/1835851822 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ff7cc0c2460 con 0x7ff7d415d610 2024-07-24T16:24:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.700+0000 7fbc977fe640 1 -- 172.21.15.159:0/2932383663 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fbc880199e0 con 0x7fbca006c9c0 2024-07-24T16:24:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.701+0000 7fbc977fe640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbc84077010 0x7fbc840794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.701+0000 7fbc977fe640 1 -- 172.21.15.159:0/2932383663 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbc8809dff0 con 0x7fbca006c9c0 2024-07-24T16:24:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.701+0000 7f1bcd3df640 1 -- 172.21.15.159:0/1660707914 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1bc80b4180 con 0x7f1bc815a6b0 2024-07-24T16:24:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.701+0000 7ff7d9608640 1 -- 172.21.15.159:0/1835851822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7b4005290 con 0x7ff7d415d610 2024-07-24T16:24:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.701+0000 7ff7d2ffd640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff7c0077010 0x7ff7c00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.701+0000 7fbc9ed9d640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbc84077010 0x7fbc840794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.702+0000 7ff7d2ffd640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff7c0077010 0x7ff7c00794d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4007fd0 tx=0x7ff7c4001470 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.702+0000 7f2f57fff640 1 -- 172.21.15.159:0/3249883881 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f2f60047030 con 0x7f2f6404e9f0 2024-07-24T16:24:25.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.702+0000 7fbc9ed9d640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbc84077010 0x7fbc840794d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbca01e5ad0 tx=0x7fbc90033040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.703+0000 7f2f57fff640 1 --2- 172.21.15.159:0/3249883881 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2f50077010 0x7f2f500794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.703+0000 7f2f57fff640 1 -- 172.21.15.159:0/3249883881 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2f600c09b0 con 0x7f2f6404e9f0 2024-07-24T16:24:25.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.703+0000 7f2f6affd640 1 --2- 172.21.15.159:0/3249883881 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2f50077010 0x7f2f500794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.703+0000 7f2f6affd640 1 --2- 172.21.15.159:0/3249883881 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2f50077010 0x7f2f500794d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2f640e23c0 tx=0x7f2f58005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.705+0000 7fbc977fe640 1 -- 172.21.15.159:0/2932383663 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fbca0149620 con 0x7fbca006c9c0 2024-07-24T16:24:25.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.707+0000 7f1bc4ff9640 1 -- 172.21.15.159:0/1660707914 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1bc0004420 con 0x7f1bc815a6b0 2024-07-24T16:24:25.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.708+0000 7f1bc4ff9640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1bb4077060 0x7f1bb4079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:25.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.709+0000 7f1bc7fff640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1bb4077060 0x7f1bb4079520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:25.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.709+0000 7f1bc7fff640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1bb4077060 0x7f1bb4079520 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80095f0 tx=0x7f1bb8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:25.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.710+0000 7ff7bb7fe640 1 -- 172.21.15.159:0/1835851822 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7ff7cc08ad50 con 0x7ff7d415d610 2024-07-24T16:24:25.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.715+0000 7f1bc4ff9640 1 -- 172.21.15.159:0/1660707914 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1bc0003e10 con 0x7f1bc815a6b0 2024-07-24T16:24:25.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.715+0000 7f2f57fff640 1 -- 172.21.15.159:0/3249883881 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f2f600892e0 con 0x7f2f6404e9f0 2024-07-24T16:24:25.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:25.723+0000 7f1bc4ff9640 1 -- 172.21.15.159:0/1660707914 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f1bc0024020 con 0x7f1bc815a6b0 2024-07-24T16:24:26.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.126+0000 7f9257a4e640 1 -- 172.21.15.159:0/3255680488 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f92500ae5c0 con 0x7f925013e490 2024-07-24T16:24:26.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.127+0000 7f9245ffb640 1 -- 172.21.15.159:0/3255680488 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9240081250 con 0x7f925013e490 2024-07-24T16:24:26.129 INFO:teuthology.orchestra.run.smithi159.stdout:55834574854 2024-07-24T16:24:26.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.130+0000 7f92337fe640 1 -- 172.21.15.159:0/3255680488 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f92340770e0 msgr2=0x7f92340795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.130+0000 7f92337fe640 1 --2- 172.21.15.159:0/3255680488 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f92340770e0 0x7f92340795a0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f9248001be0 tx=0x7f9248002040 comp rx=0 tx=0).stop 2024-07-24T16:24:26.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.131+0000 7f92337fe640 1 -- 172.21.15.159:0/3255680488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f925013e490 msgr2=0x7f9250071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.131+0000 7f92337fe640 1 --2- 172.21.15.159:0/3255680488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f925013e490 0x7f9250071ca0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f92400017e0 tx=0x7f92400063c0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.131+0000 7f92337fe640 1 -- 172.21.15.159:0/3255680488 shutdown_connections 2024-07-24T16:24:26.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.131+0000 7f92337fe640 1 --2- 172.21.15.159:0/3255680488 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f92340770e0 0x7f92340795a0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.131+0000 7f92337fe640 1 --2- 172.21.15.159:0/3255680488 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9250129500 0x7f9250129980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.131+0000 7f92337fe640 1 --2- 172.21.15.159:0/3255680488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f925013e490 0x7f9250071ca0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.131+0000 7f92337fe640 1 --2- 172.21.15.159:0/3255680488 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f923c004800 0x7f9250071760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.131+0000 7f92337fe640 1 -- 172.21.15.159:0/3255680488 >> 172.21.15.159:0/3255680488 conn(0x7f92500b4a20 msgr2=0x7f9250141e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:26.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.132+0000 7f92337fe640 1 -- 172.21.15.159:0/3255680488 shutdown_connections 2024-07-24T16:24:26.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.132+0000 7f92337fe640 1 -- 172.21.15.159:0/3255680488 wait complete. 2024-07-24T16:24:26.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.132+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/3862827158 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6e380cdf70 con 0x7f6e380b75e0 2024-07-24T16:24:26.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.133+0000 7f6e34ff9640 1 -- 172.21.15.159:0/3862827158 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6e30082ca0 con 0x7f6e380b75e0 2024-07-24T16:24:26.136 INFO:teuthology.orchestra.run.smithi159.stdout:55834574854 2024-07-24T16:24:26.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.134+0000 7f25c359e640 1 -- 172.21.15.159:0/1990951039 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f25c4070d60 con 0x7f25c415e3f0 2024-07-24T16:24:26.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.135+0000 7f25b2ffd640 1 -- 172.21.15.159:0/1990951039 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f25b4085bf0 con 0x7f25c415e3f0 2024-07-24T16:24:26.138 INFO:teuthology.orchestra.run.smithi159.stdout:55834574855 2024-07-24T16:24:26.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.137+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6e18077060 msgr2=0x7f6e18079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.138+0000 7f6e3cfa4640 1 --2- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6e18077060 0x7f6e18079520 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6e28005fd0 tx=0x7f6e28009260 comp rx=0 tx=0).stop 2024-07-24T16:24:26.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.138+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e380b75e0 msgr2=0x7f6e380d18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.138+0000 7f6e3cfa4640 1 --2- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e380b75e0 0x7f6e380d18e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e30009cd0 tx=0x7f6e30032d30 comp rx=0 tx=0).stop 2024-07-24T16:24:26.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.138+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/3862827158 shutdown_connections 2024-07-24T16:24:26.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.138+0000 7f6e3cfa4640 1 --2- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6e18077060 0x7f6e18079520 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.138+0000 7f6e3cfa4640 1 --2- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e380b75e0 0x7f6e380d18e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.138+0000 7f6e3cfa4640 1 --2- 172.21.15.159:0/3862827158 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6e380b7170 0x7f6e381609f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.138+0000 7f6e3cfa4640 1 --2- 172.21.15.159:0/3862827158 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6e3806cb90 0x7f6e38071b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.138+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/3862827158 >> 172.21.15.159:0/3862827158 conn(0x7f6e380d35f0 msgr2=0x7f6e380b30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:26.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.138+0000 7fbe9a272640 1 -- 172.21.15.159:0/1686290175 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fbe8c032f20 con 0x7fbe8c054b20 2024-07-24T16:24:26.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/3862827158 shutdown_connections 2024-07-24T16:24:26.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f6e3cfa4640 1 -- 172.21.15.159:0/3862827158 wait complete. 2024-07-24T16:24:26.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f25c359e640 1 -- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f25a4077040 msgr2=0x7f25a4079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f25c359e640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f25a4077040 0x7f25a4079500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f25c415e110 tx=0x7f25b8005f90 comp rx=0 tx=0).stop 2024-07-24T16:24:26.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f25c359e640 1 -- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f25c415e3f0 msgr2=0x7f25c414fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7fbe89ffb640 1 -- 172.21.15.159:0/1686290175 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbe94112020 con 0x7fbe8c054b20 2024-07-24T16:24:26.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f25c359e640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f25c415e3f0 0x7f25c414fc30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f25b4000c00 tx=0x7f25b4004df0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f25c359e640 1 -- 172.21.15.159:0/1990951039 shutdown_connections 2024-07-24T16:24:26.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f25c359e640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f25a4077040 0x7f25a4079500 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f25c359e640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f25c414cef0 0x7f25c415bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f25c359e640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f25c415e7d0 0x7f25c414c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f25c359e640 1 --2- 172.21.15.159:0/1990951039 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f25c415e3f0 0x7f25c414fc30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f25c359e640 1 -- 172.21.15.159:0/1990951039 >> 172.21.15.159:0/1990951039 conn(0x7f25c40d14d0 msgr2=0x7f25c40b5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:26.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f25c359e640 1 -- 172.21.15.159:0/1990951039 shutdown_connections 2024-07-24T16:24:26.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.139+0000 7f25c359e640 1 -- 172.21.15.159:0/1990951039 wait complete. 2024-07-24T16:24:26.145 INFO:teuthology.orchestra.run.smithi159.stdout:55834574855 2024-07-24T16:24:26.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.144+0000 7fbe9a272640 1 -- 172.21.15.159:0/1686290175 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbe78077050 msgr2=0x7fbe78079510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.144+0000 7fbe9a272640 1 --2- 172.21.15.159:0/1686290175 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbe78077050 0x7fbe78079510 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fbe84006690 tx=0x7fbe84006350 comp rx=0 tx=0).stop 2024-07-24T16:24:26.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.144+0000 7fbe9a272640 1 -- 172.21.15.159:0/1686290175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe8c054b20 msgr2=0x7fbe8c04d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.144+0000 7fbe9a272640 1 --2- 172.21.15.159:0/1686290175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe8c054b20 0x7fbe8c04d110 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbe94076a00 tx=0x7fbe94075b10 comp rx=0 tx=0).stop 2024-07-24T16:24:26.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.144+0000 7fbe9a272640 1 -- 172.21.15.159:0/1686290175 shutdown_connections 2024-07-24T16:24:26.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.144+0000 7fbe9a272640 1 --2- 172.21.15.159:0/1686290175 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbe78077050 0x7fbe78079510 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.144+0000 7fbe9a272640 1 --2- 172.21.15.159:0/1686290175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbe8c054b20 0x7fbe8c04d110 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.144+0000 7fbe9a272640 1 --2- 172.21.15.159:0/1686290175 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbe8c053580 0x7fbe8c0d5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.144+0000 7fbe9a272640 1 --2- 172.21.15.159:0/1686290175 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbe80006490 0x7fbe8c04f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.144+0000 7fbe9a272640 1 -- 172.21.15.159:0/1686290175 >> 172.21.15.159:0/1686290175 conn(0x7fbe8c01e8d0 msgr2=0x7fbe8c0509e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:26.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.144+0000 7f2f55ffb640 1 -- 172.21.15.159:0/3249883881 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2f6403bd80 con 0x7f2f6404e9f0 2024-07-24T16:24:26.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.144+0000 7fbe9a272640 1 -- 172.21.15.159:0/1686290175 shutdown_connections 2024-07-24T16:24:26.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.145+0000 7fbe9a272640 1 -- 172.21.15.159:0/1686290175 wait complete. 2024-07-24T16:24:26.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.145+0000 7f2f57fff640 1 -- 172.21.15.159:0/3249883881 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2f6008d830 con 0x7f2f6404e9f0 2024-07-24T16:24:26.149 INFO:teuthology.orchestra.run.smithi159.stdout:55834574854 2024-07-24T16:24:26.151 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.149+0000 7f2f70928640 1 -- 172.21.15.159:0/3249883881 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2f50077010 msgr2=0x7f2f500794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.149+0000 7f2f70928640 1 --2- 172.21.15.159:0/3249883881 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2f50077010 0x7f2f500794d0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2f640e23c0 tx=0x7f2f58005f90 comp rx=0 tx=0).stop 2024-07-24T16:24:26.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.149+0000 7f2f70928640 1 -- 172.21.15.159:0/3249883881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f6404e9f0 msgr2=0x7f2f6403cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.152 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.149+0000 7f2f70928640 1 --2- 172.21.15.159:0/3249883881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f6404e9f0 0x7f2f6403cc90 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00c380 tx=0x7f2f600010d0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.150+0000 7f2f70928640 1 -- 172.21.15.159:0/3249883881 shutdown_connections 2024-07-24T16:24:26.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.150+0000 7f2f70928640 1 --2- 172.21.15.159:0/3249883881 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2f50077010 0x7f2f500794d0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.150+0000 7f2f70928640 1 --2- 172.21.15.159:0/3249883881 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2f640e1730 0x7f2f640e1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.150+0000 7f2f70928640 1 --2- 172.21.15.159:0/3249883881 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2f6400b950 0x7f2f6400d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.150+0000 7f2f70928640 1 --2- 172.21.15.159:0/3249883881 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2f6404e9f0 0x7f2f6403cc90 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.153 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.150+0000 7f2f70928640 1 -- 172.21.15.159:0/3249883881 >> 172.21.15.159:0/3249883881 conn(0x7f2f6403a3c0 msgr2=0x7f2f640382e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:26.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.150+0000 7ff7d9608640 1 -- 172.21.15.159:0/1835851822 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff7b4005580 con 0x7ff7d415d610 2024-07-24T16:24:26.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.150+0000 7fbca50cb640 1 -- 172.21.15.159:0/2932383663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fbca006f150 con 0x7fbca006c9c0 2024-07-24T16:24:26.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.151+0000 7f2f70928640 1 -- 172.21.15.159:0/3249883881 shutdown_connections 2024-07-24T16:24:26.154 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.151+0000 7fbc977fe640 1 -- 172.21.15.159:0/2932383663 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbc88066f20 con 0x7fbca006c9c0 2024-07-24T16:24:26.155 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.151+0000 7f2f70928640 1 -- 172.21.15.159:0/3249883881 wait complete. 2024-07-24T16:24:26.155 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2024-07-24T16:24:26.156 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.151+0000 7ff7bb7fe640 1 -- 172.21.15.159:0/1835851822 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff7cc08f2a0 con 0x7ff7d415d610 2024-07-24T16:24:26.156 INFO:teuthology.orchestra.run.smithi159.stdout:55834574854 2024-07-24T16:24:26.156 INFO:teuthology.orchestra.run.smithi159.stdout:55834574855 2024-07-24T16:24:26.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.154+0000 7ff7d9608640 1 -- 172.21.15.159:0/1835851822 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff7c0077010 msgr2=0x7ff7c00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.154+0000 7ff7d9608640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff7c0077010 0x7ff7c00794d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff7c4007fd0 tx=0x7ff7c4001470 comp rx=0 tx=0).stop 2024-07-24T16:24:26.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.154+0000 7ff7d9608640 1 -- 172.21.15.159:0/1835851822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7d415d610 msgr2=0x7ff7d41596e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.154+0000 7ff7d9608640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7d415d610 0x7ff7d41596e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009000 tx=0x7ff7cc032f80 comp rx=0 tx=0).stop 2024-07-24T16:24:26.157 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.154+0000 7ff7d9608640 1 -- 172.21.15.159:0/1835851822 shutdown_connections 2024-07-24T16:24:26.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.154+0000 7ff7d9608640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff7c0077010 0x7ff7c00794d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.154+0000 7ff7d9608640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff7d415d610 0x7ff7d41596e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.154+0000 7ff7d9608640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff7d40d30d0 0x7ff7d40aa890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.154+0000 7ff7d9608640 1 --2- 172.21.15.159:0/1835851822 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff7d40b5c50 0x7ff7d40cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.154+0000 7ff7d9608640 1 -- 172.21.15.159:0/1835851822 >> 172.21.15.159:0/1835851822 conn(0x7ff7d40d0550 msgr2=0x7ff7d40b8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:26.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.154+0000 7ff7d9608640 1 -- 172.21.15.159:0/1835851822 shutdown_connections 2024-07-24T16:24:26.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.154+0000 7ff7d9608640 1 -- 172.21.15.159:0/1835851822 wait complete. 2024-07-24T16:24:26.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.155+0000 7fbca50cb640 1 -- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbc84077010 msgr2=0x7fbc840794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.155+0000 7fbca50cb640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbc84077010 0x7fbc840794d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbca01e5ad0 tx=0x7fbc90033040 comp rx=0 tx=0).stop 2024-07-24T16:24:26.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.155+0000 7fbca50cb640 1 -- 172.21.15.159:0/2932383663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbca006c9c0 msgr2=0x7fbca01484a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.155+0000 7fbca50cb640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbca006c9c0 0x7fbca01484a0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800bd90 tx=0x7fbc88007590 comp rx=0 tx=0).stop 2024-07-24T16:24:26.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.155+0000 7fbca50cb640 1 -- 172.21.15.159:0/2932383663 shutdown_connections 2024-07-24T16:24:26.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.155+0000 7fbca50cb640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fbc84077010 0x7fbc840794d0 secure :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbca01e5ad0 tx=0x7fbc90033040 comp rx=0 tx=0).stop 2024-07-24T16:24:26.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.155+0000 7fbca50cb640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbca015adc0 0x7fbca0159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.155+0000 7fbca50cb640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbca006c9c0 0x7fbca01484a0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.155+0000 7fbca50cb640 1 --2- 172.21.15.159:0/2932383663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbca006c560 0x7fbca01e4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.155+0000 7fbca50cb640 1 -- 172.21.15.159:0/2932383663 >> 172.21.15.159:0/2932383663 conn(0x7fbca006e1a0 msgr2=0x7fbca00683a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:26.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.155+0000 7fbca50cb640 1 -- 172.21.15.159:0/2932383663 shutdown_connections 2024-07-24T16:24:26.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.157+0000 7fbca50cb640 1 -- 172.21.15.159:0/2932383663 wait complete. 2024-07-24T16:24:26.162 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2024-07-24T16:24:26.166 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-07-24T16:24:26.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.166+0000 7f1bcd3df640 1 -- 172.21.15.159:0/1660707914 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1bc80afe90 con 0x7f1bc815a6b0 2024-07-24T16:24:26.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.166+0000 7f1bc4ff9640 1 -- 172.21.15.159:0/1660707914 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1bc0062130 con 0x7f1bc815a6b0 2024-07-24T16:24:26.169 INFO:teuthology.orchestra.run.smithi159.stdout:55834574855 2024-07-24T16:24:26.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2024-07-24T16:24:26.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.170+0000 7f1bcd3df640 1 -- 172.21.15.159:0/1660707914 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1bb4077060 msgr2=0x7f1bb4079520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.170+0000 7f1bcd3df640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1bb4077060 0x7f1bb4079520 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1bb80095f0 tx=0x7f1bb8004730 comp rx=0 tx=0).stop 2024-07-24T16:24:26.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.170+0000 7f1bcd3df640 1 -- 172.21.15.159:0/1660707914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bc815a6b0 msgr2=0x7f1bc81f0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:26.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.170+0000 7f1bcd3df640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bc815a6b0 0x7f1bc81f0bb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000efc0 tx=0x7f1bc000c800 comp rx=0 tx=0).stop 2024-07-24T16:24:26.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.170+0000 7f1bcd3df640 1 -- 172.21.15.159:0/1660707914 shutdown_connections 2024-07-24T16:24:26.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.170+0000 7f1bcd3df640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1bb4077060 0x7f1bb4079520 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.170+0000 7f1bcd3df640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1bc815a6b0 0x7f1bc81f0bb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.170+0000 7f1bcd3df640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1bc806fc60 0x7f1bc814ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.170+0000 7f1bcd3df640 1 --2- 172.21.15.159:0/1660707914 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1bc806da80 0x7f1bc80ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:26.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.170+0000 7f1bcd3df640 1 -- 172.21.15.159:0/1660707914 >> 172.21.15.159:0/1660707914 conn(0x7f1bc80b1530 msgr2=0x7f1bc81502b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:26.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.170+0000 7f1bcd3df640 1 -- 172.21.15.159:0/1660707914 shutdown_connections 2024-07-24T16:24:26.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:26.170+0000 7f1bcd3df640 1 -- 172.21.15.159:0/1660707914 wait complete. 2024-07-24T16:24:26.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2024-07-24T16:24:26.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2024-07-24T16:24:26.177 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.2 2024-07-24T16:24:26.186 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.0 2024-07-24T16:24:27.157 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-07-24T16:24:27.163 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-07-24T16:24:27.166 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-07-24T16:24:27.171 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-07-24T16:24:27.176 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-07-24T16:24:27.178 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-07-24T16:24:27.178 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-07-24T16:24:27.188 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-07-24T16:24:27.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.330+0000 7f6d10cb0640 1 -- 172.21.15.159:0/2306245190 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6cf4003a30 msgr2=0x7f6cf4003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.330+0000 7f6d10cb0640 1 --2- 172.21.15.159:0/2306245190 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6cf4003a30 0x7f6cf4003e30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00c4a0 tx=0x7f6cf4005830 comp rx=0 tx=0).stop 2024-07-24T16:24:27.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.330+0000 7f6d0ad9d640 1 -- 172.21.15.159:0/2306245190 reap_dead start 2024-07-24T16:24:27.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.330+0000 7f6d10cb0640 1 -- 172.21.15.159:0/2306245190 shutdown_connections 2024-07-24T16:24:27.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.330+0000 7f6d10cb0640 1 -- 172.21.15.159:0/2306245190 >> 172.21.15.159:0/2306245190 conn(0x7f6d0c06cbc0 msgr2=0x7f6d0c0b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.331+0000 7f6d10cb0640 1 -- 172.21.15.159:0/2306245190 shutdown_connections 2024-07-24T16:24:27.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.331+0000 7f6d10cb0640 1 -- 172.21.15.159:0/2306245190 wait complete. 2024-07-24T16:24:27.335 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.333+0000 7f6d10cb0640 1 Processor -- start 2024-07-24T16:24:27.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.333+0000 7f6d10cb0640 1 -- start start 2024-07-24T16:24:27.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.334+0000 7f6d10cb0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d0c0afa30 0x7f6d0c149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.334+0000 7f6d10cb0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6d0c0afe10 0x7f6d0c14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.335+0000 7f6d10cb0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d0c14db20 0x7f6d0c14dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.335+0000 7f6d09d9b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6d0c0afe10 0x7f6d0c14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.335+0000 7f6d09d9b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6d0c0afe10 0x7f6d0c14a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:34134/0 (socket says 172.21.15.159:34134) 2024-07-24T16:24:27.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.335+0000 7f6d09d9b640 1 -- 172.21.15.159:0/3305056961 learned_addr learned my addr 172.21.15.159:0/3305056961 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:27.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.335+0000 7f6d0a59c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d0c0afa30 0x7f6d0c149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.335+0000 7f6d0ad9d640 1 --2- 172.21.15.159:0/3305056961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d0c14db20 0x7f6d0c14dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.335+0000 7f6d10cb0640 1 -- 172.21.15.159:0/3305056961 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c153b50 con 0x7f6d0c14db20 2024-07-24T16:24:27.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.335+0000 7f6d10cb0640 1 -- 172.21.15.159:0/3305056961 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6d0c1539d0 con 0x7f6d0c0afa30 2024-07-24T16:24:27.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.335+0000 7f6d10cb0640 1 -- 172.21.15.159:0/3305056961 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0c153cd0 con 0x7f6d0c0afe10 2024-07-24T16:24:27.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.336+0000 7f6d09d9b640 1 -- 172.21.15.159:0/3305056961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d0c0afa30 msgr2=0x7f6d0c149b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.336+0000 7f6d09d9b640 1 --2- 172.21.15.159:0/3305056961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d0c0afa30 0x7f6d0c149b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.336+0000 7f6d09d9b640 1 -- 172.21.15.159:0/3305056961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d0c14db20 msgr2=0x7f6d0c14dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.336+0000 7f6d09d9b640 1 --2- 172.21.15.159:0/3305056961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d0c14db20 0x7f6d0c14dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.336+0000 7f6d09d9b640 1 -- 172.21.15.159:0/3305056961 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d0c14a6f0 con 0x7f6d0c0afe10 2024-07-24T16:24:27.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.336+0000 7f6d09d9b640 1 --2- 172.21.15.159:0/3305056961 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6d0c0afe10 0x7f6d0c14a0b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400c6d0 tx=0x7f6d0400cb90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.337+0000 7f6cfaffd640 1 -- 172.21.15.159:0/3305056961 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04016020 con 0x7f6d0c0afe10 2024-07-24T16:24:27.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.337+0000 7f6cfaffd640 1 -- 172.21.15.159:0/3305056961 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d0400a930 con 0x7f6d0c0afe10 2024-07-24T16:24:27.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.337+0000 7f6cfaffd640 1 -- 172.21.15.159:0/3305056961 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0400adc0 con 0x7f6d0c0afe10 2024-07-24T16:24:27.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.337+0000 7f6d10cb0640 1 -- 172.21.15.159:0/3305056961 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d0c0b0710 con 0x7f6d0c0afe10 2024-07-24T16:24:27.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.337+0000 7f6d10cb0640 1 -- 172.21.15.159:0/3305056961 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d0c0b0cd0 con 0x7f6d0c0afe10 2024-07-24T16:24:27.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.339+0000 7f6d10cb0640 1 -- 172.21.15.159:0/3305056961 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d0c14e4e0 con 0x7f6d0c0afe10 2024-07-24T16:24:27.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.341+0000 7f6cfaffd640 1 -- 172.21.15.159:0/3305056961 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6d04019020 con 0x7f6d0c0afe10 2024-07-24T16:24:27.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.342+0000 7f6cfaffd640 1 --2- 172.21.15.159:0/3305056961 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6cec077040 0x7f6cec079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.342+0000 7f6cfaffd640 1 -- 172.21.15.159:0/3305056961 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6d040991f0 con 0x7f6d0c0afe10 2024-07-24T16:24:27.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.342+0000 7f6d0a59c640 1 --2- 172.21.15.159:0/3305056961 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6cec077040 0x7f6cec079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.343+0000 7f6d0a59c640 1 --2- 172.21.15.159:0/3305056961 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6cec077040 0x7f6cec079500 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc033000 tx=0x7f6cfc02d070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.344+0000 7f6cfaffd640 1 -- 172.21.15.159:0/3305056961 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f6d04020070 con 0x7f6d0c0afe10 2024-07-24T16:24:27.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.380+0000 7f84b7fff640 1 -- 172.21.15.159:0/4025086416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b8161060 msgr2=0x7f84b80ccb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.380+0000 7f84b7fff640 1 --2- 172.21.15.159:0/4025086416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b8161060 0x7f84b80ccb30 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009880 tx=0x7f84ac02a4d0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.381+0000 7f84b7fff640 1 -- 172.21.15.159:0/4025086416 shutdown_connections 2024-07-24T16:24:27.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.381+0000 7f84b7fff640 1 --2- 172.21.15.159:0/4025086416 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b8161060 0x7f84b80ccb30 secure :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f84ac009880 tx=0x7f84ac02a4d0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.381+0000 7f84b7fff640 1 --2- 172.21.15.159:0/4025086416 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f84b8146c70 0x7f84b80adea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.381+0000 7fb0c8a11640 1 -- 172.21.15.159:0/3835594473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c406ff20 msgr2=0x7fb0c4153740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.381+0000 7fb0c8a11640 1 --2- 172.21.15.159:0/3835594473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c406ff20 0x7fb0c4153740 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8005fd0 tx=0x7fb0b802a480 comp rx=0 tx=0).stop 2024-07-24T16:24:27.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.381+0000 7f84b7fff640 1 -- 172.21.15.159:0/4025086416 >> 172.21.15.159:0/4025086416 conn(0x7f84b80b49f0 msgr2=0x7f84b80b4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.381+0000 7fb0c8a11640 1 -- 172.21.15.159:0/3835594473 shutdown_connections 2024-07-24T16:24:27.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.381+0000 7fb0c8a11640 1 --2- 172.21.15.159:0/3835594473 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c406ff20 0x7fb0c4153740 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.381+0000 7fb0c8a11640 1 -- 172.21.15.159:0/3835594473 >> 172.21.15.159:0/3835594473 conn(0x7fb0c406cbc0 msgr2=0x7fb0c40b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.381+0000 7fb0c8a11640 1 -- 172.21.15.159:0/3835594473 shutdown_connections 2024-07-24T16:24:27.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.381+0000 7fb0c8a11640 1 -- 172.21.15.159:0/3835594473 wait complete. 2024-07-24T16:24:27.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.381+0000 7f84b7fff640 1 -- 172.21.15.159:0/4025086416 shutdown_connections 2024-07-24T16:24:27.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.382+0000 7f42563cb640 1 -- 172.21.15.159:0/617273681 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42500cfc10 msgr2=0x7f425015a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.382+0000 7f42563cb640 1 --2- 172.21.15.159:0/617273681 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42500cfc10 0x7f425015a490 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4240007380 tx=0x7f424002b1a0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.382+0000 7f42563cb640 1 -- 172.21.15.159:0/617273681 shutdown_connections 2024-07-24T16:24:27.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.382+0000 7f42563cb640 1 --2- 172.21.15.159:0/617273681 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42500cfc10 0x7f425015a490 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.382+0000 7f42563cb640 1 -- 172.21.15.159:0/617273681 >> 172.21.15.159:0/617273681 conn(0x7f425006c560 msgr2=0x7f425006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.382+0000 7f84b7fff640 1 -- 172.21.15.159:0/4025086416 wait complete. 2024-07-24T16:24:27.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.383+0000 7f42563cb640 1 -- 172.21.15.159:0/617273681 shutdown_connections 2024-07-24T16:24:27.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.383+0000 7fe949b0c640 1 -- 172.21.15.159:0/2072291737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe94406faf0 msgr2=0x7fe9440cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.383+0000 7fe949b0c640 1 --2- 172.21.15.159:0/2072291737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe94406faf0 0x7fe9440cf500 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe9440719b0 tx=0x7fe93402a600 comp rx=0 tx=0).stop 2024-07-24T16:24:27.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.384+0000 7fe949b0c640 1 -- 172.21.15.159:0/2072291737 shutdown_connections 2024-07-24T16:24:27.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.384+0000 7fe949b0c640 1 --2- 172.21.15.159:0/2072291737 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe94406faf0 0x7fe9440cf500 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.384+0000 7fe949b0c640 1 --2- 172.21.15.159:0/2072291737 >> v2:172.21.15.193:3300/0 conn(0x7fe94406e360 0x7fe944156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.384+0000 7fe949b0c640 1 -- 172.21.15.159:0/2072291737 >> 172.21.15.159:0/2072291737 conn(0x7fe94406c560 msgr2=0x7fe94406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.384+0000 7f42563cb640 1 -- 172.21.15.159:0/617273681 wait complete. 2024-07-24T16:24:27.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.384+0000 7fb0c8a11640 1 Processor -- start 2024-07-24T16:24:27.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.384+0000 7fac06cc6640 1 -- 172.21.15.159:0/2258675634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac000cfa40 msgr2=0x7fac00159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.384+0000 7fac06cc6640 1 --2- 172.21.15.159:0/2258675634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac000cfa40 0x7fac00159d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fabf4005fd0 tx=0x7fabf402a5f0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.384+0000 7fe949b0c640 1 -- 172.21.15.159:0/2072291737 shutdown_connections 2024-07-24T16:24:27.391 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.384+0000 7fe949b0c640 1 -- 172.21.15.159:0/2072291737 wait complete. 2024-07-24T16:24:27.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.384+0000 7f84b7fff640 1 Processor -- start 2024-07-24T16:24:27.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.384+0000 7f84b7fff640 1 -- start start 2024-07-24T16:24:27.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7fac06cc6640 1 -- 172.21.15.159:0/2258675634 shutdown_connections 2024-07-24T16:24:27.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7fac06cc6640 1 --2- 172.21.15.159:0/2258675634 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fac0006faf0 0x7fac000cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7fac06cc6640 1 --2- 172.21.15.159:0/2258675634 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac000cfa40 0x7fac00159d80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7fac06cc6640 1 -- 172.21.15.159:0/2258675634 >> 172.21.15.159:0/2258675634 conn(0x7fac0006c560 msgr2=0x7fac0006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7f84b7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b80cd070 0x7f84b81e7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7f84b7fff640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f84b8146c70 0x7f84b815db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7f84b6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b80cd070 0x7f84b81e7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7f84b6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b80cd070 0x7f84b81e7e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60036/0 (socket says 172.21.15.159:60036) 2024-07-24T16:24:27.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7f84b6ffd640 1 -- 172.21.15.159:0/2485213427 learned_addr learned my addr 172.21.15.159:0/2485213427 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:27.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7f84b7fff640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b815e0a0 0x7f84b815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7f84b7fff640 1 -- 172.21.15.159:0/2485213427 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f84b80b2990 con 0x7f84b80cd070 2024-07-24T16:24:27.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7f84b7fff640 1 -- 172.21.15.159:0/2485213427 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f84b80b2810 con 0x7f84b815e0a0 2024-07-24T16:24:27.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7f84b7fff640 1 -- 172.21.15.159:0/2485213427 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f84b80b2b10 con 0x7f84b8146c70 2024-07-24T16:24:27.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.384+0000 7fb0c8a11640 1 -- start start 2024-07-24T16:24:27.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7fb0c8a11640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0c406fb40 0x7fb0c414d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7f84b77fe640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b815e0a0 0x7f84b815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.395 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7fb0c8a11640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0c406ff20 0x7fb0c4139f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7fb0c8a11640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c415eee0 0x7fb0c40af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7f3b2e44e640 1 -- 172.21.15.159:0/1922174054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b140051c0 msgr2=0x7f3b1400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7f3b2e44e640 1 --2- 172.21.15.159:0/1922174054 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b140051c0 0x7f3b1400b9c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3b2000c6c0 tx=0x7f3b14005830 comp rx=0 tx=0).stop 2024-07-24T16:24:27.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.385+0000 7f84b67fc640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f84b8146c70 0x7f84b815db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7f3b2dc4d640 1 -- 172.21.15.159:0/1922174054 reap_dead start 2024-07-24T16:24:27.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0c406fb40 0x7fb0c414d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c259c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0c406fb40 0x7fb0c414d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:57004/0 (socket says 172.21.15.159:57004) 2024-07-24T16:24:27.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c1d9b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0c406ff20 0x7fb0c4139f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c1d9b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0c406ff20 0x7fb0c4139f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:34212/0 (socket says 172.21.15.159:34212) 2024-07-24T16:24:27.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7f42563cb640 1 Processor -- start 2024-07-24T16:24:27.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7f3b2e44e640 1 -- 172.21.15.159:0/1922174054 shutdown_connections 2024-07-24T16:24:27.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7f3b2e44e640 1 -- 172.21.15.159:0/1922174054 >> 172.21.15.159:0/1922174054 conn(0x7f3b280b2150 msgr2=0x7f3b280b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c259c640 1 -- 172.21.15.159:0/4190722411 learned_addr learned my addr 172.21.15.159:0/4190722411 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:27.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fac06cc6640 1 -- 172.21.15.159:0/2258675634 shutdown_connections 2024-07-24T16:24:27.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fac06cc6640 1 -- 172.21.15.159:0/2258675634 wait complete. 2024-07-24T16:24:27.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c8a11640 1 -- 172.21.15.159:0/4190722411 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c416cfa0 con 0x7fb0c415eee0 2024-07-24T16:24:27.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c8a11640 1 -- 172.21.15.159:0/4190722411 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c4153e90 con 0x7fb0c406fb40 2024-07-24T16:24:27.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c8a11640 1 -- 172.21.15.159:0/4190722411 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c416d120 con 0x7fb0c406ff20 2024-07-24T16:24:27.400 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c2d9d640 1 --2- 172.21.15.159:0/4190722411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c415eee0 0x7fb0c40af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7f3b2e44e640 1 -- 172.21.15.159:0/1922174054 shutdown_connections 2024-07-24T16:24:27.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7f84b67fc640 1 -- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b815e0a0 msgr2=0x7f84b815fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7f84b67fc640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b815e0a0 0x7f84b815fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7f84b67fc640 1 -- 172.21.15.159:0/2485213427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b80cd070 msgr2=0x7f84b81e7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7f84b67fc640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b80cd070 0x7f84b81e7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7f84b67fc640 1 -- 172.21.15.159:0/2485213427 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b81e8540 con 0x7f84b8146c70 2024-07-24T16:24:27.401 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7f84b6ffd640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b80cd070 0x7f84b81e7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:24:27.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7f42563cb640 1 -- start start 2024-07-24T16:24:27.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7f84b67fc640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f84b8146c70 0x7f84b815db60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84ac031000 tx=0x7f84ac032c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.402 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7f42563cb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42500cfc10 0x7f4250139b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7fe949b0c640 1 Processor -- start 2024-07-24T16:24:27.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7f42563cb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4250157130 0x7f42501ef5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7f42563cb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4250157510 0x7f42500cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7f42563cb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f42501429b0 con 0x7f4250157130 2024-07-24T16:24:27.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7f42563cb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4250142830 con 0x7f42500cfc10 2024-07-24T16:24:27.403 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7f42563cb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4250142b30 con 0x7f4250157510 2024-07-24T16:24:27.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7f1f1f431640 1 -- 172.21.15.159:0/3311837186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f180cfb50 msgr2=0x7f1f180ad890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7f1f1f431640 1 --2- 172.21.15.159:0/3311837186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f180cfb50 0x7f1f180ad890 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1f180d01b0 tx=0x7f1f0802a490 comp rx=0 tx=0).stop 2024-07-24T16:24:27.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f424ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42500cfc10 0x7f4250139b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f424ffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42500cfc10 0x7f4250139b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:57006/0 (socket says 172.21.15.159:57006) 2024-07-24T16:24:27.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f424ffff640 1 -- 172.21.15.159:0/3847539022 learned_addr learned my addr 172.21.15.159:0/3847539022 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:27.404 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f424f7fe640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4250157130 0x7f42501ef5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f4254968640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4250157510 0x7f42500cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c2d9d640 1 -- 172.21.15.159:0/4190722411 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0c406ff20 msgr2=0x7fb0c4139f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c2d9d640 1 --2- 172.21.15.159:0/4190722411 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0c406ff20 0x7fb0c4139f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c2d9d640 1 -- 172.21.15.159:0/4190722411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0c406fb40 msgr2=0x7fb0c414d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c2d9d640 1 --2- 172.21.15.159:0/4190722411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0c406fb40 0x7fb0c414d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7fb0c2d9d640 1 -- 172.21.15.159:0/4190722411 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c40af6d0 con 0x7fb0c415eee0 2024-07-24T16:24:27.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7fb0c2d9d640 1 --2- 172.21.15.159:0/4190722411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c415eee0 0x7fb0c40af190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8031000 tx=0x7fb0b8032f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7fb0b2ffd640 1 -- 172.21.15.159:0/4190722411 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b8041070 con 0x7fb0c415eee0 2024-07-24T16:24:27.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7fb0b2ffd640 1 -- 172.21.15.159:0/4190722411 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0b8004110 con 0x7fb0c415eee0 2024-07-24T16:24:27.405 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7fb0b2ffd640 1 -- 172.21.15.159:0/4190722411 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc001a70 con 0x7fb0c415eee0 2024-07-24T16:24:27.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7fe949b0c640 1 -- start start 2024-07-24T16:24:27.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.386+0000 7f3b2e44e640 1 -- 172.21.15.159:0/1922174054 wait complete. 2024-07-24T16:24:27.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f3b2e44e640 1 Processor -- start 2024-07-24T16:24:27.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f3b2e44e640 1 -- start start 2024-07-24T16:24:27.406 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f4254968640 1 -- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42500cfc10 msgr2=0x7f4250139b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f4254968640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42500cfc10 0x7f4250139b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f4254968640 1 -- 172.21.15.159:0/3847539022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4250157130 msgr2=0x7f42501ef5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f4254968640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4250157130 0x7f42501ef5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7fac06cc6640 1 Processor -- start 2024-07-24T16:24:27.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7fac06cc6640 1 -- start start 2024-07-24T16:24:27.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7fb0c8a11640 1 -- 172.21.15.159:0/4190722411 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c40af970 con 0x7fb0c415eee0 2024-07-24T16:24:27.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7fb0c8a11640 1 -- 172.21.15.159:0/4190722411 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c40aff30 con 0x7fb0c415eee0 2024-07-24T16:24:27.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7f849f7fe640 1 -- 172.21.15.159:0/2485213427 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac040070 con 0x7f84b8146c70 2024-07-24T16:24:27.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.387+0000 7f849f7fe640 1 -- 172.21.15.159:0/2485213427 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84ac005310 con 0x7f84b8146c70 2024-07-24T16:24:27.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f849f7fe640 1 -- 172.21.15.159:0/2485213427 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac0047a0 con 0x7f84b8146c70 2024-07-24T16:24:27.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f4254968640 1 -- 172.21.15.159:0/3847539022 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f425013a0b0 con 0x7f4250157510 2024-07-24T16:24:27.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.388+0000 7f4254968640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4250157510 0x7f42500cbec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4240031000 tx=0x7f4240003b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7f424f7fe640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4250157130 0x7f42501ef5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:24:27.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7f424cff9640 1 -- 172.21.15.159:0/3847539022 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240042070 con 0x7f4250157510 2024-07-24T16:24:27.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7f42563cb640 1 -- 172.21.15.159:0/3847539022 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42501efb30 con 0x7f4250157510 2024-07-24T16:24:27.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7f42563cb640 1 -- 172.21.15.159:0/3847539022 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f42500ccc60 con 0x7f4250157510 2024-07-24T16:24:27.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7f1f1f431640 1 -- 172.21.15.159:0/3311837186 shutdown_connections 2024-07-24T16:24:27.409 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7f424cff9640 1 -- 172.21.15.159:0/3847539022 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f424002bc60 con 0x7f4250157510 2024-07-24T16:24:27.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7f424cff9640 1 -- 172.21.15.159:0/3847539022 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4240005c90 con 0x7f4250157510 2024-07-24T16:24:27.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7fac06cc6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fac0006e360 0x7fac00155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7f1f1f431640 1 --2- 172.21.15.159:0/3311837186 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f18161e20 0x7f1f1815d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7fac06cc6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac0006faf0 0x7fac00071d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7fac06cc6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac000cfa40 0x7fac0016aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7f1f1f431640 1 --2- 172.21.15.159:0/3311837186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f180cfb50 0x7f1f180ad890 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7fac06cc6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fac00142620 con 0x7fac0006faf0 2024-07-24T16:24:27.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7f3b2e44e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b140051c0 0x7f3b281f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7fac06cc6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fac0015a830 con 0x7fac000cfa40 2024-07-24T16:24:27.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2e44e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b280b51b0 0x7f3b281587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.389+0000 7f1f1f431640 1 --2- 172.21.15.159:0/3311837186 >> v2:172.21.15.193:3300/0 conn(0x7f1f180cf770 0x7f1f18071d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fac06cc6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fac001427a0 con 0x7fac0006e360 2024-07-24T16:24:27.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2e44e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b2815ee60 0x7f3b2815f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2e44e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3b2806e120 con 0x7f3b2815ee60 2024-07-24T16:24:27.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2e44e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b28155e40 con 0x7f3b140051c0 2024-07-24T16:24:27.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2cc4b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b280b51b0 0x7f3b281587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2cc4b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b280b51b0 0x7f3b281587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:34240/0 (socket says 172.21.15.159:34240) 2024-07-24T16:24:27.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2cc4b640 1 -- 172.21.15.159:0/163089914 learned_addr learned my addr 172.21.15.159:0/163089914 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:27.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2e44e640 1 -- 172.21.15.159:0/163089914 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3b2806e2a0 con 0x7f3b280b51b0 2024-07-24T16:24:27.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fabfffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac0006faf0 0x7fac00071d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fe949b0c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe94406e360 0x7fe94413c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fe949b0c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe94406faf0 0x7fe9440ce250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fe949b0c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe944157400 0x7fe944141bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fe949b0c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe944142620 con 0x7fe944157400 2024-07-24T16:24:27.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fe949b0c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe9441427a0 con 0x7fe94406faf0 2024-07-24T16:24:27.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fe949b0c640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe944142920 con 0x7fe94406e360 2024-07-24T16:24:27.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2d44c640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b140051c0 0x7f3b281f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fe942ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe94406faf0 0x7fe9440ce250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2cc4b640 1 -- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b140051c0 msgr2=0x7f3b281f5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fe942ffd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe94406faf0 0x7fe9440ce250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:57024/0 (socket says 172.21.15.159:57024) 2024-07-24T16:24:27.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2cc4b640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b140051c0 0x7f3b281f5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2cc4b640 1 -- 172.21.15.159:0/163089914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b2815ee60 msgr2=0x7f3b2815f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2cc4b640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b2815ee60 0x7f3b2815f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f3b2cc4b640 1 -- 172.21.15.159:0/163089914 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b28158d10 con 0x7f3b280b51b0 2024-07-24T16:24:27.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fabfffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac0006faf0 0x7fac00071d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60062/0 (socket says 172.21.15.159:60062) 2024-07-24T16:24:27.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fabfffff640 1 -- 172.21.15.159:0/3450120877 learned_addr learned my addr 172.21.15.159:0/3450120877 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:27.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fac04a62640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fac0006e360 0x7fac00155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fac05263640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac000cfa40 0x7fac0016aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7f3b2d44c640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b140051c0 0x7f3b281f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:27.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7f1f1f431640 1 -- 172.21.15.159:0/3311837186 >> 172.21.15.159:0/3311837186 conn(0x7f1f1806c560 msgr2=0x7f1f1806c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fe942ffd640 1 -- 172.21.15.159:0/1367844256 learned_addr learned my addr 172.21.15.159:0/1367844256 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:27.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7f84b7fff640 1 -- 172.21.15.159:0/2485213427 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b81e8820 con 0x7f84b8146c70 2024-07-24T16:24:27.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7f84b7fff640 1 -- 172.21.15.159:0/2485213427 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b81e8de0 con 0x7f84b8146c70 2024-07-24T16:24:27.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7f1f1f431640 1 -- 172.21.15.159:0/3311837186 shutdown_connections 2024-07-24T16:24:27.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.390+0000 7fe9437fe640 1 --2- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe94406e360 0x7fe94413c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7fe942ffd640 1 -- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe94406e360 msgr2=0x7fe94413c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7fe942ffd640 1 --2- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe94406e360 0x7fe94413c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7fe942ffd640 1 -- 172.21.15.159:0/1367844256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe944157400 msgr2=0x7fe944141bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:24:27.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7fe942ffd640 1 --2- 172.21.15.159:0/1367844256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe944157400 0x7fe944141bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7fe942ffd640 1 -- 172.21.15.159:0/1367844256 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe94413e310 con 0x7fe94406faf0 2024-07-24T16:24:27.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7f1f1f431640 1 -- 172.21.15.159:0/3311837186 wait complete. 2024-07-24T16:24:27.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7fb0b0ff9640 1 -- 172.21.15.159:0/4190722411 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb09c005290 con 0x7fb0c415eee0 2024-07-24T16:24:27.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7f3b2cc4b640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b280b51b0 0x7f3b281587d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400e9a0 tx=0x7f3b2400ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7fabfffff640 1 -- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fac0006e360 msgr2=0x7fac00155aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7fabfffff640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fac0006e360 0x7fac00155aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7fabfffff640 1 -- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac000cfa40 msgr2=0x7fac0016aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7fabfffff640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac000cfa40 0x7fac0016aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7fabfffff640 1 -- 172.21.15.159:0/3450120877 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac00153a10 con 0x7fac0006faf0 2024-07-24T16:24:27.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7fb0b2ffd640 1 -- 172.21.15.159:0/4190722411 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb0b803d710 con 0x7fb0c415eee0 2024-07-24T16:24:27.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7f42563cb640 1 -- 172.21.15.159:0/3847539022 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4230005290 con 0x7f4250157510 2024-07-24T16:24:27.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.392+0000 7f424cff9640 1 -- 172.21.15.159:0/3847539022 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f4240045070 con 0x7f4250157510 2024-07-24T16:24:27.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.391+0000 7fabfffff640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac0006faf0 0x7fac00071d00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fabf800cce0 tx=0x7fabf800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.392+0000 7fb0b2ffd640 1 --2- 172.21.15.159:0/4190722411 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb0a4077110 0x7fb0a40795d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.392+0000 7fe942ffd640 1 --2- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe94406faf0 0x7fe9440ce250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe934009850 tx=0x7fe9340039e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.392+0000 7f3b1dffb640 1 -- 172.21.15.159:0/163089914 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2400cc60 con 0x7f3b280b51b0 2024-07-24T16:24:27.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.392+0000 7f3b1dffb640 1 -- 172.21.15.159:0/163089914 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b2400ce00 con 0x7f3b280b51b0 2024-07-24T16:24:27.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.392+0000 7f3b1dffb640 1 -- 172.21.15.159:0/163089914 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b24005280 con 0x7f3b280b51b0 2024-07-24T16:24:27.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.392+0000 7fb0b2ffd640 1 -- 172.21.15.159:0/4190722411 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb0b80b92a0 con 0x7fb0c415eee0 2024-07-24T16:24:27.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.392+0000 7fe93bfff640 1 -- 172.21.15.159:0/1367844256 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe93403f070 con 0x7fe94406faf0 2024-07-24T16:24:27.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.393+0000 7fe949b0c640 1 -- 172.21.15.159:0/1367844256 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9440cda50 con 0x7fe94406faf0 2024-07-24T16:24:27.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.393+0000 7fe93bfff640 1 -- 172.21.15.159:0/1367844256 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe934004890 con 0x7fe94406faf0 2024-07-24T16:24:27.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.392+0000 7f424cff9640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f423c077040 0x7f423c079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.425 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.393+0000 7f849f7fe640 1 -- 172.21.15.159:0/2485213427 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f84ac039040 con 0x7f84b8146c70 2024-07-24T16:24:27.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.392+0000 7f424cff9640 1 -- 172.21.15.159:0/3847539022 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f42400b8b90 con 0x7f4250157510 2024-07-24T16:24:27.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.393+0000 7f84b7fff640 1 -- 172.21.15.159:0/2485213427 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b815e4b0 con 0x7f84b8146c70 2024-07-24T16:24:27.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.393+0000 7f424ffff640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f423c077040 0x7f423c079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.393+0000 7fe93bfff640 1 -- 172.21.15.159:0/1367844256 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe934035030 con 0x7fe94406faf0 2024-07-24T16:24:27.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.393+0000 7fe949b0c640 1 -- 172.21.15.159:0/1367844256 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9440ce790 con 0x7fe94406faf0 2024-07-24T16:24:27.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.392+0000 7f3b2e44e640 1 -- 172.21.15.159:0/163089914 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b281f1de0 con 0x7f3b280b51b0 2024-07-24T16:24:27.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.392+0000 7f3b2e44e640 1 -- 172.21.15.159:0/163089914 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b281f2380 con 0x7f3b280b51b0 2024-07-24T16:24:27.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.394+0000 7fb0c259c640 1 --2- 172.21.15.159:0/4190722411 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb0a4077110 0x7fb0a40795d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.394+0000 7f424ffff640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f423c077040 0x7f423c079500 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4244004ee0 tx=0x7f4244009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.394+0000 7f1f1f431640 1 Processor -- start 2024-07-24T16:24:27.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.394+0000 7f849f7fe640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f84a40770e0 0x7f84a40795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.428 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.394+0000 7f849f7fe640 1 -- 172.21.15.159:0/2485213427 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f84ac0b9ab0 con 0x7f84b8146c70 2024-07-24T16:24:27.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.394+0000 7f1f1f431640 1 -- start start 2024-07-24T16:24:27.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.394+0000 7f84b6ffd640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f84a40770e0 0x7f84a40795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.429 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.394+0000 7fb0c259c640 1 --2- 172.21.15.159:0/4190722411 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb0a4077110 0x7fb0a40795d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4007fd0 tx=0x7fb0b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.395+0000 7f3b2e44e640 1 -- 172.21.15.159:0/163089914 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b280709a0 con 0x7f3b280b51b0 2024-07-24T16:24:27.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.395+0000 7f84b6ffd640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f84a40770e0 0x7f84a40795a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84b80b3d50 tx=0x7f84a800b410 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.395+0000 7fe949b0c640 1 -- 172.21.15.159:0/1367844256 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe944156ec0 con 0x7fe94406faf0 2024-07-24T16:24:27.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.395+0000 7f1f1f431640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f180cf770 0x7f1f181f3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.395+0000 7f1f1f431640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f180cfb50 0x7f1f180cc770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.395+0000 7f1f1f431640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f18161e20 0x7f1f180b0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.395+0000 7fe93bfff640 1 -- 172.21.15.159:0/1367844256 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe934042070 con 0x7fe94406faf0 2024-07-24T16:24:27.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.395+0000 7f1f1f431640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1806e2d0 con 0x7f1f180cf770 2024-07-24T16:24:27.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.395+0000 7f1f1f431640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1806e150 con 0x7f1f180cfb50 2024-07-24T16:24:27.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1f431640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1806e450 con 0x7f1f18161e20 2024-07-24T16:24:27.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1d9ce640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f18161e20 0x7f1f180b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1d9ce640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f18161e20 0x7f1f180b0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:34262/0 (socket says 172.21.15.159:34262) 2024-07-24T16:24:27.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1d9ce640 1 -- 172.21.15.159:0/1494186763 learned_addr learned my addr 172.21.15.159:0/1494186763 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:27.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1d1cd640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f180cf770 0x7f1f181f3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1c9cc640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f180cfb50 0x7f1f180cc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7fe93bfff640 1 --2- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe924077010 0x7fe9240794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1d9ce640 1 -- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f180cfb50 msgr2=0x7f1f180cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1d9ce640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f180cfb50 0x7f1f180cc770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1d9ce640 1 -- 172.21.15.159:0/1494186763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f180cf770 msgr2=0x7f1f181f3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1d9ce640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f180cf770 0x7f1f181f3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1d9ce640 1 -- 172.21.15.159:0/1494186763 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f180cccb0 con 0x7f1f18161e20 2024-07-24T16:24:27.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1c9cc640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f180cfb50 0x7f1f180cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:27.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1d1cd640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f180cf770 0x7f1f181f3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:24:27.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7fe9437fe640 1 --2- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe924077010 0x7fe9240794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7fe93bfff640 1 -- 172.21.15.159:0/1367844256 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe9340b90a0 con 0x7fe94406faf0 2024-07-24T16:24:27.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.396+0000 7f1f1d9ce640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f18161e20 0x7f1f180b0790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000e990 tx=0x7f1f1000ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.397+0000 7fe9437fe640 1 --2- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe924077010 0x7fe9240794d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe93c005c40 tx=0x7fe93c00a590 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.398+0000 7f424cff9640 1 -- 172.21.15.159:0/3847539022 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f4240081480 con 0x7f4250157510 2024-07-24T16:24:27.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.398+0000 7fabfd7fa640 1 -- 172.21.15.159:0/3450120877 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf800f650 con 0x7fac0006faf0 2024-07-24T16:24:27.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.398+0000 7fabfd7fa640 1 -- 172.21.15.159:0/3450120877 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabf800f8e0 con 0x7fac0006faf0 2024-07-24T16:24:27.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.398+0000 7fabfd7fa640 1 -- 172.21.15.159:0/3450120877 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabf800fd30 con 0x7fac0006faf0 2024-07-24T16:24:27.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.398+0000 7fac06cc6640 1 -- 172.21.15.159:0/3450120877 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac000a9480 con 0x7fac0006faf0 2024-07-24T16:24:27.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.398+0000 7fb0b2ffd640 1 -- 172.21.15.159:0/4190722411 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fb0b804a070 con 0x7fb0c415eee0 2024-07-24T16:24:27.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.398+0000 7fac06cc6640 1 -- 172.21.15.159:0/3450120877 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac000a9a40 con 0x7fac0006faf0 2024-07-24T16:24:27.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.399+0000 7fac06cc6640 1 -- 172.21.15.159:0/3450120877 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac000cf7c0 con 0x7fac0006faf0 2024-07-24T16:24:27.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.400+0000 7fabfd7fa640 1 -- 172.21.15.159:0/3450120877 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fabf8018400 con 0x7fac0006faf0 2024-07-24T16:24:27.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.401+0000 7fabfd7fa640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fabec077090 0x7fabec079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.401+0000 7fabfd7fa640 1 -- 172.21.15.159:0/3450120877 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fabf80994e0 con 0x7fac0006faf0 2024-07-24T16:24:27.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.401+0000 7fac04a62640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fabec077090 0x7fabec079550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.402+0000 7fac04a62640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fabec077090 0x7fabec079550 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fabf0007fd0 tx=0x7fabf0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.405+0000 7fabfd7fa640 1 -- 172.21.15.159:0/3450120877 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fac000cf7c0 con 0x7fac0006faf0 2024-07-24T16:24:27.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.405+0000 7fe93bfff640 1 -- 172.21.15.159:0/1367844256 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fe93402ae20 con 0x7fe94406faf0 2024-07-24T16:24:27.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.406+0000 7f849f7fe640 1 -- 172.21.15.159:0/2485213427 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f84b815e4b0 con 0x7f84b8146c70 2024-07-24T16:24:27.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.407+0000 7f1f0dffb640 1 -- 172.21.15.159:0/1494186763 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f10004d20 con 0x7f1f18161e20 2024-07-24T16:24:27.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.407+0000 7f1f0dffb640 1 -- 172.21.15.159:0/1494186763 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f1000ca60 con 0x7f1f18161e20 2024-07-24T16:24:27.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.408+0000 7f1f0dffb640 1 -- 172.21.15.159:0/1494186763 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f10004d20 con 0x7f1f18161e20 2024-07-24T16:24:27.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.408+0000 7f1f1f431640 1 -- 172.21.15.159:0/1494186763 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f1815eca0 con 0x7f1f18161e20 2024-07-24T16:24:27.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.409+0000 7f1f1f431640 1 -- 172.21.15.159:0/1494186763 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f1815f260 con 0x7f1f18161e20 2024-07-24T16:24:27.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.411+0000 7f1f1f431640 1 -- 172.21.15.159:0/1494186763 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f180ad890 con 0x7f1f18161e20 2024-07-24T16:24:27.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.410+0000 7f3b1dffb640 1 -- 172.21.15.159:0/163089914 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f3b24005420 con 0x7f3b280b51b0 2024-07-24T16:24:27.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.411+0000 7f3b1dffb640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3b0c0770e0 0x7f3b0c0795a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.411+0000 7f3b1dffb640 1 -- 172.21.15.159:0/163089914 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3b240998d0 con 0x7f3b280b51b0 2024-07-24T16:24:27.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.412+0000 7f3b2d44c640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3b0c0770e0 0x7f3b0c0795a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.412+0000 7f3b1dffb640 1 -- 172.21.15.159:0/163089914 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f3b24062890 con 0x7f3b280b51b0 2024-07-24T16:24:27.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.414+0000 7f1f0dffb640 1 -- 172.21.15.159:0/1494186763 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1f1000cc10 con 0x7f1f18161e20 2024-07-24T16:24:27.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.415+0000 7f1f0dffb640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1efc077410 0x7f1efc0798d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:27.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.415+0000 7f1f0dffb640 1 -- 172.21.15.159:0/1494186763 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1f10004b20 con 0x7f1f18161e20 2024-07-24T16:24:27.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.416+0000 7f1f1d1cd640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1efc077410 0x7f1efc0798d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:27.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.412+0000 7f3b2d44c640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3b0c0770e0 0x7f3b0c0795a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3b28069b40 tx=0x7f3b18005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.417+0000 7f1f0dffb640 1 -- 172.21.15.159:0/1494186763 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f1f10016030 con 0x7f1f18161e20 2024-07-24T16:24:27.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.417+0000 7f1f1d1cd640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1efc077410 0x7f1efc0798d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f14005fd0 tx=0x7f1f14009260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:27.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.759+0000 7f6d10cb0640 1 -- 172.21.15.159:0/3305056961 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6d0c0b0500 con 0x7f6d0c0afe10 2024-07-24T16:24:27.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.760+0000 7f6cfaffd640 1 -- 172.21.15.159:0/3305056961 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6d04068030 con 0x7f6d0c0afe10 2024-07-24T16:24:27.762 INFO:teuthology.orchestra.run.smithi159.stdout:55834574855 2024-07-24T16:24:27.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.763+0000 7f6d10cb0640 1 -- 172.21.15.159:0/3305056961 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6cec077040 msgr2=0x7f6cec079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.763+0000 7f6d10cb0640 1 --2- 172.21.15.159:0/3305056961 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6cec077040 0x7f6cec079500 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc033000 tx=0x7f6cfc02d070 comp rx=0 tx=0).stop 2024-07-24T16:24:27.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.763+0000 7f6d10cb0640 1 -- 172.21.15.159:0/3305056961 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6d0c0afe10 msgr2=0x7f6d0c14a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.763+0000 7f6d10cb0640 1 --2- 172.21.15.159:0/3305056961 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6d0c0afe10 0x7f6d0c14a0b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6d0400c6d0 tx=0x7f6d0400cb90 comp rx=0 tx=0).stop 2024-07-24T16:24:27.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.763+0000 7f6d10cb0640 1 -- 172.21.15.159:0/3305056961 shutdown_connections 2024-07-24T16:24:27.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.763+0000 7f6d10cb0640 1 --2- 172.21.15.159:0/3305056961 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6cec077040 0x7f6cec079500 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.763+0000 7f6d10cb0640 1 --2- 172.21.15.159:0/3305056961 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d0c14db20 0x7f6d0c14dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.763+0000 7f6d10cb0640 1 --2- 172.21.15.159:0/3305056961 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6d0c0afe10 0x7f6d0c14a0b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.764+0000 7f6d10cb0640 1 --2- 172.21.15.159:0/3305056961 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d0c0afa30 0x7f6d0c149b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.764+0000 7f6d10cb0640 1 -- 172.21.15.159:0/3305056961 >> 172.21.15.159:0/3305056961 conn(0x7f6d0c06cbc0 msgr2=0x7f6d0c14ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.764+0000 7f6d10cb0640 1 -- 172.21.15.159:0/3305056961 shutdown_connections 2024-07-24T16:24:27.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.764+0000 7f6d10cb0640 1 -- 172.21.15.159:0/3305056961 wait complete. 2024-07-24T16:24:27.782 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2024-07-24T16:24:27.783 DEBUG:teuthology.parallel:result is None 2024-07-24T16:24:27.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.806+0000 7f3b2e44e640 1 -- 172.21.15.159:0/163089914 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3b28148a30 con 0x7f3b280b51b0 2024-07-24T16:24:27.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.807+0000 7f3b1dffb640 1 -- 172.21.15.159:0/163089914 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3b24062190 con 0x7f3b280b51b0 2024-07-24T16:24:27.809 INFO:teuthology.orchestra.run.smithi159.stdout:55834574856 2024-07-24T16:24:27.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.809+0000 7f3b2e44e640 1 -- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3b0c0770e0 msgr2=0x7f3b0c0795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.809+0000 7f3b2e44e640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3b0c0770e0 0x7f3b0c0795a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3b28069b40 tx=0x7f3b18005f90 comp rx=0 tx=0).stop 2024-07-24T16:24:27.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.809+0000 7f3b2e44e640 1 -- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b280b51b0 msgr2=0x7f3b281587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.809+0000 7f3b2e44e640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b280b51b0 0x7f3b281587d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400e9a0 tx=0x7f3b2400ee60 comp rx=0 tx=0).stop 2024-07-24T16:24:27.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.809+0000 7f3b2e44e640 1 -- 172.21.15.159:0/163089914 shutdown_connections 2024-07-24T16:24:27.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.809+0000 7f3b2e44e640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3b0c0770e0 0x7f3b0c0795a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.809+0000 7f3b2e44e640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b2815ee60 0x7f3b2815f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.809+0000 7f3b2e44e640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b280b51b0 0x7f3b281587d0 secure :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3b2400e9a0 tx=0x7f3b2400ee60 comp rx=0 tx=0).stop 2024-07-24T16:24:27.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.809+0000 7f3b2e44e640 1 --2- 172.21.15.159:0/163089914 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b140051c0 0x7f3b281f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.809+0000 7f3b2e44e640 1 -- 172.21.15.159:0/163089914 >> 172.21.15.159:0/163089914 conn(0x7f3b280b2150 msgr2=0x7f3b280b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.809+0000 7f3b2e44e640 1 -- 172.21.15.159:0/163089914 shutdown_connections 2024-07-24T16:24:27.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.809+0000 7f3b2e44e640 1 -- 172.21.15.159:0/163089914 wait complete. 2024-07-24T16:24:27.822 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2024-07-24T16:24:27.823 DEBUG:teuthology.parallel:result is None 2024-07-24T16:24:27.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.836+0000 7fb0b0ff9640 1 -- 172.21.15.159:0/4190722411 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb09c005580 con 0x7fb0c415eee0 2024-07-24T16:24:27.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.837+0000 7fb0b2ffd640 1 -- 172.21.15.159:0/4190722411 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb0b8081b80 con 0x7fb0c415eee0 2024-07-24T16:24:27.839 INFO:teuthology.orchestra.run.smithi159.stdout:55834574856 2024-07-24T16:24:27.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.838+0000 7f42563cb640 1 -- 172.21.15.159:0/3847539022 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f4230005580 con 0x7f4250157510 2024-07-24T16:24:27.841 INFO:teuthology.orchestra.run.smithi159.stdout:55834574855 2024-07-24T16:24:27.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.839+0000 7f424cff9640 1 -- 172.21.15.159:0/3847539022 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42400859d0 con 0x7f4250157510 2024-07-24T16:24:27.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.840+0000 7fb0b0ff9640 1 -- 172.21.15.159:0/4190722411 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb0a4077110 msgr2=0x7fb0a40795d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.840+0000 7fb0b0ff9640 1 --2- 172.21.15.159:0/4190722411 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb0a4077110 0x7fb0a40795d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4007fd0 tx=0x7fb0b4009040 comp rx=0 tx=0).stop 2024-07-24T16:24:27.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.840+0000 7fb0b0ff9640 1 -- 172.21.15.159:0/4190722411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c415eee0 msgr2=0x7fb0c40af190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.840+0000 7fb0b0ff9640 1 --2- 172.21.15.159:0/4190722411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c415eee0 0x7fb0c40af190 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb0b8031000 tx=0x7fb0b8032f50 comp rx=0 tx=0).stop 2024-07-24T16:24:27.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.840+0000 7fb0b0ff9640 1 -- 172.21.15.159:0/4190722411 shutdown_connections 2024-07-24T16:24:27.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.840+0000 7fb0b0ff9640 1 --2- 172.21.15.159:0/4190722411 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb0a4077110 0x7fb0a40795d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.840+0000 7fb0b0ff9640 1 --2- 172.21.15.159:0/4190722411 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb0c415eee0 0x7fb0c40af190 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.841+0000 7fb0b0ff9640 1 --2- 172.21.15.159:0/4190722411 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb0c406ff20 0x7fb0c4139f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.841+0000 7fb0b0ff9640 1 --2- 172.21.15.159:0/4190722411 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb0c406fb40 0x7fb0c414d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.841+0000 7fb0b0ff9640 1 -- 172.21.15.159:0/4190722411 >> 172.21.15.159:0/4190722411 conn(0x7fb0c406cbc0 msgr2=0x7fb0c416bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.841+0000 7fb0b0ff9640 1 -- 172.21.15.159:0/4190722411 shutdown_connections 2024-07-24T16:24:27.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.841+0000 7fb0b0ff9640 1 -- 172.21.15.159:0/4190722411 wait complete. 2024-07-24T16:24:27.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.842+0000 7f42563cb640 1 -- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f423c077040 msgr2=0x7f423c079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.842+0000 7f42563cb640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f423c077040 0x7f423c079500 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f4244004ee0 tx=0x7f4244009040 comp rx=0 tx=0).stop 2024-07-24T16:24:27.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.842+0000 7f42563cb640 1 -- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4250157510 msgr2=0x7f42500cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.842+0000 7f42563cb640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4250157510 0x7f42500cbec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4240031000 tx=0x7f4240003b90 comp rx=0 tx=0).stop 2024-07-24T16:24:27.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.842+0000 7f42563cb640 1 -- 172.21.15.159:0/3847539022 shutdown_connections 2024-07-24T16:24:27.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.842+0000 7f42563cb640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f423c077040 0x7f423c079500 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.842+0000 7f42563cb640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4250157510 0x7f42500cbec0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.842+0000 7f42563cb640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4250157130 0x7f42501ef5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.842+0000 7f42563cb640 1 --2- 172.21.15.159:0/3847539022 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42500cfc10 0x7f4250139b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.842+0000 7f42563cb640 1 -- 172.21.15.159:0/3847539022 >> 172.21.15.159:0/3847539022 conn(0x7f425006c560 msgr2=0x7f42500682a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.844+0000 7f42563cb640 1 -- 172.21.15.159:0/3847539022 shutdown_connections 2024-07-24T16:24:27.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.844+0000 7f42563cb640 1 -- 172.21.15.159:0/3847539022 wait complete. 2024-07-24T16:24:27.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.844+0000 7fac06cc6640 1 -- 172.21.15.159:0/3450120877 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fac000cf500 con 0x7fac0006faf0 2024-07-24T16:24:27.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.844+0000 7fabfd7fa640 1 -- 172.21.15.159:0/3450120877 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fabf8014030 con 0x7fac0006faf0 2024-07-24T16:24:27.847 INFO:teuthology.orchestra.run.smithi159.stdout:55834574856 2024-07-24T16:24:27.848 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.846+0000 7fe949b0c640 1 -- 172.21.15.159:0/1367844256 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe9440683c0 con 0x7fe94406faf0 2024-07-24T16:24:27.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.847+0000 7fe93bfff640 1 -- 172.21.15.159:0/1367844256 <== mon.1 v2:172.21.15.193:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe934081a30 con 0x7fe94406faf0 2024-07-24T16:24:27.849 INFO:teuthology.orchestra.run.smithi159.stdout:55834574856 2024-07-24T16:24:27.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.847+0000 7fac06cc6640 1 -- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fabec077090 msgr2=0x7fabec079550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.847+0000 7fac06cc6640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fabec077090 0x7fabec079550 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fabf0007fd0 tx=0x7fabf0009040 comp rx=0 tx=0).stop 2024-07-24T16:24:27.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.848+0000 7fac06cc6640 1 -- 172.21.15.159:0/3450120877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac0006faf0 msgr2=0x7fac00071d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.848+0000 7fac06cc6640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac0006faf0 0x7fac00071d00 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fabf800cce0 tx=0x7fabf800a620 comp rx=0 tx=0).stop 2024-07-24T16:24:27.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.848+0000 7fac06cc6640 1 -- 172.21.15.159:0/3450120877 shutdown_connections 2024-07-24T16:24:27.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.848+0000 7fac06cc6640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fabec077090 0x7fabec079550 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.848+0000 7fac06cc6640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fac000cfa40 0x7fac0016aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.848+0000 7fac06cc6640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fac0006faf0 0x7fac00071d00 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.848+0000 7fac06cc6640 1 --2- 172.21.15.159:0/3450120877 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fac0006e360 0x7fac00155aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.848+0000 7fac06cc6640 1 -- 172.21.15.159:0/3450120877 >> 172.21.15.159:0/3450120877 conn(0x7fac0006c560 msgr2=0x7fac0015cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.848+0000 7fac06cc6640 1 -- 172.21.15.159:0/3450120877 shutdown_connections 2024-07-24T16:24:27.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.848+0000 7fac06cc6640 1 -- 172.21.15.159:0/3450120877 wait complete. 2024-07-24T16:24:27.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.849+0000 7fe949b0c640 1 -- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe924077010 msgr2=0x7fe9240794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.849+0000 7fe949b0c640 1 --2- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe924077010 0x7fe9240794d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe93c005c40 tx=0x7fe93c00a590 comp rx=0 tx=0).stop 2024-07-24T16:24:27.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.849+0000 7fe949b0c640 1 -- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe94406faf0 msgr2=0x7fe9440ce250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.849+0000 7fe949b0c640 1 --2- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe94406faf0 0x7fe9440ce250 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe934009850 tx=0x7fe9340039e0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.849+0000 7fe949b0c640 1 -- 172.21.15.159:0/1367844256 shutdown_connections 2024-07-24T16:24:27.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.849+0000 7fe949b0c640 1 --2- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe924077010 0x7fe9240794d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.849+0000 7fe949b0c640 1 --2- 172.21.15.159:0/1367844256 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe944157400 0x7fe944141bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.849+0000 7fe949b0c640 1 --2- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe94406faf0 0x7fe9440ce250 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.849+0000 7fe949b0c640 1 --2- 172.21.15.159:0/1367844256 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe94406e360 0x7fe94413c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.849+0000 7fe949b0c640 1 -- 172.21.15.159:0/1367844256 >> 172.21.15.159:0/1367844256 conn(0x7fe94406c560 msgr2=0x7fe944072d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.849+0000 7fe949b0c640 1 -- 172.21.15.159:0/1367844256 shutdown_connections 2024-07-24T16:24:27.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.850+0000 7fe949b0c640 1 -- 172.21.15.159:0/1367844256 wait complete. 2024-07-24T16:24:27.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.854+0000 7f84b7fff640 1 -- 172.21.15.159:0/2485213427 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f84b80adea0 con 0x7f84b8146c70 2024-07-24T16:24:27.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.855+0000 7f849f7fe640 1 -- 172.21.15.159:0/2485213427 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f84ac049060 con 0x7f84b8146c70 2024-07-24T16:24:27.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.855+0000 7f1f1f431640 1 -- 172.21.15.159:0/1494186763 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1f18161110 con 0x7f1f18161e20 2024-07-24T16:24:27.857 INFO:teuthology.orchestra.run.smithi159.stdout:55834574855 2024-07-24T16:24:27.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.855+0000 7f1f0dffb640 1 -- 172.21.15.159:0/1494186763 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1f10062020 con 0x7f1f18161e20 2024-07-24T16:24:27.858 INFO:teuthology.orchestra.run.smithi159.stdout:55834574855 2024-07-24T16:24:27.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f1f1f431640 1 -- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1efc077410 msgr2=0x7f1efc0798d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f1f1f431640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1efc077410 0x7f1efc0798d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1f14005fd0 tx=0x7f1f14009260 comp rx=0 tx=0).stop 2024-07-24T16:24:27.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f1f1f431640 1 -- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f18161e20 msgr2=0x7f1f180b0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f1f1f431640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f18161e20 0x7f1f180b0790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f1f1000e990 tx=0x7f1f1000ed90 comp rx=0 tx=0).stop 2024-07-24T16:24:27.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f1f1f431640 1 -- 172.21.15.159:0/1494186763 shutdown_connections 2024-07-24T16:24:27.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f1f1f431640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1efc077410 0x7f1efc0798d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f1f1f431640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f18161e20 0x7f1f180b0790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f1f1f431640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f180cfb50 0x7f1f180cc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f1f1f431640 1 --2- 172.21.15.159:0/1494186763 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f180cf770 0x7f1f181f3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f1f1f431640 1 -- 172.21.15.159:0/1494186763 >> 172.21.15.159:0/1494186763 conn(0x7f1f1806c560 msgr2=0x7f1f1815b040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f1f1f431640 1 -- 172.21.15.159:0/1494186763 shutdown_connections 2024-07-24T16:24:27.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f84b7fff640 1 -- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f84a40770e0 msgr2=0x7f84a40795a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f1f1f431640 1 -- 172.21.15.159:0/1494186763 wait complete. 2024-07-24T16:24:27.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f84b7fff640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f84a40770e0 0x7f84a40795a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f84b80b3d50 tx=0x7f84a800b410 comp rx=0 tx=0).stop 2024-07-24T16:24:27.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f84b7fff640 1 -- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f84b8146c70 msgr2=0x7f84b815db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:27.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f84b7fff640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f84b8146c70 0x7f84b815db60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f84ac031000 tx=0x7f84ac032c10 comp rx=0 tx=0).stop 2024-07-24T16:24:27.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f84b7fff640 1 -- 172.21.15.159:0/2485213427 shutdown_connections 2024-07-24T16:24:27.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f84b7fff640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f84a40770e0 0x7f84a40795a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f84b7fff640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f84b815e0a0 0x7f84b815fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f84b7fff640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f84b8146c70 0x7f84b815db60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f84b7fff640 1 --2- 172.21.15.159:0/2485213427 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f84b80cd070 0x7f84b81e7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:27.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.858+0000 7f84b7fff640 1 -- 172.21.15.159:0/2485213427 >> 172.21.15.159:0/2485213427 conn(0x7f84b80b49f0 msgr2=0x7f84b80b4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:27.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.859+0000 7f84b7fff640 1 -- 172.21.15.159:0/2485213427 shutdown_connections 2024-07-24T16:24:27.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:27.859+0000 7f84b7fff640 1 -- 172.21.15.159:0/2485213427 wait complete. 2024-07-24T16:24:27.865 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-07-24T16:24:27.865 DEBUG:teuthology.parallel:result is None 2024-07-24T16:24:27.866 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2024-07-24T16:24:27.866 DEBUG:teuthology.parallel:result is None 2024-07-24T16:24:27.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.2 2024-07-24T16:24:27.873 DEBUG:teuthology.parallel:result is None 2024-07-24T16:24:27.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-07-24T16:24:27.874 DEBUG:teuthology.parallel:result is None 2024-07-24T16:24:27.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2024-07-24T16:24:27.875 DEBUG:teuthology.parallel:result is None 2024-07-24T16:24:27.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2024-07-24T16:24:27.876 DEBUG:teuthology.parallel:result is None 2024-07-24T16:24:27.876 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-07-24T16:24:27.876 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:24:28.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.015+0000 7f830d34b640 1 -- 172.21.15.159:0/2825939485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83080b66e0 msgr2=0x7f830815bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.015+0000 7f830d34b640 1 --2- 172.21.15.159:0/2825939485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83080b66e0 0x7f830815bae0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f82f8009830 tx=0x7f82f802a480 comp rx=0 tx=0).stop 2024-07-24T16:24:28.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.015+0000 7f830d34b640 1 -- 172.21.15.159:0/2825939485 shutdown_connections 2024-07-24T16:24:28.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.015+0000 7f830d34b640 1 --2- 172.21.15.159:0/2825939485 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83080d0fc0 0x7f8308071ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.015+0000 7f830d34b640 1 --2- 172.21.15.159:0/2825939485 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83080b66e0 0x7f830815bae0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.015+0000 7f830d34b640 1 -- 172.21.15.159:0/2825939485 >> 172.21.15.159:0/2825939485 conn(0x7f83080b33c0 msgr2=0x7f83080b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:28.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.015+0000 7f830d34b640 1 -- 172.21.15.159:0/2825939485 shutdown_connections 2024-07-24T16:24:28.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.015+0000 7f830d34b640 1 -- 172.21.15.159:0/2825939485 wait complete. 2024-07-24T16:24:28.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.016+0000 7f830d34b640 1 Processor -- start 2024-07-24T16:24:28.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.017+0000 7f830d34b640 1 -- start start 2024-07-24T16:24:28.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.017+0000 7f830d34b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83080721e0 0x7f83081f5290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:28.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.017+0000 7f830d34b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83080b66e0 0x7f830806ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:28.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.017+0000 7f830d34b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83080d0fc0 0x7f8308150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:28.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.017+0000 7f830d34b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8308074430 con 0x7f83080b66e0 2024-07-24T16:24:28.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.017+0000 7f830d34b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f83080742b0 con 0x7f83080d0fc0 2024-07-24T16:24:28.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.017+0000 7f830d34b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f83080cf4c0 con 0x7f83080721e0 2024-07-24T16:24:28.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.017+0000 7f82fe7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83080b66e0 0x7f830806ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:28.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f82fe7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83080b66e0 0x7f830806ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60074/0 (socket says 172.21.15.159:60074) 2024-07-24T16:24:28.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f82fe7fc640 1 -- 172.21.15.159:0/1574130079 learned_addr learned my addr 172.21.15.159:0/1574130079 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:28.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f83077fe640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83080d0fc0 0x7f8308150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:28.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f8306ffd640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83080721e0 0x7f83081f5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:28.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f82fe7fc640 1 -- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83080721e0 msgr2=0x7f83081f5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f82fe7fc640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83080721e0 0x7f83081f5290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f82fe7fc640 1 -- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83080d0fc0 msgr2=0x7f8308150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f82fe7fc640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83080d0fc0 0x7f8308150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f82fe7fc640 1 -- 172.21.15.159:0/1574130079 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f830806d8c0 con 0x7f83080b66e0 2024-07-24T16:24:28.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f8306ffd640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83080721e0 0x7f83081f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:28.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f83077fe640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83080d0fc0 0x7f8308150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:28.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f82fe7fc640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83080b66e0 0x7f830806ee50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f82f000e9f0 tx=0x7f82f000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:28.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f82fffff640 1 -- 172.21.15.159:0/1574130079 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f000cd80 con 0x7f83080b66e0 2024-07-24T16:24:28.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f82fffff640 1 -- 172.21.15.159:0/1574130079 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f82f0004020 con 0x7f83080b66e0 2024-07-24T16:24:28.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f830d34b640 1 -- 172.21.15.159:0/1574130079 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f830806dba0 con 0x7f83080b66e0 2024-07-24T16:24:28.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f82fffff640 1 -- 172.21.15.159:0/1574130079 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82f0004470 con 0x7f83080b66e0 2024-07-24T16:24:28.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.018+0000 7f830d34b640 1 -- 172.21.15.159:0/1574130079 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f830806e160 con 0x7f83080b66e0 2024-07-24T16:24:28.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.019+0000 7f830d34b640 1 -- 172.21.15.159:0/1574130079 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f830815bae0 con 0x7f83080b66e0 2024-07-24T16:24:28.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.020+0000 7f82fffff640 1 -- 172.21.15.159:0/1574130079 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f82f00035f0 con 0x7f83080b66e0 2024-07-24T16:24:28.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.020+0000 7f82fffff640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f82e8077010 0x7f82e80794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:28.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.021+0000 7f82fffff640 1 -- 172.21.15.159:0/1574130079 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f82f00996d0 con 0x7f83080b66e0 2024-07-24T16:24:28.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.021+0000 7f8306ffd640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f82e8077010 0x7f82e80794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:28.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.021+0000 7f8306ffd640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f82e8077010 0x7f82e80794d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f82f8034000 tx=0x7f82f8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:28.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.024+0000 7f82fffff640 1 -- 172.21.15.159:0/1574130079 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f82f0062620 con 0x7f83080b66e0 2024-07-24T16:24:28.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.204+0000 7f830d34b640 1 -- 172.21.15.159:0/1574130079 --> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f83080b21f0 con 0x7f82e8077010 2024-07-24T16:24:28.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.210+0000 7f82fffff640 1 -- 172.21.15.159:0/1574130079 <== mgr.4103 v2:172.21.15.193:6832/222319347 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332520 (secure 0 0 0) 0x7f83080b21f0 con 0x7f82e8077010 2024-07-24T16:24:28.217 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:28.221 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:24:28.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.214+0000 7f830d34b640 1 -- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f82e8077010 msgr2=0x7f82e80794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.214+0000 7f830d34b640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f82e8077010 0x7f82e80794d0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f82f8034000 tx=0x7f82f8004730 comp rx=0 tx=0).stop 2024-07-24T16:24:28.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.214+0000 7f830d34b640 1 -- 172.21.15.159:0/1574130079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83080b66e0 msgr2=0x7f830806ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.214+0000 7f830d34b640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83080b66e0 0x7f830806ee50 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f82f000e9f0 tx=0x7f82f000eeb0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.214+0000 7f830d34b640 1 -- 172.21.15.159:0/1574130079 shutdown_connections 2024-07-24T16:24:28.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.214+0000 7f830d34b640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f82e8077010 0x7f82e80794d0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.214+0000 7f830d34b640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f83080d0fc0 0x7f8308150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.214+0000 7f830d34b640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f83080b66e0 0x7f830806ee50 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.214+0000 7f830d34b640 1 --2- 172.21.15.159:0/1574130079 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f83080721e0 0x7f83081f5290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.214+0000 7f830d34b640 1 -- 172.21.15.159:0/1574130079 >> 172.21.15.159:0/1574130079 conn(0x7f83080b33c0 msgr2=0x7f83080b1230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:28.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.214+0000 7f830d34b640 1 -- 172.21.15.159:0/1574130079 shutdown_connections 2024-07-24T16:24:28.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.214+0000 7f830d34b640 1 -- 172.21.15.159:0/1574130079 wait complete. 2024-07-24T16:24:28.227 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2024-07-24T16:24:26.367043+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1988976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003471"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441633+0000","last_change":"2024-07-24T16:24:02.424537+0000","last_active":"2024-07-24T16:24:08.441633+0000","last_peered":"2024-07-24T16:24:08.441633+0000","last_clean":"2024-07-24T16:24:08.441633+0000","last_became_active":"2024-07-24T16:24:02.424271+0000","last_became_peered":"2024-07-24T16:24:02.424271+0000","last_unstale":"2024-07-24T16:24:08.441633+0000","last_undegraded":"2024-07-24T16:24:08.441633+0000","last_fullsized":"2024-07-24T16:24:08.441633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:39:09.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663338+0000","last_change":"2024-07-24T16:24:03.415815+0000","last_active":"2024-07-24T16:24:08.663338+0000","last_peered":"2024-07-24T16:24:08.663338+0000","last_clean":"2024-07-24T16:24:08.663338+0000","last_became_active":"2024-07-24T16:24:03.415526+0000","last_became_peered":"2024-07-24T16:24:03.415526+0000","last_unstale":"2024-07-24T16:24:08.663338+0000","last_undegraded":"2024-07-24T16:24:08.663338+0000","last_fullsized":"2024-07-24T16:24:08.663338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662707+0000","last_change":"2024-07-24T16:24:07.690761+0000","last_active":"2024-07-24T16:24:08.662707+0000","last_peered":"2024-07-24T16:24:08.662707+0000","last_clean":"2024-07-24T16:24:08.662707+0000","last_became_active":"2024-07-24T16:24:07.690360+0000","last_became_peered":"2024-07-24T16:24:07.690360+0000","last_unstale":"2024-07-24T16:24:08.662707+0000","last_undegraded":"2024-07-24T16:24:08.662707+0000","last_fullsized":"2024-07-24T16:24:08.662707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:20:33.168439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663491+0000","last_change":"2024-07-24T16:24:02.417793+0000","last_active":"2024-07-24T16:24:08.663491+0000","last_peered":"2024-07-24T16:24:08.663491+0000","last_clean":"2024-07-24T16:24:08.663491+0000","last_became_active":"2024-07-24T16:24:02.417520+0000","last_became_peered":"2024-07-24T16:24:02.417520+0000","last_unstale":"2024-07-24T16:24:08.663491+0000","last_undegraded":"2024-07-24T16:24:08.663491+0000","last_fullsized":"2024-07-24T16:24:08.663491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:39:09.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441465+0000","last_change":"2024-07-24T16:24:03.431760+0000","last_active":"2024-07-24T16:24:08.441465+0000","last_peered":"2024-07-24T16:24:08.441465+0000","last_clean":"2024-07-24T16:24:08.441465+0000","last_became_active":"2024-07-24T16:24:03.431479+0000","last_became_peered":"2024-07-24T16:24:03.431479+0000","last_unstale":"2024-07-24T16:24:08.441465+0000","last_undegraded":"2024-07-24T16:24:08.441465+0000","last_fullsized":"2024-07-24T16:24:08.441465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:30:43.693386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759610+0000","last_change":"2024-07-24T16:24:07.447841+0000","last_active":"2024-07-24T16:24:08.759610+0000","last_peered":"2024-07-24T16:24:08.759610+0000","last_clean":"2024-07-24T16:24:08.759610+0000","last_became_active":"2024-07-24T16:24:07.446215+0000","last_became_peered":"2024-07-24T16:24:07.446215+0000","last_unstale":"2024-07-24T16:24:08.759610+0000","last_undegraded":"2024-07-24T16:24:08.759610+0000","last_fullsized":"2024-07-24T16:24:08.759610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:09.837609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932112+0000","last_change":"2024-07-24T16:24:02.427356+0000","last_active":"2024-07-24T16:24:08.932112+0000","last_peered":"2024-07-24T16:24:08.932112+0000","last_clean":"2024-07-24T16:24:08.932112+0000","last_became_active":"2024-07-24T16:24:02.426961+0000","last_became_peered":"2024-07-24T16:24:02.426961+0000","last_unstale":"2024-07-24T16:24:08.932112+0000","last_undegraded":"2024-07-24T16:24:08.932112+0000","last_fullsized":"2024-07-24T16:24:08.932112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:45:48.251916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441858+0000","last_change":"2024-07-24T16:24:03.410957+0000","last_active":"2024-07-24T16:24:08.441858+0000","last_peered":"2024-07-24T16:24:08.441858+0000","last_clean":"2024-07-24T16:24:08.441858+0000","last_became_active":"2024-07-24T16:24:03.410678+0000","last_became_peered":"2024-07-24T16:24:03.410678+0000","last_unstale":"2024-07-24T16:24:08.441858+0000","last_undegraded":"2024-07-24T16:24:08.441858+0000","last_fullsized":"2024-07-24T16:24:08.441858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:32:56.003382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759927+0000","last_change":"2024-07-24T16:24:07.447764+0000","last_active":"2024-07-24T16:24:08.759927+0000","last_peered":"2024-07-24T16:24:08.759927+0000","last_clean":"2024-07-24T16:24:08.759927+0000","last_became_active":"2024-07-24T16:24:07.446150+0000","last_became_peered":"2024-07-24T16:24:07.446150+0000","last_unstale":"2024-07-24T16:24:08.759927+0000","last_undegraded":"2024-07-24T16:24:08.759927+0000","last_fullsized":"2024-07-24T16:24:08.759927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:29.138058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931831+0000","last_change":"2024-07-24T16:24:02.427694+0000","last_active":"2024-07-24T16:24:08.931831+0000","last_peered":"2024-07-24T16:24:08.931831+0000","last_clean":"2024-07-24T16:24:08.931831+0000","last_became_active":"2024-07-24T16:24:02.427418+0000","last_became_peered":"2024-07-24T16:24:02.427418+0000","last_unstale":"2024-07-24T16:24:08.931831+0000","last_undegraded":"2024-07-24T16:24:08.931831+0000","last_fullsized":"2024-07-24T16:24:08.931831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:35:30.416854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442157+0000","last_change":"2024-07-24T16:24:03.411299+0000","last_active":"2024-07-24T16:24:08.442157+0000","last_peered":"2024-07-24T16:24:08.442157+0000","last_clean":"2024-07-24T16:24:08.442157+0000","last_became_active":"2024-07-24T16:24:03.410332+0000","last_became_peered":"2024-07-24T16:24:03.410332+0000","last_unstale":"2024-07-24T16:24:08.442157+0000","last_undegraded":"2024-07-24T16:24:08.442157+0000","last_fullsized":"2024-07-24T16:24:08.442157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:05.808945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759607+0000","last_change":"2024-07-24T16:24:07.449263+0000","last_active":"2024-07-24T16:24:08.759607+0000","last_peered":"2024-07-24T16:24:08.759607+0000","last_clean":"2024-07-24T16:24:08.759607+0000","last_became_active":"2024-07-24T16:24:07.448686+0000","last_became_peered":"2024-07-24T16:24:07.448686+0000","last_unstale":"2024-07-24T16:24:08.759607+0000","last_undegraded":"2024-07-24T16:24:08.759607+0000","last_fullsized":"2024-07-24T16:24:08.759607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:05.528295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931074+0000","last_change":"2024-07-24T16:24:03.420544+0000","last_active":"2024-07-24T16:24:08.931074+0000","last_peered":"2024-07-24T16:24:08.931074+0000","last_clean":"2024-07-24T16:24:08.931074+0000","last_became_active":"2024-07-24T16:24:03.419248+0000","last_became_peered":"2024-07-24T16:24:03.419248+0000","last_unstale":"2024-07-24T16:24:08.931074+0000","last_undegraded":"2024-07-24T16:24:08.931074+0000","last_fullsized":"2024-07-24T16:24:08.931074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931758+0000","last_change":"2024-07-24T16:24:02.427241+0000","last_active":"2024-07-24T16:24:08.931758+0000","last_peered":"2024-07-24T16:24:08.931758+0000","last_clean":"2024-07-24T16:24:08.931758+0000","last_became_active":"2024-07-24T16:24:02.426981+0000","last_became_peered":"2024-07-24T16:24:02.426981+0000","last_unstale":"2024-07-24T16:24:08.931758+0000","last_undegraded":"2024-07-24T16:24:08.931758+0000","last_fullsized":"2024-07-24T16:24:08.931758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760170+0000","last_change":"2024-07-24T16:24:07.453666+0000","last_active":"2024-07-24T16:24:08.760170+0000","last_peered":"2024-07-24T16:24:08.760170+0000","last_clean":"2024-07-24T16:24:08.760170+0000","last_became_active":"2024-07-24T16:24:07.453136+0000","last_became_peered":"2024-07-24T16:24:07.453136+0000","last_unstale":"2024-07-24T16:24:08.760170+0000","last_undegraded":"2024-07-24T16:24:08.760170+0000","last_fullsized":"2024-07-24T16:24:08.760170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:25.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663125+0000","last_change":"2024-07-24T16:24:03.419598+0000","last_active":"2024-07-24T16:24:08.663125+0000","last_peered":"2024-07-24T16:24:08.663125+0000","last_clean":"2024-07-24T16:24:08.663125+0000","last_became_active":"2024-07-24T16:24:03.419148+0000","last_became_peered":"2024-07-24T16:24:03.419148+0000","last_unstale":"2024-07-24T16:24:08.663125+0000","last_undegraded":"2024-07-24T16:24:08.663125+0000","last_fullsized":"2024-07-24T16:24:08.663125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:33:56.923986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930432+0000","last_change":"2024-07-24T16:24:02.412753+0000","last_active":"2024-07-24T16:24:08.930432+0000","last_peered":"2024-07-24T16:24:08.930432+0000","last_clean":"2024-07-24T16:24:08.930432+0000","last_became_active":"2024-07-24T16:24:02.412500+0000","last_became_peered":"2024-07-24T16:24:02.412500+0000","last_unstale":"2024-07-24T16:24:08.930432+0000","last_undegraded":"2024-07-24T16:24:08.930432+0000","last_fullsized":"2024-07-24T16:24:08.930432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759990+0000","last_change":"2024-07-24T16:24:07.447575+0000","last_active":"2024-07-24T16:24:08.759990+0000","last_peered":"2024-07-24T16:24:08.759990+0000","last_clean":"2024-07-24T16:24:08.759990+0000","last_became_active":"2024-07-24T16:24:07.447131+0000","last_became_peered":"2024-07-24T16:24:07.447131+0000","last_unstale":"2024-07-24T16:24:08.759990+0000","last_undegraded":"2024-07-24T16:24:08.759990+0000","last_fullsized":"2024-07-24T16:24:08.759990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:00.032046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662902+0000","last_change":"2024-07-24T16:24:03.414198+0000","last_active":"2024-07-24T16:24:08.662902+0000","last_peered":"2024-07-24T16:24:08.662902+0000","last_clean":"2024-07-24T16:24:08.662902+0000","last_became_active":"2024-07-24T16:24:03.413765+0000","last_became_peered":"2024-07-24T16:24:03.413765+0000","last_unstale":"2024-07-24T16:24:08.662902+0000","last_undegraded":"2024-07-24T16:24:08.662902+0000","last_fullsized":"2024-07-24T16:24:08.662902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:11.929285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930215+0000","last_change":"2024-07-24T16:24:02.424488+0000","last_active":"2024-07-24T16:24:08.930215+0000","last_peered":"2024-07-24T16:24:08.930215+0000","last_clean":"2024-07-24T16:24:08.930215+0000","last_became_active":"2024-07-24T16:24:02.424175+0000","last_became_peered":"2024-07-24T16:24:02.424175+0000","last_unstale":"2024-07-24T16:24:08.930215+0000","last_undegraded":"2024-07-24T16:24:08.930215+0000","last_fullsized":"2024-07-24T16:24:08.930215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930944+0000","last_change":"2024-07-24T16:24:07.689275+0000","last_active":"2024-07-24T16:24:08.930944+0000","last_peered":"2024-07-24T16:24:08.930944+0000","last_clean":"2024-07-24T16:24:08.930944+0000","last_became_active":"2024-07-24T16:24:07.688814+0000","last_became_peered":"2024-07-24T16:24:07.688814+0000","last_unstale":"2024-07-24T16:24:08.930944+0000","last_undegraded":"2024-07-24T16:24:08.930944+0000","last_fullsized":"2024-07-24T16:24:08.930944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:50:06.081975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759861+0000","last_change":"2024-07-24T16:24:03.410501+0000","last_active":"2024-07-24T16:24:08.759861+0000","last_peered":"2024-07-24T16:24:08.759861+0000","last_clean":"2024-07-24T16:24:08.759861+0000","last_became_active":"2024-07-24T16:24:03.410221+0000","last_became_peered":"2024-07-24T16:24:03.410221+0000","last_unstale":"2024-07-24T16:24:08.759861+0000","last_undegraded":"2024-07-24T16:24:08.759861+0000","last_fullsized":"2024-07-24T16:24:08.759861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:07.509173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930886+0000","last_change":"2024-07-24T16:24:02.424500+0000","last_active":"2024-07-24T16:24:08.930886+0000","last_peered":"2024-07-24T16:24:08.930886+0000","last_clean":"2024-07-24T16:24:08.930886+0000","last_became_active":"2024-07-24T16:24:02.423974+0000","last_became_peered":"2024-07-24T16:24:02.423974+0000","last_unstale":"2024-07-24T16:24:08.930886+0000","last_undegraded":"2024-07-24T16:24:08.930886+0000","last_fullsized":"2024-07-24T16:24:08.930886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760199+0000","last_change":"2024-07-24T16:24:07.446830+0000","last_active":"2024-07-24T16:24:08.760199+0000","last_peered":"2024-07-24T16:24:08.760199+0000","last_clean":"2024-07-24T16:24:08.760199+0000","last_became_active":"2024-07-24T16:24:07.446412+0000","last_became_peered":"2024-07-24T16:24:07.446412+0000","last_unstale":"2024-07-24T16:24:08.760199+0000","last_undegraded":"2024-07-24T16:24:08.760199+0000","last_fullsized":"2024-07-24T16:24:08.760199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:46.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441614+0000","last_change":"2024-07-24T16:24:03.418856+0000","last_active":"2024-07-24T16:24:08.441614+0000","last_peered":"2024-07-24T16:24:08.441614+0000","last_clean":"2024-07-24T16:24:08.441614+0000","last_became_active":"2024-07-24T16:24:03.418584+0000","last_became_peered":"2024-07-24T16:24:03.418584+0000","last_unstale":"2024-07-24T16:24:08.441614+0000","last_undegraded":"2024-07-24T16:24:08.441614+0000","last_fullsized":"2024-07-24T16:24:08.441614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931815+0000","last_change":"2024-07-24T16:24:02.424481+0000","last_active":"2024-07-24T16:24:08.931815+0000","last_peered":"2024-07-24T16:24:08.931815+0000","last_clean":"2024-07-24T16:24:08.931815+0000","last_became_active":"2024-07-24T16:24:02.424223+0000","last_became_peered":"2024-07-24T16:24:02.424223+0000","last_unstale":"2024-07-24T16:24:08.931815+0000","last_undegraded":"2024-07-24T16:24:08.931815+0000","last_fullsized":"2024-07-24T16:24:08.931815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759577+0000","last_change":"2024-07-24T16:24:07.689438+0000","last_active":"2024-07-24T16:24:08.759577+0000","last_peered":"2024-07-24T16:24:08.759577+0000","last_clean":"2024-07-24T16:24:08.759577+0000","last_became_active":"2024-07-24T16:24:07.689062+0000","last_became_peered":"2024-07-24T16:24:07.689062+0000","last_unstale":"2024-07-24T16:24:08.759577+0000","last_undegraded":"2024-07-24T16:24:08.759577+0000","last_fullsized":"2024-07-24T16:24:08.759577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:15.957949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663604+0000","last_change":"2024-07-24T16:24:03.420566+0000","last_active":"2024-07-24T16:24:08.663604+0000","last_peered":"2024-07-24T16:24:08.663604+0000","last_clean":"2024-07-24T16:24:08.663604+0000","last_became_active":"2024-07-24T16:24:03.420294+0000","last_became_peered":"2024-07-24T16:24:03.420294+0000","last_unstale":"2024-07-24T16:24:08.663604+0000","last_undegraded":"2024-07-24T16:24:08.663604+0000","last_fullsized":"2024-07-24T16:24:08.663604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:01.499631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930843+0000","last_change":"2024-07-24T16:24:02.417701+0000","last_active":"2024-07-24T16:24:08.930843+0000","last_peered":"2024-07-24T16:24:08.930843+0000","last_clean":"2024-07-24T16:24:08.930843+0000","last_became_active":"2024-07-24T16:24:02.417387+0000","last_became_peered":"2024-07-24T16:24:02.417387+0000","last_unstale":"2024-07-24T16:24:08.930843+0000","last_undegraded":"2024-07-24T16:24:08.930843+0000","last_fullsized":"2024-07-24T16:24:08.930843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662631+0000","last_change":"2024-07-24T16:24:07.692448+0000","last_active":"2024-07-24T16:24:08.662631+0000","last_peered":"2024-07-24T16:24:08.662631+0000","last_clean":"2024-07-24T16:24:08.662631+0000","last_became_active":"2024-07-24T16:24:07.691926+0000","last_became_peered":"2024-07-24T16:24:07.691926+0000","last_unstale":"2024-07-24T16:24:08.662631+0000","last_undegraded":"2024-07-24T16:24:08.662631+0000","last_fullsized":"2024-07-24T16:24:08.662631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:53:01.459934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930611+0000","last_change":"2024-07-24T16:24:03.407657+0000","last_active":"2024-07-24T16:24:08.930611+0000","last_peered":"2024-07-24T16:24:08.930611+0000","last_clean":"2024-07-24T16:24:08.930611+0000","last_became_active":"2024-07-24T16:24:03.407207+0000","last_became_peered":"2024-07-24T16:24:03.407207+0000","last_unstale":"2024-07-24T16:24:08.930611+0000","last_undegraded":"2024-07-24T16:24:08.930611+0000","last_fullsized":"2024-07-24T16:24:08.930611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932275+0000","last_change":"2024-07-24T16:24:02.424314+0000","last_active":"2024-07-24T16:24:08.932275+0000","last_peered":"2024-07-24T16:24:08.932275+0000","last_clean":"2024-07-24T16:24:08.932275+0000","last_became_active":"2024-07-24T16:24:02.424058+0000","last_became_peered":"2024-07-24T16:24:02.424058+0000","last_unstale":"2024-07-24T16:24:08.932275+0000","last_undegraded":"2024-07-24T16:24:08.932275+0000","last_fullsized":"2024-07-24T16:24:08.932275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:56:35.089759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441392+0000","last_change":"2024-07-24T16:24:07.689455+0000","last_active":"2024-07-24T16:24:08.441392+0000","last_peered":"2024-07-24T16:24:08.441392+0000","last_clean":"2024-07-24T16:24:08.441392+0000","last_became_active":"2024-07-24T16:24:07.689096+0000","last_became_peered":"2024-07-24T16:24:07.689096+0000","last_unstale":"2024-07-24T16:24:08.441392+0000","last_undegraded":"2024-07-24T16:24:08.441392+0000","last_fullsized":"2024-07-24T16:24:08.441392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:46.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442272+0000","last_change":"2024-07-24T16:24:03.418605+0000","last_active":"2024-07-24T16:24:08.442272+0000","last_peered":"2024-07-24T16:24:08.442272+0000","last_clean":"2024-07-24T16:24:08.442272+0000","last_became_active":"2024-07-24T16:24:03.417882+0000","last_became_peered":"2024-07-24T16:24:03.417882+0000","last_unstale":"2024-07-24T16:24:08.442272+0000","last_undegraded":"2024-07-24T16:24:08.442272+0000","last_fullsized":"2024-07-24T16:24:08.442272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:01.499631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930686+0000","last_change":"2024-07-24T16:24:02.414441+0000","last_active":"2024-07-24T16:24:08.930686+0000","last_peered":"2024-07-24T16:24:08.930686+0000","last_clean":"2024-07-24T16:24:08.930686+0000","last_became_active":"2024-07-24T16:24:02.414195+0000","last_became_peered":"2024-07-24T16:24:02.414195+0000","last_unstale":"2024-07-24T16:24:08.930686+0000","last_undegraded":"2024-07-24T16:24:08.930686+0000","last_fullsized":"2024-07-24T16:24:08.930686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:11:26.148830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930197+0000","last_change":"2024-07-24T16:24:07.456656+0000","last_active":"2024-07-24T16:24:08.930197+0000","last_peered":"2024-07-24T16:24:08.930197+0000","last_clean":"2024-07-24T16:24:08.930197+0000","last_became_active":"2024-07-24T16:24:07.456253+0000","last_became_peered":"2024-07-24T16:24:07.456253+0000","last_unstale":"2024-07-24T16:24:08.930197+0000","last_undegraded":"2024-07-24T16:24:08.930197+0000","last_fullsized":"2024-07-24T16:24:08.930197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:46.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760097+0000","last_change":"2024-07-24T16:24:03.419761+0000","last_active":"2024-07-24T16:24:08.760097+0000","last_peered":"2024-07-24T16:24:08.760097+0000","last_clean":"2024-07-24T16:24:08.760097+0000","last_became_active":"2024-07-24T16:24:03.419479+0000","last_became_peered":"2024-07-24T16:24:03.419479+0000","last_unstale":"2024-07-24T16:24:08.760097+0000","last_undegraded":"2024-07-24T16:24:08.760097+0000","last_fullsized":"2024-07-24T16:24:08.760097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:45:49.295282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442191+0000","last_change":"2024-07-24T16:24:02.414549+0000","last_active":"2024-07-24T16:24:08.442191+0000","last_peered":"2024-07-24T16:24:08.442191+0000","last_clean":"2024-07-24T16:24:08.442191+0000","last_became_active":"2024-07-24T16:24:02.414271+0000","last_became_peered":"2024-07-24T16:24:02.414271+0000","last_unstale":"2024-07-24T16:24:08.442191+0000","last_undegraded":"2024-07-24T16:24:08.442191+0000","last_fullsized":"2024-07-24T16:24:08.442191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930578+0000","last_change":"2024-07-24T16:24:07.446913+0000","last_active":"2024-07-24T16:24:08.930578+0000","last_peered":"2024-07-24T16:24:08.930578+0000","last_clean":"2024-07-24T16:24:08.930578+0000","last_became_active":"2024-07-24T16:24:07.446002+0000","last_became_peered":"2024-07-24T16:24:07.446002+0000","last_unstale":"2024-07-24T16:24:08.930578+0000","last_undegraded":"2024-07-24T16:24:08.930578+0000","last_fullsized":"2024-07-24T16:24:08.930578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:41.634001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930229+0000","last_change":"2024-07-24T16:24:03.406743+0000","last_active":"2024-07-24T16:24:08.930229+0000","last_peered":"2024-07-24T16:24:08.930229+0000","last_clean":"2024-07-24T16:24:08.930229+0000","last_became_active":"2024-07-24T16:24:03.406481+0000","last_became_peered":"2024-07-24T16:24:03.406481+0000","last_unstale":"2024-07-24T16:24:08.930229+0000","last_undegraded":"2024-07-24T16:24:08.930229+0000","last_fullsized":"2024-07-24T16:24:08.930229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.439757+0000","last_change":"2024-07-24T16:24:02.412920+0000","last_active":"2024-07-24T16:24:08.439757+0000","last_peered":"2024-07-24T16:24:08.439757+0000","last_clean":"2024-07-24T16:24:08.439757+0000","last_became_active":"2024-07-24T16:24:02.412548+0000","last_became_peered":"2024-07-24T16:24:02.412548+0000","last_unstale":"2024-07-24T16:24:08.439757+0000","last_undegraded":"2024-07-24T16:24:08.439757+0000","last_fullsized":"2024-07-24T16:24:08.439757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930950+0000","last_change":"2024-07-24T16:24:07.456001+0000","last_active":"2024-07-24T16:24:08.930950+0000","last_peered":"2024-07-24T16:24:08.930950+0000","last_clean":"2024-07-24T16:24:08.930950+0000","last_became_active":"2024-07-24T16:24:07.455608+0000","last_became_peered":"2024-07-24T16:24:07.455608+0000","last_unstale":"2024-07-24T16:24:08.930950+0000","last_undegraded":"2024-07-24T16:24:08.930950+0000","last_fullsized":"2024-07-24T16:24:08.930950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:48:55.180884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441022+0000","last_change":"2024-07-24T16:24:03.421468+0000","last_active":"2024-07-24T16:24:08.441022+0000","last_peered":"2024-07-24T16:24:08.441022+0000","last_clean":"2024-07-24T16:24:08.441022+0000","last_became_active":"2024-07-24T16:24:03.420885+0000","last_became_peered":"2024-07-24T16:24:03.420885+0000","last_unstale":"2024-07-24T16:24:08.441022+0000","last_undegraded":"2024-07-24T16:24:08.441022+0000","last_fullsized":"2024-07-24T16:24:08.441022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930925+0000","last_change":"2024-07-24T16:24:02.424655+0000","last_active":"2024-07-24T16:24:08.930925+0000","last_peered":"2024-07-24T16:24:08.930925+0000","last_clean":"2024-07-24T16:24:08.930925+0000","last_became_active":"2024-07-24T16:24:02.424258+0000","last_became_peered":"2024-07-24T16:24:02.424258+0000","last_unstale":"2024-07-24T16:24:08.930925+0000","last_undegraded":"2024-07-24T16:24:08.930925+0000","last_fullsized":"2024-07-24T16:24:08.930925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441444+0000","last_change":"2024-07-24T16:24:07.689063+0000","last_active":"2024-07-24T16:24:08.441444+0000","last_peered":"2024-07-24T16:24:08.441444+0000","last_clean":"2024-07-24T16:24:08.441444+0000","last_became_active":"2024-07-24T16:24:07.688668+0000","last_became_peered":"2024-07-24T16:24:07.688668+0000","last_unstale":"2024-07-24T16:24:08.441444+0000","last_undegraded":"2024-07-24T16:24:08.441444+0000","last_fullsized":"2024-07-24T16:24:08.441444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:41.279030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663032+0000","last_change":"2024-07-24T16:24:03.414611+0000","last_active":"2024-07-24T16:24:08.663032+0000","last_peered":"2024-07-24T16:24:08.663032+0000","last_clean":"2024-07-24T16:24:08.663032+0000","last_became_active":"2024-07-24T16:24:03.414234+0000","last_became_peered":"2024-07-24T16:24:03.414234+0000","last_unstale":"2024-07-24T16:24:08.663032+0000","last_undegraded":"2024-07-24T16:24:08.663032+0000","last_fullsized":"2024-07-24T16:24:08.663032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442285+0000","last_change":"2024-07-24T16:24:02.413921+0000","last_active":"2024-07-24T16:24:08.442285+0000","last_peered":"2024-07-24T16:24:08.442285+0000","last_clean":"2024-07-24T16:24:08.442285+0000","last_became_active":"2024-07-24T16:24:02.413460+0000","last_became_peered":"2024-07-24T16:24:02.413460+0000","last_unstale":"2024-07-24T16:24:08.442285+0000","last_undegraded":"2024-07-24T16:24:08.442285+0000","last_fullsized":"2024-07-24T16:24:08.442285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":117,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930636+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:24:08.930636+0000","last_peered":"2024-07-24T16:24:08.930636+0000","last_clean":"2024-07-24T16:24:08.930636+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:24:08.930636+0000","last_undegraded":"2024-07-24T16:24:08.930636+0000","last_fullsized":"2024-07-24T16:24:08.930636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931362+0000","last_change":"2024-07-24T16:24:07.691109+0000","last_active":"2024-07-24T16:24:08.931362+0000","last_peered":"2024-07-24T16:24:08.931362+0000","last_clean":"2024-07-24T16:24:08.931362+0000","last_became_active":"2024-07-24T16:24:07.690690+0000","last_became_peered":"2024-07-24T16:24:07.690690+0000","last_unstale":"2024-07-24T16:24:08.931362+0000","last_undegraded":"2024-07-24T16:24:08.931362+0000","last_fullsized":"2024-07-24T16:24:08.931362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:00.032046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931993+0000","last_change":"2024-07-24T16:24:03.425855+0000","last_active":"2024-07-24T16:24:08.931993+0000","last_peered":"2024-07-24T16:24:08.931993+0000","last_clean":"2024-07-24T16:24:08.931993+0000","last_became_active":"2024-07-24T16:24:03.425039+0000","last_became_peered":"2024-07-24T16:24:03.425039+0000","last_unstale":"2024-07-24T16:24:08.931993+0000","last_undegraded":"2024-07-24T16:24:08.931993+0000","last_fullsized":"2024-07-24T16:24:08.931993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:32:56.003382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440339+0000","last_change":"2024-07-24T16:24:02.419130+0000","last_active":"2024-07-24T16:24:08.440339+0000","last_peered":"2024-07-24T16:24:08.440339+0000","last_clean":"2024-07-24T16:24:08.440339+0000","last_became_active":"2024-07-24T16:24:02.418877+0000","last_became_peered":"2024-07-24T16:24:02.418877+0000","last_unstale":"2024-07-24T16:24:08.440339+0000","last_undegraded":"2024-07-24T16:24:08.440339+0000","last_fullsized":"2024-07-24T16:24:08.440339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:11:26.148830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931126+0000","last_change":"2024-07-24T16:24:07.689387+0000","last_active":"2024-07-24T16:24:08.931126+0000","last_peered":"2024-07-24T16:24:08.931126+0000","last_clean":"2024-07-24T16:24:08.931126+0000","last_became_active":"2024-07-24T16:24:07.688861+0000","last_became_peered":"2024-07-24T16:24:07.688861+0000","last_unstale":"2024-07-24T16:24:08.931126+0000","last_undegraded":"2024-07-24T16:24:08.931126+0000","last_fullsized":"2024-07-24T16:24:08.931126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:29.138058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442010+0000","last_change":"2024-07-24T16:24:03.414560+0000","last_active":"2024-07-24T16:24:08.442010+0000","last_peered":"2024-07-24T16:24:08.442010+0000","last_clean":"2024-07-24T16:24:08.442010+0000","last_became_active":"2024-07-24T16:24:03.414244+0000","last_became_peered":"2024-07-24T16:24:03.414244+0000","last_unstale":"2024-07-24T16:24:08.442010+0000","last_undegraded":"2024-07-24T16:24:08.442010+0000","last_fullsized":"2024-07-24T16:24:08.442010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:21.258885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930741+0000","last_change":"2024-07-24T16:24:02.414255+0000","last_active":"2024-07-24T16:24:08.930741+0000","last_peered":"2024-07-24T16:24:08.930741+0000","last_clean":"2024-07-24T16:24:08.930741+0000","last_became_active":"2024-07-24T16:24:02.413982+0000","last_became_peered":"2024-07-24T16:24:02.413982+0000","last_unstale":"2024-07-24T16:24:08.930741+0000","last_undegraded":"2024-07-24T16:24:08.930741+0000","last_fullsized":"2024-07-24T16:24:08.930741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441533+0000","last_change":"2024-07-24T16:24:07.450463+0000","last_active":"2024-07-24T16:24:08.441533+0000","last_peered":"2024-07-24T16:24:08.441533+0000","last_clean":"2024-07-24T16:24:08.441533+0000","last_became_active":"2024-07-24T16:24:07.449717+0000","last_became_peered":"2024-07-24T16:24:07.449717+0000","last_unstale":"2024-07-24T16:24:08.441533+0000","last_undegraded":"2024-07-24T16:24:08.441533+0000","last_fullsized":"2024-07-24T16:24:08.441533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:41.634001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932150+0000","last_change":"2024-07-24T16:24:03.421244+0000","last_active":"2024-07-24T16:24:08.932150+0000","last_peered":"2024-07-24T16:24:08.932150+0000","last_clean":"2024-07-24T16:24:08.932150+0000","last_became_active":"2024-07-24T16:24:03.420900+0000","last_became_peered":"2024-07-24T16:24:03.420900+0000","last_unstale":"2024-07-24T16:24:08.932150+0000","last_undegraded":"2024-07-24T16:24:08.932150+0000","last_fullsized":"2024-07-24T16:24:08.932150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:48:51.152220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440222+0000","last_change":"2024-07-24T16:24:02.413448+0000","last_active":"2024-07-24T16:24:08.440222+0000","last_peered":"2024-07-24T16:24:08.440222+0000","last_clean":"2024-07-24T16:24:08.440222+0000","last_became_active":"2024-07-24T16:24:02.412569+0000","last_became_peered":"2024-07-24T16:24:02.412569+0000","last_unstale":"2024-07-24T16:24:08.440222+0000","last_undegraded":"2024-07-24T16:24:08.440222+0000","last_fullsized":"2024-07-24T16:24:08.440222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441408+0000","last_change":"2024-07-24T16:24:07.689773+0000","last_active":"2024-07-24T16:24:08.441408+0000","last_peered":"2024-07-24T16:24:08.441408+0000","last_clean":"2024-07-24T16:24:08.441408+0000","last_became_active":"2024-07-24T16:24:07.689367+0000","last_became_peered":"2024-07-24T16:24:07.689367+0000","last_unstale":"2024-07-24T16:24:08.441408+0000","last_undegraded":"2024-07-24T16:24:08.441408+0000","last_fullsized":"2024-07-24T16:24:08.441408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:53:01.459934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932045+0000","last_change":"2024-07-24T16:24:03.420569+0000","last_active":"2024-07-24T16:24:08.932045+0000","last_peered":"2024-07-24T16:24:08.932045+0000","last_clean":"2024-07-24T16:24:08.932045+0000","last_became_active":"2024-07-24T16:24:03.420253+0000","last_became_peered":"2024-07-24T16:24:03.420253+0000","last_unstale":"2024-07-24T16:24:08.932045+0000","last_undegraded":"2024-07-24T16:24:08.932045+0000","last_fullsized":"2024-07-24T16:24:08.932045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:21.258885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760346+0000","last_change":"2024-07-24T16:24:02.417860+0000","last_active":"2024-07-24T16:24:08.760346+0000","last_peered":"2024-07-24T16:24:08.760346+0000","last_clean":"2024-07-24T16:24:08.760346+0000","last_became_active":"2024-07-24T16:24:02.417610+0000","last_became_peered":"2024-07-24T16:24:02.417610+0000","last_unstale":"2024-07-24T16:24:08.760346+0000","last_undegraded":"2024-07-24T16:24:08.760346+0000","last_fullsized":"2024-07-24T16:24:08.760346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:34:17.692339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759523+0000","last_change":"2024-07-24T16:24:07.447096+0000","last_active":"2024-07-24T16:24:08.759523+0000","last_peered":"2024-07-24T16:24:08.759523+0000","last_clean":"2024-07-24T16:24:08.759523+0000","last_became_active":"2024-07-24T16:24:07.446606+0000","last_became_peered":"2024-07-24T16:24:07.446606+0000","last_unstale":"2024-07-24T16:24:08.759523+0000","last_undegraded":"2024-07-24T16:24:08.759523+0000","last_fullsized":"2024-07-24T16:24:08.759523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:31.194762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931063+0000","last_change":"2024-07-24T16:24:03.425422+0000","last_active":"2024-07-24T16:24:08.931063+0000","last_peered":"2024-07-24T16:24:08.931063+0000","last_clean":"2024-07-24T16:24:08.931063+0000","last_became_active":"2024-07-24T16:24:03.421595+0000","last_became_peered":"2024-07-24T16:24:03.421595+0000","last_unstale":"2024-07-24T16:24:08.931063+0000","last_undegraded":"2024-07-24T16:24:08.931063+0000","last_fullsized":"2024-07-24T16:24:08.931063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:11.929285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.439657+0000","last_change":"2024-07-24T16:24:02.411221+0000","last_active":"2024-07-24T16:24:08.439657+0000","last_peered":"2024-07-24T16:24:08.439657+0000","last_clean":"2024-07-24T16:24:08.439657+0000","last_became_active":"2024-07-24T16:24:02.410863+0000","last_became_peered":"2024-07-24T16:24:02.410863+0000","last_unstale":"2024-07-24T16:24:08.439657+0000","last_undegraded":"2024-07-24T16:24:08.439657+0000","last_fullsized":"2024-07-24T16:24:08.439657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:39:09.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441228+0000","last_change":"2024-07-24T16:24:07.451699+0000","last_active":"2024-07-24T16:24:08.441228+0000","last_peered":"2024-07-24T16:24:08.441228+0000","last_clean":"2024-07-24T16:24:08.441228+0000","last_became_active":"2024-07-24T16:24:07.451312+0000","last_became_peered":"2024-07-24T16:24:07.451312+0000","last_unstale":"2024-07-24T16:24:08.441228+0000","last_undegraded":"2024-07-24T16:24:08.441228+0000","last_fullsized":"2024-07-24T16:24:08.441228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:00.032046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930892+0000","last_change":"2024-07-24T16:24:03.423978+0000","last_active":"2024-07-24T16:24:08.930892+0000","last_peered":"2024-07-24T16:24:08.930892+0000","last_clean":"2024-07-24T16:24:08.930892+0000","last_became_active":"2024-07-24T16:24:03.423695+0000","last_became_peered":"2024-07-24T16:24:03.423695+0000","last_unstale":"2024-07-24T16:24:08.930892+0000","last_undegraded":"2024-07-24T16:24:08.930892+0000","last_fullsized":"2024-07-24T16:24:08.930892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930970+0000","last_change":"2024-07-24T16:24:02.420730+0000","last_active":"2024-07-24T16:24:08.930970+0000","last_peered":"2024-07-24T16:24:08.930970+0000","last_clean":"2024-07-24T16:24:08.930970+0000","last_became_active":"2024-07-24T16:24:02.420437+0000","last_became_peered":"2024-07-24T16:24:02.420437+0000","last_unstale":"2024-07-24T16:24:08.930970+0000","last_undegraded":"2024-07-24T16:24:08.930970+0000","last_fullsized":"2024-07-24T16:24:08.930970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663486+0000","last_change":"2024-07-24T16:24:07.689640+0000","last_active":"2024-07-24T16:24:08.663486+0000","last_peered":"2024-07-24T16:24:08.663486+0000","last_clean":"2024-07-24T16:24:08.663486+0000","last_became_active":"2024-07-24T16:24:07.689279+0000","last_became_peered":"2024-07-24T16:24:07.689279+0000","last_unstale":"2024-07-24T16:24:08.663486+0000","last_undegraded":"2024-07-24T16:24:08.663486+0000","last_fullsized":"2024-07-24T16:24:08.663486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:48:40.982486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931940+0000","last_change":"2024-07-24T16:24:03.422243+0000","last_active":"2024-07-24T16:24:08.931940+0000","last_peered":"2024-07-24T16:24:08.931940+0000","last_clean":"2024-07-24T16:24:08.931940+0000","last_became_active":"2024-07-24T16:24:03.419977+0000","last_became_peered":"2024-07-24T16:24:03.419977+0000","last_unstale":"2024-07-24T16:24:08.931940+0000","last_undegraded":"2024-07-24T16:24:08.931940+0000","last_fullsized":"2024-07-24T16:24:08.931940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:33:56.923986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442330+0000","last_change":"2024-07-24T16:24:02.415148+0000","last_active":"2024-07-24T16:24:08.442330+0000","last_peered":"2024-07-24T16:24:08.442330+0000","last_clean":"2024-07-24T16:24:08.442330+0000","last_became_active":"2024-07-24T16:24:02.414888+0000","last_became_peered":"2024-07-24T16:24:02.414888+0000","last_unstale":"2024-07-24T16:24:08.442330+0000","last_undegraded":"2024-07-24T16:24:08.442330+0000","last_fullsized":"2024-07-24T16:24:08.442330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663297+0000","last_change":"2024-07-24T16:24:07.689067+0000","last_active":"2024-07-24T16:24:08.663297+0000","last_peered":"2024-07-24T16:24:08.663297+0000","last_clean":"2024-07-24T16:24:08.663297+0000","last_became_active":"2024-07-24T16:24:07.688641+0000","last_became_peered":"2024-07-24T16:24:07.688641+0000","last_unstale":"2024-07-24T16:24:08.663297+0000","last_undegraded":"2024-07-24T16:24:08.663297+0000","last_fullsized":"2024-07-24T16:24:08.663297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:25:51.738843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441338+0000","last_change":"2024-07-24T16:24:03.431327+0000","last_active":"2024-07-24T16:24:08.441338+0000","last_peered":"2024-07-24T16:24:08.441338+0000","last_clean":"2024-07-24T16:24:08.441338+0000","last_became_active":"2024-07-24T16:24:03.430853+0000","last_became_peered":"2024-07-24T16:24:03.430853+0000","last_unstale":"2024-07-24T16:24:08.441338+0000","last_undegraded":"2024-07-24T16:24:08.441338+0000","last_fullsized":"2024-07-24T16:24:08.441338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441701+0000","last_change":"2024-07-24T16:24:02.420934+0000","last_active":"2024-07-24T16:24:08.441701+0000","last_peered":"2024-07-24T16:24:08.441701+0000","last_clean":"2024-07-24T16:24:08.441701+0000","last_became_active":"2024-07-24T16:24:02.420671+0000","last_became_peered":"2024-07-24T16:24:02.420671+0000","last_unstale":"2024-07-24T16:24:08.441701+0000","last_undegraded":"2024-07-24T16:24:08.441701+0000","last_fullsized":"2024-07-24T16:24:08.441701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:34:17.692339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441875+0000","last_change":"2024-07-24T16:24:07.689105+0000","last_active":"2024-07-24T16:24:08.441875+0000","last_peered":"2024-07-24T16:24:08.441875+0000","last_clean":"2024-07-24T16:24:08.441875+0000","last_became_active":"2024-07-24T16:24:07.688653+0000","last_became_peered":"2024-07-24T16:24:07.688653+0000","last_unstale":"2024-07-24T16:24:08.441875+0000","last_undegraded":"2024-07-24T16:24:08.441875+0000","last_fullsized":"2024-07-24T16:24:08.441875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:53:17.994950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931785+0000","last_change":"2024-07-24T16:24:03.426312+0000","last_active":"2024-07-24T16:24:08.931785+0000","last_peered":"2024-07-24T16:24:08.931785+0000","last_clean":"2024-07-24T16:24:08.931785+0000","last_became_active":"2024-07-24T16:24:03.425604+0000","last_became_peered":"2024-07-24T16:24:03.425604+0000","last_unstale":"2024-07-24T16:24:08.931785+0000","last_undegraded":"2024-07-24T16:24:08.931785+0000","last_fullsized":"2024-07-24T16:24:08.931785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:25.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:12.924059+0000","last_change":"2024-07-24T16:24:02.422934+0000","last_active":"2024-07-24T16:24:12.924059+0000","last_peered":"2024-07-24T16:24:12.924059+0000","last_clean":"2024-07-24T16:24:12.924059+0000","last_became_active":"2024-07-24T16:24:02.422695+0000","last_became_peered":"2024-07-24T16:24:02.422695+0000","last_unstale":"2024-07-24T16:24:12.924059+0000","last_undegraded":"2024-07-24T16:24:12.924059+0000","last_fullsized":"2024-07-24T16:24:12.924059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930364+0000","last_change":"2024-07-24T16:24:07.456345+0000","last_active":"2024-07-24T16:24:08.930364+0000","last_peered":"2024-07-24T16:24:08.930364+0000","last_clean":"2024-07-24T16:24:08.930364+0000","last_became_active":"2024-07-24T16:24:07.455655+0000","last_became_peered":"2024-07-24T16:24:07.455655+0000","last_unstale":"2024-07-24T16:24:08.930364+0000","last_undegraded":"2024-07-24T16:24:08.930364+0000","last_fullsized":"2024-07-24T16:24:08.930364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:41.279030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760268+0000","last_change":"2024-07-24T16:24:03.421137+0000","last_active":"2024-07-24T16:24:08.760268+0000","last_peered":"2024-07-24T16:24:08.760268+0000","last_clean":"2024-07-24T16:24:08.760268+0000","last_became_active":"2024-07-24T16:24:03.420297+0000","last_became_peered":"2024-07-24T16:24:03.420297+0000","last_unstale":"2024-07-24T16:24:08.760268+0000","last_undegraded":"2024-07-24T16:24:08.760268+0000","last_fullsized":"2024-07-24T16:24:08.760268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:56:36.133125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930677+0000","last_change":"2024-07-24T16:24:02.420388+0000","last_active":"2024-07-24T16:24:08.930677+0000","last_peered":"2024-07-24T16:24:08.930677+0000","last_clean":"2024-07-24T16:24:08.930677+0000","last_became_active":"2024-07-24T16:24:02.420112+0000","last_became_peered":"2024-07-24T16:24:02.420112+0000","last_unstale":"2024-07-24T16:24:08.930677+0000","last_undegraded":"2024-07-24T16:24:08.930677+0000","last_fullsized":"2024-07-24T16:24:08.930677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759693+0000","last_change":"2024-07-24T16:24:07.448340+0000","last_active":"2024-07-24T16:24:08.759693+0000","last_peered":"2024-07-24T16:24:08.759693+0000","last_clean":"2024-07-24T16:24:08.759693+0000","last_became_active":"2024-07-24T16:24:07.447324+0000","last_became_peered":"2024-07-24T16:24:07.447324+0000","last_unstale":"2024-07-24T16:24:08.759693+0000","last_undegraded":"2024-07-24T16:24:08.759693+0000","last_fullsized":"2024-07-24T16:24:08.759693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:34:00.952650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441533+0000","last_change":"2024-07-24T16:24:03.426242+0000","last_active":"2024-07-24T16:24:08.441533+0000","last_peered":"2024-07-24T16:24:08.441533+0000","last_clean":"2024-07-24T16:24:08.441533+0000","last_became_active":"2024-07-24T16:24:03.425940+0000","last_became_peered":"2024-07-24T16:24:03.425940+0000","last_unstale":"2024-07-24T16:24:08.441533+0000","last_undegraded":"2024-07-24T16:24:08.441533+0000","last_fullsized":"2024-07-24T16:24:08.441533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442327+0000","last_change":"2024-07-24T16:24:02.419299+0000","last_active":"2024-07-24T16:24:08.442327+0000","last_peered":"2024-07-24T16:24:08.442327+0000","last_clean":"2024-07-24T16:24:08.442327+0000","last_became_active":"2024-07-24T16:24:02.419004+0000","last_became_peered":"2024-07-24T16:24:02.419004+0000","last_unstale":"2024-07-24T16:24:08.442327+0000","last_undegraded":"2024-07-24T16:24:08.442327+0000","last_fullsized":"2024-07-24T16:24:08.442327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662799+0000","last_change":"2024-07-24T16:24:07.446403+0000","last_active":"2024-07-24T16:24:08.662799+0000","last_peered":"2024-07-24T16:24:08.662799+0000","last_clean":"2024-07-24T16:24:08.662799+0000","last_became_active":"2024-07-24T16:24:07.445711+0000","last_became_peered":"2024-07-24T16:24:07.445711+0000","last_unstale":"2024-07-24T16:24:08.662799+0000","last_undegraded":"2024-07-24T16:24:08.662799+0000","last_fullsized":"2024-07-24T16:24:08.662799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:14:48.365984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441973+0000","last_change":"2024-07-24T16:24:03.421104+0000","last_active":"2024-07-24T16:24:08.441973+0000","last_peered":"2024-07-24T16:24:08.441973+0000","last_clean":"2024-07-24T16:24:08.441973+0000","last_became_active":"2024-07-24T16:24:03.420479+0000","last_became_peered":"2024-07-24T16:24:03.420479+0000","last_unstale":"2024-07-24T16:24:08.441973+0000","last_undegraded":"2024-07-24T16:24:08.441973+0000","last_fullsized":"2024-07-24T16:24:08.441973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:37.605337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931694+0000","last_change":"2024-07-24T16:24:02.424342+0000","last_active":"2024-07-24T16:24:08.931694+0000","last_peered":"2024-07-24T16:24:08.931694+0000","last_clean":"2024-07-24T16:24:08.931694+0000","last_became_active":"2024-07-24T16:24:02.424056+0000","last_became_peered":"2024-07-24T16:24:02.424056+0000","last_unstale":"2024-07-24T16:24:08.931694+0000","last_undegraded":"2024-07-24T16:24:08.931694+0000","last_fullsized":"2024-07-24T16:24:08.931694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662718+0000","last_change":"2024-07-24T16:24:07.689112+0000","last_active":"2024-07-24T16:24:08.662718+0000","last_peered":"2024-07-24T16:24:08.662718+0000","last_clean":"2024-07-24T16:24:08.662718+0000","last_became_active":"2024-07-24T16:24:07.688763+0000","last_became_peered":"2024-07-24T16:24:07.688763+0000","last_unstale":"2024-07-24T16:24:08.662718+0000","last_undegraded":"2024-07-24T16:24:08.662718+0000","last_fullsized":"2024-07-24T16:24:08.662718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:53:17.994950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441200+0000","last_change":"2024-07-24T16:24:07.689772+0000","last_active":"2024-07-24T16:24:08.441200+0000","last_peered":"2024-07-24T16:24:08.441200+0000","last_clean":"2024-07-24T16:24:08.441200+0000","last_became_active":"2024-07-24T16:24:07.689417+0000","last_became_peered":"2024-07-24T16:24:07.689417+0000","last_unstale":"2024-07-24T16:24:08.441200+0000","last_undegraded":"2024-07-24T16:24:08.441200+0000","last_fullsized":"2024-07-24T16:24:08.441200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:25.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930100+0000","last_change":"2024-07-24T16:24:03.416202+0000","last_active":"2024-07-24T16:24:08.930100+0000","last_peered":"2024-07-24T16:24:08.930100+0000","last_clean":"2024-07-24T16:24:08.930100+0000","last_became_active":"2024-07-24T16:24:03.415444+0000","last_became_peered":"2024-07-24T16:24:03.415444+0000","last_unstale":"2024-07-24T16:24:08.930100+0000","last_undegraded":"2024-07-24T16:24:08.930100+0000","last_fullsized":"2024-07-24T16:24:08.930100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441673+0000","last_change":"2024-07-24T16:24:02.416160+0000","last_active":"2024-07-24T16:24:08.441673+0000","last_peered":"2024-07-24T16:24:08.441673+0000","last_clean":"2024-07-24T16:24:08.441673+0000","last_became_active":"2024-07-24T16:24:02.415685+0000","last_became_peered":"2024-07-24T16:24:02.415685+0000","last_unstale":"2024-07-24T16:24:08.441673+0000","last_undegraded":"2024-07-24T16:24:08.441673+0000","last_fullsized":"2024-07-24T16:24:08.441673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931484+0000","last_change":"2024-07-24T16:24:07.453889+0000","last_active":"2024-07-24T16:24:08.931484+0000","last_peered":"2024-07-24T16:24:08.931484+0000","last_clean":"2024-07-24T16:24:08.931484+0000","last_became_active":"2024-07-24T16:24:07.453401+0000","last_became_peered":"2024-07-24T16:24:07.453401+0000","last_unstale":"2024-07-24T16:24:08.931484+0000","last_undegraded":"2024-07-24T16:24:08.931484+0000","last_fullsized":"2024-07-24T16:24:08.931484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:25.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662799+0000","last_change":"2024-07-24T16:24:03.422055+0000","last_active":"2024-07-24T16:24:08.662799+0000","last_peered":"2024-07-24T16:24:08.662799+0000","last_clean":"2024-07-24T16:24:08.662799+0000","last_became_active":"2024-07-24T16:24:03.420953+0000","last_became_peered":"2024-07-24T16:24:03.420953+0000","last_unstale":"2024-07-24T16:24:08.662799+0000","last_undegraded":"2024-07-24T16:24:08.662799+0000","last_fullsized":"2024-07-24T16:24:08.662799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662904+0000","last_change":"2024-07-24T16:24:02.416293+0000","last_active":"2024-07-24T16:24:08.662904+0000","last_peered":"2024-07-24T16:24:08.662904+0000","last_clean":"2024-07-24T16:24:08.662904+0000","last_became_active":"2024-07-24T16:24:02.415990+0000","last_became_peered":"2024-07-24T16:24:02.415990+0000","last_unstale":"2024-07-24T16:24:08.662904+0000","last_undegraded":"2024-07-24T16:24:08.662904+0000","last_fullsized":"2024-07-24T16:24:08.662904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931260+0000","last_change":"2024-07-24T16:24:02.421954+0000","last_active":"2024-07-24T16:24:08.931260+0000","last_peered":"2024-07-24T16:24:08.931260+0000","last_clean":"2024-07-24T16:24:08.931260+0000","last_became_active":"2024-07-24T16:24:02.421684+0000","last_became_peered":"2024-07-24T16:24:02.421684+0000","last_unstale":"2024-07-24T16:24:08.931260+0000","last_undegraded":"2024-07-24T16:24:08.931260+0000","last_fullsized":"2024-07-24T16:24:08.931260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441648+0000","last_change":"2024-07-24T16:24:03.421135+0000","last_active":"2024-07-24T16:24:08.441648+0000","last_peered":"2024-07-24T16:24:08.441648+0000","last_clean":"2024-07-24T16:24:08.441648+0000","last_became_active":"2024-07-24T16:24:03.420836+0000","last_became_peered":"2024-07-24T16:24:03.420836+0000","last_unstale":"2024-07-24T16:24:08.441648+0000","last_undegraded":"2024-07-24T16:24:08.441648+0000","last_fullsized":"2024-07-24T16:24:08.441648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:17:16.704958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440237+0000","last_change":"2024-07-24T16:24:07.456171+0000","last_active":"2024-07-24T16:24:08.440237+0000","last_peered":"2024-07-24T16:24:08.440237+0000","last_clean":"2024-07-24T16:24:08.440237+0000","last_became_active":"2024-07-24T16:24:07.455706+0000","last_became_peered":"2024-07-24T16:24:07.455706+0000","last_unstale":"2024-07-24T16:24:08.440237+0000","last_undegraded":"2024-07-24T16:24:08.440237+0000","last_fullsized":"2024-07-24T16:24:08.440237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:57:59.034419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663222+0000","last_change":"2024-07-24T16:24:02.424430+0000","last_active":"2024-07-24T16:24:08.663222+0000","last_peered":"2024-07-24T16:24:08.663222+0000","last_clean":"2024-07-24T16:24:08.663222+0000","last_became_active":"2024-07-24T16:24:02.424131+0000","last_became_peered":"2024-07-24T16:24:02.424131+0000","last_unstale":"2024-07-24T16:24:08.663222+0000","last_undegraded":"2024-07-24T16:24:08.663222+0000","last_fullsized":"2024-07-24T16:24:08.663222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:11:26.148830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759757+0000","last_change":"2024-07-24T16:24:03.405739+0000","last_active":"2024-07-24T16:24:08.759757+0000","last_peered":"2024-07-24T16:24:08.759757+0000","last_clean":"2024-07-24T16:24:08.759757+0000","last_became_active":"2024-07-24T16:24:03.405465+0000","last_became_peered":"2024-07-24T16:24:03.405465+0000","last_unstale":"2024-07-24T16:24:08.759757+0000","last_undegraded":"2024-07-24T16:24:08.759757+0000","last_fullsized":"2024-07-24T16:24:08.759757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:17.143178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663324+0000","last_change":"2024-07-24T16:24:07.451902+0000","last_active":"2024-07-24T16:24:08.663324+0000","last_peered":"2024-07-24T16:24:08.663324+0000","last_clean":"2024-07-24T16:24:08.663324+0000","last_became_active":"2024-07-24T16:24:07.451243+0000","last_became_peered":"2024-07-24T16:24:07.451243+0000","last_unstale":"2024-07-24T16:24:08.663324+0000","last_undegraded":"2024-07-24T16:24:08.663324+0000","last_fullsized":"2024-07-24T16:24:08.663324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:32:02.239427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930768+0000","last_change":"2024-07-24T16:24:03.426344+0000","last_active":"2024-07-24T16:24:08.930768+0000","last_peered":"2024-07-24T16:24:08.930768+0000","last_clean":"2024-07-24T16:24:08.930768+0000","last_became_active":"2024-07-24T16:24:03.426064+0000","last_became_peered":"2024-07-24T16:24:03.426064+0000","last_unstale":"2024-07-24T16:24:08.930768+0000","last_undegraded":"2024-07-24T16:24:08.930768+0000","last_fullsized":"2024-07-24T16:24:08.930768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:17:16.704958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.439822+0000","last_change":"2024-07-24T16:24:03.414954+0000","last_active":"2024-07-24T16:24:08.439822+0000","last_peered":"2024-07-24T16:24:08.439822+0000","last_clean":"2024-07-24T16:24:08.439822+0000","last_became_active":"2024-07-24T16:24:03.414684+0000","last_became_peered":"2024-07-24T16:24:03.414684+0000","last_unstale":"2024-07-24T16:24:08.439822+0000","last_undegraded":"2024-07-24T16:24:08.439822+0000","last_fullsized":"2024-07-24T16:24:08.439822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:17.143178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441834+0000","last_change":"2024-07-24T16:24:03.420882+0000","last_active":"2024-07-24T16:24:08.441834+0000","last_peered":"2024-07-24T16:24:08.441834+0000","last_clean":"2024-07-24T16:24:08.441834+0000","last_became_active":"2024-07-24T16:24:03.420555+0000","last_became_peered":"2024-07-24T16:24:03.420555+0000","last_unstale":"2024-07-24T16:24:08.441834+0000","last_undegraded":"2024-07-24T16:24:08.441834+0000","last_fullsized":"2024-07-24T16:24:08.441834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:37.250366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441536+0000","last_change":"2024-07-24T16:24:03.419648+0000","last_active":"2024-07-24T16:24:08.441536+0000","last_peered":"2024-07-24T16:24:08.441536+0000","last_clean":"2024-07-24T16:24:08.441536+0000","last_became_active":"2024-07-24T16:24:03.419390+0000","last_became_peered":"2024-07-24T16:24:03.419390+0000","last_unstale":"2024-07-24T16:24:08.441536+0000","last_undegraded":"2024-07-24T16:24:08.441536+0000","last_fullsized":"2024-07-24T16:24:08.441536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663423+0000","last_change":"2024-07-24T16:24:03.420527+0000","last_active":"2024-07-24T16:24:08.663423+0000","last_peered":"2024-07-24T16:24:08.663423+0000","last_clean":"2024-07-24T16:24:08.663423+0000","last_became_active":"2024-07-24T16:24:03.419368+0000","last_became_peered":"2024-07-24T16:24:03.419368+0000","last_unstale":"2024-07-24T16:24:08.663423+0000","last_undegraded":"2024-07-24T16:24:08.663423+0000","last_fullsized":"2024-07-24T16:24:08.663423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:25.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930580+0000","last_change":"2024-07-24T16:24:03.416673+0000","last_active":"2024-07-24T16:24:08.930580+0000","last_peered":"2024-07-24T16:24:08.930580+0000","last_clean":"2024-07-24T16:24:08.930580+0000","last_became_active":"2024-07-24T16:24:03.416375+0000","last_became_peered":"2024-07-24T16:24:03.416375+0000","last_unstale":"2024-07-24T16:24:08.930580+0000","last_undegraded":"2024-07-24T16:24:08.930580+0000","last_fullsized":"2024-07-24T16:24:08.930580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931645+0000","last_change":"2024-07-24T16:24:03.424087+0000","last_active":"2024-07-24T16:24:08.931645+0000","last_peered":"2024-07-24T16:24:08.931645+0000","last_clean":"2024-07-24T16:24:08.931645+0000","last_became_active":"2024-07-24T16:24:03.423409+0000","last_became_peered":"2024-07-24T16:24:03.423409+0000","last_unstale":"2024-07-24T16:24:08.931645+0000","last_undegraded":"2024-07-24T16:24:08.931645+0000","last_fullsized":"2024-07-24T16:24:08.931645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663596+0000","last_change":"2024-07-24T16:24:03.418712+0000","last_active":"2024-07-24T16:24:08.663596+0000","last_peered":"2024-07-24T16:24:08.663596+0000","last_clean":"2024-07-24T16:24:08.663596+0000","last_became_active":"2024-07-24T16:24:03.418419+0000","last_became_peered":"2024-07-24T16:24:03.418419+0000","last_unstale":"2024-07-24T16:24:08.663596+0000","last_undegraded":"2024-07-24T16:24:08.663596+0000","last_fullsized":"2024-07-24T16:24:08.663596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441633+0000","last_change":"2024-07-24T16:24:03.418720+0000","last_active":"2024-07-24T16:24:08.441633+0000","last_peered":"2024-07-24T16:24:08.441633+0000","last_clean":"2024-07-24T16:24:08.441633+0000","last_became_active":"2024-07-24T16:24:03.418318+0000","last_became_peered":"2024-07-24T16:24:03.418318+0000","last_unstale":"2024-07-24T16:24:08.441633+0000","last_undegraded":"2024-07-24T16:24:08.441633+0000","last_fullsized":"2024-07-24T16:24:08.441633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:11.929285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662844+0000","last_change":"2024-07-24T16:24:03.418662+0000","last_active":"2024-07-24T16:24:08.662844+0000","last_peered":"2024-07-24T16:24:08.662844+0000","last_clean":"2024-07-24T16:24:08.662844+0000","last_became_active":"2024-07-24T16:24:03.418378+0000","last_became_peered":"2024-07-24T16:24:03.418378+0000","last_unstale":"2024-07-24T16:24:08.662844+0000","last_undegraded":"2024-07-24T16:24:08.662844+0000","last_fullsized":"2024-07-24T16:24:08.662844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441710+0000","last_change":"2024-07-24T16:24:03.418038+0000","last_active":"2024-07-24T16:24:08.441710+0000","last_peered":"2024-07-24T16:24:08.441710+0000","last_clean":"2024-07-24T16:24:08.441710+0000","last_became_active":"2024-07-24T16:24:03.417007+0000","last_became_peered":"2024-07-24T16:24:03.417007+0000","last_unstale":"2024-07-24T16:24:08.441710+0000","last_undegraded":"2024-07-24T16:24:08.441710+0000","last_fullsized":"2024-07-24T16:24:08.441710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:42.549780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441338+0000","last_change":"2024-07-24T16:24:03.431911+0000","last_active":"2024-07-24T16:24:08.441338+0000","last_peered":"2024-07-24T16:24:08.441338+0000","last_clean":"2024-07-24T16:24:08.441338+0000","last_became_active":"2024-07-24T16:24:03.431609+0000","last_became_peered":"2024-07-24T16:24:03.431609+0000","last_unstale":"2024-07-24T16:24:08.441338+0000","last_undegraded":"2024-07-24T16:24:08.441338+0000","last_fullsized":"2024-07-24T16:24:08.441338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:48:51.593685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931556+0000","last_change":"2024-07-24T16:24:03.421743+0000","last_active":"2024-07-24T16:24:08.931556+0000","last_peered":"2024-07-24T16:24:08.931556+0000","last_clean":"2024-07-24T16:24:08.931556+0000","last_became_active":"2024-07-24T16:24:03.419448+0000","last_became_peered":"2024-07-24T16:24:03.419448+0000","last_unstale":"2024-07-24T16:24:08.931556+0000","last_undegraded":"2024-07-24T16:24:08.931556+0000","last_fullsized":"2024-07-24T16:24:08.931556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932230+0000","last_change":"2024-07-24T16:24:03.426083+0000","last_active":"2024-07-24T16:24:08.932230+0000","last_peered":"2024-07-24T16:24:08.932230+0000","last_clean":"2024-07-24T16:24:08.932230+0000","last_became_active":"2024-07-24T16:24:03.425305+0000","last_became_peered":"2024-07-24T16:24:03.425305+0000","last_unstale":"2024-07-24T16:24:08.932230+0000","last_undegraded":"2024-07-24T16:24:08.932230+0000","last_fullsized":"2024-07-24T16:24:08.932230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:37.250366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440125+0000","last_change":"2024-07-24T16:24:03.414343+0000","last_active":"2024-07-24T16:24:08.440125+0000","last_peered":"2024-07-24T16:24:08.440125+0000","last_clean":"2024-07-24T16:24:08.440125+0000","last_became_active":"2024-07-24T16:24:03.414057+0000","last_became_peered":"2024-07-24T16:24:03.414057+0000","last_unstale":"2024-07-24T16:24:08.440125+0000","last_undegraded":"2024-07-24T16:24:08.440125+0000","last_fullsized":"2024-07-24T16:24:08.440125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:45:49.295282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442181+0000","last_change":"2024-07-24T16:24:03.420932+0000","last_active":"2024-07-24T16:24:08.442181+0000","last_peered":"2024-07-24T16:24:08.442181+0000","last_clean":"2024-07-24T16:24:08.442181+0000","last_became_active":"2024-07-24T16:24:03.420642+0000","last_became_peered":"2024-07-24T16:24:03.420642+0000","last_unstale":"2024-07-24T16:24:08.442181+0000","last_undegraded":"2024-07-24T16:24:08.442181+0000","last_fullsized":"2024-07-24T16:24:08.442181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441303+0000","last_change":"2024-07-24T16:24:03.425237+0000","last_active":"2024-07-24T16:24:08.441303+0000","last_peered":"2024-07-24T16:24:08.441303+0000","last_clean":"2024-07-24T16:24:08.441303+0000","last_became_active":"2024-07-24T16:24:03.424915+0000","last_became_peered":"2024-07-24T16:24:03.424915+0000","last_unstale":"2024-07-24T16:24:08.441303+0000","last_undegraded":"2024-07-24T16:24:08.441303+0000","last_fullsized":"2024-07-24T16:24:08.441303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930172+0000","last_change":"2024-07-24T16:24:03.404488+0000","last_active":"2024-07-24T16:24:08.930172+0000","last_peered":"2024-07-24T16:24:08.930172+0000","last_clean":"2024-07-24T16:24:08.930172+0000","last_became_active":"2024-07-24T16:24:03.404145+0000","last_became_peered":"2024-07-24T16:24:03.404145+0000","last_unstale":"2024-07-24T16:24:08.930172+0000","last_undegraded":"2024-07-24T16:24:08.930172+0000","last_fullsized":"2024-07-24T16:24:08.930172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441452+0000","last_change":"2024-07-24T16:24:03.421865+0000","last_active":"2024-07-24T16:24:08.441452+0000","last_peered":"2024-07-24T16:24:08.441452+0000","last_clean":"2024-07-24T16:24:08.441452+0000","last_became_active":"2024-07-24T16:24:03.421569+0000","last_became_peered":"2024-07-24T16:24:03.421569+0000","last_unstale":"2024-07-24T16:24:08.441452+0000","last_undegraded":"2024-07-24T16:24:08.441452+0000","last_fullsized":"2024-07-24T16:24:08.441452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663120+0000","last_change":"2024-07-24T16:24:03.414078+0000","last_active":"2024-07-24T16:24:08.663120+0000","last_peered":"2024-07-24T16:24:08.663120+0000","last_clean":"2024-07-24T16:24:08.663120+0000","last_became_active":"2024-07-24T16:24:03.413790+0000","last_became_peered":"2024-07-24T16:24:03.413790+0000","last_unstale":"2024-07-24T16:24:08.663120+0000","last_undegraded":"2024-07-24T16:24:08.663120+0000","last_fullsized":"2024-07-24T16:24:08.663120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:05.808945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760147+0000","last_change":"2024-07-24T16:24:03.415097+0000","last_active":"2024-07-24T16:24:08.760147+0000","last_peered":"2024-07-24T16:24:08.760147+0000","last_clean":"2024-07-24T16:24:08.760147+0000","last_became_active":"2024-07-24T16:24:03.413714+0000","last_became_peered":"2024-07-24T16:24:03.413714+0000","last_unstale":"2024-07-24T16:24:08.760147+0000","last_undegraded":"2024-07-24T16:24:08.760147+0000","last_fullsized":"2024-07-24T16:24:08.760147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:35:31.460220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931494+0000","last_change":"2024-07-24T16:24:03.414407+0000","last_active":"2024-07-24T16:24:08.931494+0000","last_peered":"2024-07-24T16:24:08.931494+0000","last_clean":"2024-07-24T16:24:08.931494+0000","last_became_active":"2024-07-24T16:24:03.414130+0000","last_became_peered":"2024-07-24T16:24:03.414130+0000","last_unstale":"2024-07-24T16:24:08.931494+0000","last_undegraded":"2024-07-24T16:24:08.931494+0000","last_fullsized":"2024-07-24T16:24:08.931494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931527+0000","last_change":"2024-07-24T16:24:03.423751+0000","last_active":"2024-07-24T16:24:08.931527+0000","last_peered":"2024-07-24T16:24:08.931527+0000","last_clean":"2024-07-24T16:24:08.931527+0000","last_became_active":"2024-07-24T16:24:03.423474+0000","last_became_peered":"2024-07-24T16:24:03.423474+0000","last_unstale":"2024-07-24T16:24:08.931527+0000","last_undegraded":"2024-07-24T16:24:08.931527+0000","last_fullsized":"2024-07-24T16:24:08.931527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932077+0000","last_change":"2024-07-24T16:24:03.427935+0000","last_active":"2024-07-24T16:24:08.932077+0000","last_peered":"2024-07-24T16:24:08.932077+0000","last_clean":"2024-07-24T16:24:08.932077+0000","last_became_active":"2024-07-24T16:24:03.427533+0000","last_became_peered":"2024-07-24T16:24:03.427533+0000","last_unstale":"2024-07-24T16:24:08.932077+0000","last_undegraded":"2024-07-24T16:24:08.932077+0000","last_fullsized":"2024-07-24T16:24:08.932077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:37.605337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662710+0000","last_change":"2024-07-24T16:24:03.426562+0000","last_active":"2024-07-24T16:24:08.662710+0000","last_peered":"2024-07-24T16:24:08.662710+0000","last_clean":"2024-07-24T16:24:08.662710+0000","last_became_active":"2024-07-24T16:24:03.426289+0000","last_became_peered":"2024-07-24T16:24:03.426289+0000","last_unstale":"2024-07-24T16:24:08.662710+0000","last_undegraded":"2024-07-24T16:24:08.662710+0000","last_fullsized":"2024-07-24T16:24:08.662710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930924+0000","last_change":"2024-07-24T16:24:03.425133+0000","last_active":"2024-07-24T16:24:08.930924+0000","last_peered":"2024-07-24T16:24:08.930924+0000","last_clean":"2024-07-24T16:24:08.930924+0000","last_became_active":"2024-07-24T16:24:03.424694+0000","last_became_peered":"2024-07-24T16:24:03.424694+0000","last_unstale":"2024-07-24T16:24:08.930924+0000","last_undegraded":"2024-07-24T16:24:08.930924+0000","last_fullsized":"2024-07-24T16:24:08.930924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:05.808945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441560+0000","last_change":"2024-07-24T16:24:03.424756+0000","last_active":"2024-07-24T16:24:08.441560+0000","last_peered":"2024-07-24T16:24:08.441560+0000","last_clean":"2024-07-24T16:24:08.441560+0000","last_became_active":"2024-07-24T16:24:03.424496+0000","last_became_peered":"2024-07-24T16:24:03.424496+0000","last_unstale":"2024-07-24T16:24:08.441560+0000","last_undegraded":"2024-07-24T16:24:08.441560+0000","last_fullsized":"2024-07-24T16:24:08.441560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:25.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931259+0000","last_change":"2024-07-24T16:24:03.424754+0000","last_active":"2024-07-24T16:24:08.931259+0000","last_peered":"2024-07-24T16:24:08.931259+0000","last_clean":"2024-07-24T16:24:08.931259+0000","last_became_active":"2024-07-24T16:24:03.421220+0000","last_became_peered":"2024-07-24T16:24:03.421220+0000","last_unstale":"2024-07-24T16:24:08.931259+0000","last_undegraded":"2024-07-24T16:24:08.931259+0000","last_fullsized":"2024-07-24T16:24:08.931259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:01.499631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441829+0000","last_change":"2024-07-24T16:24:03.419695+0000","last_active":"2024-07-24T16:24:08.441829+0000","last_peered":"2024-07-24T16:24:08.441829+0000","last_clean":"2024-07-24T16:24:08.441829+0000","last_became_active":"2024-07-24T16:24:03.416727+0000","last_became_peered":"2024-07-24T16:24:03.416727+0000","last_unstale":"2024-07-24T16:24:08.441829+0000","last_undegraded":"2024-07-24T16:24:08.441829+0000","last_fullsized":"2024-07-24T16:24:08.441829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:33:56.923986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441260+0000","last_change":"2024-07-24T16:24:03.422051+0000","last_active":"2024-07-24T16:24:08.441260+0000","last_peered":"2024-07-24T16:24:08.441260+0000","last_clean":"2024-07-24T16:24:08.441260+0000","last_became_active":"2024-07-24T16:24:03.421771+0000","last_became_peered":"2024-07-24T16:24:03.421771+0000","last_unstale":"2024-07-24T16:24:08.441260+0000","last_undegraded":"2024-07-24T16:24:08.441260+0000","last_fullsized":"2024-07-24T16:24:08.441260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:07:14.015059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930778+0000","last_change":"2024-07-24T16:24:03.419502+0000","last_active":"2024-07-24T16:24:08.930778+0000","last_peered":"2024-07-24T16:24:08.930778+0000","last_clean":"2024-07-24T16:24:08.930778+0000","last_became_active":"2024-07-24T16:24:03.419206+0000","last_became_peered":"2024-07-24T16:24:03.419206+0000","last_unstale":"2024-07-24T16:24:08.930778+0000","last_undegraded":"2024-07-24T16:24:08.930778+0000","last_fullsized":"2024-07-24T16:24:08.930778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931978+0000","last_change":"2024-07-24T16:24:03.419857+0000","last_active":"2024-07-24T16:24:08.931978+0000","last_peered":"2024-07-24T16:24:08.931978+0000","last_clean":"2024-07-24T16:24:08.931978+0000","last_became_active":"2024-07-24T16:24:03.419599+0000","last_became_peered":"2024-07-24T16:24:03.419599+0000","last_unstale":"2024-07-24T16:24:08.931978+0000","last_undegraded":"2024-07-24T16:24:08.931978+0000","last_fullsized":"2024-07-24T16:24:08.931978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:42.549780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:24:28.232 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:24:28.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.368+0000 7fe46f5a2640 1 -- 172.21.15.159:0/1832193304 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe4680cf770 msgr2=0x7fe46815b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.368+0000 7fe46f5a2640 1 --2- 172.21.15.159:0/1832193304 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe4680cf770 0x7fe46815b4b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe464009860 tx=0x7fe46402a5a0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.368+0000 7fe46f5a2640 1 -- 172.21.15.159:0/1832193304 shutdown_connections 2024-07-24T16:24:28.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.368+0000 7fe46f5a2640 1 --2- 172.21.15.159:0/1832193304 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe4680cf770 0x7fe46815b4b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.368+0000 7fe46f5a2640 1 -- 172.21.15.159:0/1832193304 >> 172.21.15.159:0/1832193304 conn(0x7fe46806c560 msgr2=0x7fe46806c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:28.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.368+0000 7fe46f5a2640 1 -- 172.21.15.159:0/1832193304 shutdown_connections 2024-07-24T16:24:28.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.368+0000 7fe46f5a2640 1 -- 172.21.15.159:0/1832193304 wait complete. 2024-07-24T16:24:28.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.369+0000 7fe46f5a2640 1 Processor -- start 2024-07-24T16:24:28.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.369+0000 7fe46f5a2640 1 -- start start 2024-07-24T16:24:28.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46f5a2640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe46806dba0 0x7fe468154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:28.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46f5a2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680cf770 0x7fe4681f7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:28.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46f5a2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4680cfb50 0x7fe4681594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:28.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46f5a2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe4680cbfa0 con 0x7fe4680cf770 2024-07-24T16:24:28.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46f5a2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe4680cbe20 con 0x7fe4680cfb50 2024-07-24T16:24:28.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46f5a2640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe4680b4120 con 0x7fe46806dba0 2024-07-24T16:24:28.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46cb3d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680cf770 0x7fe4681f7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:28.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46cb3d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680cf770 0x7fe4681f7fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60076/0 (socket says 172.21.15.159:60076) 2024-07-24T16:24:28.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46cb3d640 1 -- 172.21.15.159:0/2607105177 learned_addr learned my addr 172.21.15.159:0/2607105177 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:28.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46d33e640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe46806dba0 0x7fe468154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:28.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46db3f640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4680cfb50 0x7fe4681594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:28.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46cb3d640 1 -- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe46806dba0 msgr2=0x7fe468154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46cb3d640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe46806dba0 0x7fe468154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46cb3d640 1 -- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4680cfb50 msgr2=0x7fe4681594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46cb3d640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4680cfb50 0x7fe4681594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46cb3d640 1 -- 172.21.15.159:0/2607105177 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4681f8510 con 0x7fe4680cf770 2024-07-24T16:24:28.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe46cb3d640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680cf770 0x7fe4681f7fd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe45800c450 tx=0x7fe45800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:28.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.370+0000 7fe45dffb640 1 -- 172.21.15.159:0/2607105177 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4580052d0 con 0x7fe4680cf770 2024-07-24T16:24:28.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.371+0000 7fe46f5a2640 1 -- 172.21.15.159:0/2607105177 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe46813d1f0 con 0x7fe4680cf770 2024-07-24T16:24:28.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.371+0000 7fe45dffb640 1 -- 172.21.15.159:0/2607105177 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe458005490 con 0x7fe4680cf770 2024-07-24T16:24:28.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.371+0000 7fe45dffb640 1 -- 172.21.15.159:0/2607105177 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe458012890 con 0x7fe4680cf770 2024-07-24T16:24:28.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.371+0000 7fe46f5a2640 1 -- 172.21.15.159:0/2607105177 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4680cccb0 con 0x7fe4680cf770 2024-07-24T16:24:28.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.372+0000 7fe46f5a2640 1 -- 172.21.15.159:0/2607105177 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4680aeef0 con 0x7fe4680cf770 2024-07-24T16:24:28.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.372+0000 7fe45dffb640 1 -- 172.21.15.159:0/2607105177 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe458012a30 con 0x7fe4680cf770 2024-07-24T16:24:28.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.372+0000 7fe45dffb640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe44c077010 0x7fe44c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:28.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.373+0000 7fe45dffb640 1 -- 172.21.15.159:0/2607105177 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe4580988c0 con 0x7fe4680cf770 2024-07-24T16:24:28.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.373+0000 7fe46d33e640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe44c077010 0x7fe44c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:28.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.373+0000 7fe46d33e640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe44c077010 0x7fe44c0794d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe464034000 tx=0x7fe464004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:28.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.377+0000 7fe45dffb640 1 -- 172.21.15.159:0/2607105177 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fe4681f8510 con 0x7fe4680cf770 2024-07-24T16:24:28.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.557+0000 7fe46f5a2640 1 -- 172.21.15.159:0/2607105177 --> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe468154a30 con 0x7fe44c077010 2024-07-24T16:24:28.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.562+0000 7fe45dffb640 1 -- 172.21.15.159:0/2607105177 <== mgr.4103 v2:172.21.15.193:6832/222319347 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332520 (secure 0 0 0) 0x7fe468154a30 con 0x7fe44c077010 2024-07-24T16:24:28.568 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:28.570 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:24:28.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.566+0000 7fe46f5a2640 1 -- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe44c077010 msgr2=0x7fe44c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.566+0000 7fe46f5a2640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe44c077010 0x7fe44c0794d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe464034000 tx=0x7fe464004730 comp rx=0 tx=0).stop 2024-07-24T16:24:28.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.566+0000 7fe46f5a2640 1 -- 172.21.15.159:0/2607105177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680cf770 msgr2=0x7fe4681f7fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.566+0000 7fe46f5a2640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680cf770 0x7fe4681f7fd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fe45800c450 tx=0x7fe45800c910 comp rx=0 tx=0).stop 2024-07-24T16:24:28.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.566+0000 7fe46f5a2640 1 -- 172.21.15.159:0/2607105177 shutdown_connections 2024-07-24T16:24:28.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.566+0000 7fe46f5a2640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe44c077010 0x7fe44c0794d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.566+0000 7fe46f5a2640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe4680cfb50 0x7fe4681594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.566+0000 7fe46f5a2640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe4680cf770 0x7fe4681f7fd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.566+0000 7fe46f5a2640 1 --2- 172.21.15.159:0/2607105177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe46806dba0 0x7fe468154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.566+0000 7fe46f5a2640 1 -- 172.21.15.159:0/2607105177 >> 172.21.15.159:0/2607105177 conn(0x7fe46806c560 msgr2=0x7fe468072a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:28.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.566+0000 7fe46f5a2640 1 -- 172.21.15.159:0/2607105177 shutdown_connections 2024-07-24T16:24:28.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.566+0000 7fe46f5a2640 1 -- 172.21.15.159:0/2607105177 wait complete. 2024-07-24T16:24:28.579 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":33,"stamp":"2024-07-24T16:24:28.367610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219380,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755340,"statfs":{"total":773094113280,"available":772869468160,"internally_reserved":0,"allocated":3284992,"data_stored":1988976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003210"},"pg_stats":[{"pgid":"2.1f","version":"19'4","reported_seq":27,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441633+0000","last_change":"2024-07-24T16:24:02.424537+0000","last_active":"2024-07-24T16:24:08.441633+0000","last_peered":"2024-07-24T16:24:08.441633+0000","last_clean":"2024-07-24T16:24:08.441633+0000","last_became_active":"2024-07-24T16:24:02.424271+0000","last_became_peered":"2024-07-24T16:24:02.424271+0000","last_unstale":"2024-07-24T16:24:08.441633+0000","last_undegraded":"2024-07-24T16:24:08.441633+0000","last_fullsized":"2024-07-24T16:24:08.441633+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:39:09.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663338+0000","last_change":"2024-07-24T16:24:03.415815+0000","last_active":"2024-07-24T16:24:08.663338+0000","last_peered":"2024-07-24T16:24:08.663338+0000","last_clean":"2024-07-24T16:24:08.663338+0000","last_became_active":"2024-07-24T16:24:03.415526+0000","last_became_peered":"2024-07-24T16:24:03.415526+0000","last_unstale":"2024-07-24T16:24:08.663338+0000","last_undegraded":"2024-07-24T16:24:08.663338+0000","last_fullsized":"2024-07-24T16:24:08.663338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662707+0000","last_change":"2024-07-24T16:24:07.690761+0000","last_active":"2024-07-24T16:24:08.662707+0000","last_peered":"2024-07-24T16:24:08.662707+0000","last_clean":"2024-07-24T16:24:08.662707+0000","last_became_active":"2024-07-24T16:24:07.690360+0000","last_became_peered":"2024-07-24T16:24:07.690360+0000","last_unstale":"2024-07-24T16:24:08.662707+0000","last_undegraded":"2024-07-24T16:24:08.662707+0000","last_fullsized":"2024-07-24T16:24:08.662707+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:20:33.168439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663491+0000","last_change":"2024-07-24T16:24:02.417793+0000","last_active":"2024-07-24T16:24:08.663491+0000","last_peered":"2024-07-24T16:24:08.663491+0000","last_clean":"2024-07-24T16:24:08.663491+0000","last_became_active":"2024-07-24T16:24:02.417520+0000","last_became_peered":"2024-07-24T16:24:02.417520+0000","last_unstale":"2024-07-24T16:24:08.663491+0000","last_undegraded":"2024-07-24T16:24:08.663491+0000","last_fullsized":"2024-07-24T16:24:08.663491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:39:09.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441465+0000","last_change":"2024-07-24T16:24:03.431760+0000","last_active":"2024-07-24T16:24:08.441465+0000","last_peered":"2024-07-24T16:24:08.441465+0000","last_clean":"2024-07-24T16:24:08.441465+0000","last_became_active":"2024-07-24T16:24:03.431479+0000","last_became_peered":"2024-07-24T16:24:03.431479+0000","last_unstale":"2024-07-24T16:24:08.441465+0000","last_undegraded":"2024-07-24T16:24:08.441465+0000","last_fullsized":"2024-07-24T16:24:08.441465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:30:43.693386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759610+0000","last_change":"2024-07-24T16:24:07.447841+0000","last_active":"2024-07-24T16:24:08.759610+0000","last_peered":"2024-07-24T16:24:08.759610+0000","last_clean":"2024-07-24T16:24:08.759610+0000","last_became_active":"2024-07-24T16:24:07.446215+0000","last_became_peered":"2024-07-24T16:24:07.446215+0000","last_unstale":"2024-07-24T16:24:08.759610+0000","last_undegraded":"2024-07-24T16:24:08.759610+0000","last_fullsized":"2024-07-24T16:24:08.759610+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:09.837609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932112+0000","last_change":"2024-07-24T16:24:02.427356+0000","last_active":"2024-07-24T16:24:08.932112+0000","last_peered":"2024-07-24T16:24:08.932112+0000","last_clean":"2024-07-24T16:24:08.932112+0000","last_became_active":"2024-07-24T16:24:02.426961+0000","last_became_peered":"2024-07-24T16:24:02.426961+0000","last_unstale":"2024-07-24T16:24:08.932112+0000","last_undegraded":"2024-07-24T16:24:08.932112+0000","last_fullsized":"2024-07-24T16:24:08.932112+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:45:48.251916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441858+0000","last_change":"2024-07-24T16:24:03.410957+0000","last_active":"2024-07-24T16:24:08.441858+0000","last_peered":"2024-07-24T16:24:08.441858+0000","last_clean":"2024-07-24T16:24:08.441858+0000","last_became_active":"2024-07-24T16:24:03.410678+0000","last_became_peered":"2024-07-24T16:24:03.410678+0000","last_unstale":"2024-07-24T16:24:08.441858+0000","last_undegraded":"2024-07-24T16:24:08.441858+0000","last_fullsized":"2024-07-24T16:24:08.441858+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:32:56.003382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759927+0000","last_change":"2024-07-24T16:24:07.447764+0000","last_active":"2024-07-24T16:24:08.759927+0000","last_peered":"2024-07-24T16:24:08.759927+0000","last_clean":"2024-07-24T16:24:08.759927+0000","last_became_active":"2024-07-24T16:24:07.446150+0000","last_became_peered":"2024-07-24T16:24:07.446150+0000","last_unstale":"2024-07-24T16:24:08.759927+0000","last_undegraded":"2024-07-24T16:24:08.759927+0000","last_fullsized":"2024-07-24T16:24:08.759927+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:29.138058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931831+0000","last_change":"2024-07-24T16:24:02.427694+0000","last_active":"2024-07-24T16:24:08.931831+0000","last_peered":"2024-07-24T16:24:08.931831+0000","last_clean":"2024-07-24T16:24:08.931831+0000","last_became_active":"2024-07-24T16:24:02.427418+0000","last_became_peered":"2024-07-24T16:24:02.427418+0000","last_unstale":"2024-07-24T16:24:08.931831+0000","last_undegraded":"2024-07-24T16:24:08.931831+0000","last_fullsized":"2024-07-24T16:24:08.931831+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:35:30.416854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442157+0000","last_change":"2024-07-24T16:24:03.411299+0000","last_active":"2024-07-24T16:24:08.442157+0000","last_peered":"2024-07-24T16:24:08.442157+0000","last_clean":"2024-07-24T16:24:08.442157+0000","last_became_active":"2024-07-24T16:24:03.410332+0000","last_became_peered":"2024-07-24T16:24:03.410332+0000","last_unstale":"2024-07-24T16:24:08.442157+0000","last_undegraded":"2024-07-24T16:24:08.442157+0000","last_fullsized":"2024-07-24T16:24:08.442157+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:05.808945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759607+0000","last_change":"2024-07-24T16:24:07.449263+0000","last_active":"2024-07-24T16:24:08.759607+0000","last_peered":"2024-07-24T16:24:08.759607+0000","last_clean":"2024-07-24T16:24:08.759607+0000","last_became_active":"2024-07-24T16:24:07.448686+0000","last_became_peered":"2024-07-24T16:24:07.448686+0000","last_unstale":"2024-07-24T16:24:08.759607+0000","last_undegraded":"2024-07-24T16:24:08.759607+0000","last_fullsized":"2024-07-24T16:24:08.759607+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:05.528295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931074+0000","last_change":"2024-07-24T16:24:03.420544+0000","last_active":"2024-07-24T16:24:08.931074+0000","last_peered":"2024-07-24T16:24:08.931074+0000","last_clean":"2024-07-24T16:24:08.931074+0000","last_became_active":"2024-07-24T16:24:03.419248+0000","last_became_peered":"2024-07-24T16:24:03.419248+0000","last_unstale":"2024-07-24T16:24:08.931074+0000","last_undegraded":"2024-07-24T16:24:08.931074+0000","last_fullsized":"2024-07-24T16:24:08.931074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931758+0000","last_change":"2024-07-24T16:24:02.427241+0000","last_active":"2024-07-24T16:24:08.931758+0000","last_peered":"2024-07-24T16:24:08.931758+0000","last_clean":"2024-07-24T16:24:08.931758+0000","last_became_active":"2024-07-24T16:24:02.426981+0000","last_became_peered":"2024-07-24T16:24:02.426981+0000","last_unstale":"2024-07-24T16:24:08.931758+0000","last_undegraded":"2024-07-24T16:24:08.931758+0000","last_fullsized":"2024-07-24T16:24:08.931758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760170+0000","last_change":"2024-07-24T16:24:07.453666+0000","last_active":"2024-07-24T16:24:08.760170+0000","last_peered":"2024-07-24T16:24:08.760170+0000","last_clean":"2024-07-24T16:24:08.760170+0000","last_became_active":"2024-07-24T16:24:07.453136+0000","last_became_peered":"2024-07-24T16:24:07.453136+0000","last_unstale":"2024-07-24T16:24:08.760170+0000","last_undegraded":"2024-07-24T16:24:08.760170+0000","last_fullsized":"2024-07-24T16:24:08.760170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:25.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663125+0000","last_change":"2024-07-24T16:24:03.419598+0000","last_active":"2024-07-24T16:24:08.663125+0000","last_peered":"2024-07-24T16:24:08.663125+0000","last_clean":"2024-07-24T16:24:08.663125+0000","last_became_active":"2024-07-24T16:24:03.419148+0000","last_became_peered":"2024-07-24T16:24:03.419148+0000","last_unstale":"2024-07-24T16:24:08.663125+0000","last_undegraded":"2024-07-24T16:24:08.663125+0000","last_fullsized":"2024-07-24T16:24:08.663125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:33:56.923986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930432+0000","last_change":"2024-07-24T16:24:02.412753+0000","last_active":"2024-07-24T16:24:08.930432+0000","last_peered":"2024-07-24T16:24:08.930432+0000","last_clean":"2024-07-24T16:24:08.930432+0000","last_became_active":"2024-07-24T16:24:02.412500+0000","last_became_peered":"2024-07-24T16:24:02.412500+0000","last_unstale":"2024-07-24T16:24:08.930432+0000","last_undegraded":"2024-07-24T16:24:08.930432+0000","last_fullsized":"2024-07-24T16:24:08.930432+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759990+0000","last_change":"2024-07-24T16:24:07.447575+0000","last_active":"2024-07-24T16:24:08.759990+0000","last_peered":"2024-07-24T16:24:08.759990+0000","last_clean":"2024-07-24T16:24:08.759990+0000","last_became_active":"2024-07-24T16:24:07.447131+0000","last_became_peered":"2024-07-24T16:24:07.447131+0000","last_unstale":"2024-07-24T16:24:08.759990+0000","last_undegraded":"2024-07-24T16:24:08.759990+0000","last_fullsized":"2024-07-24T16:24:08.759990+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:00.032046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662902+0000","last_change":"2024-07-24T16:24:03.414198+0000","last_active":"2024-07-24T16:24:08.662902+0000","last_peered":"2024-07-24T16:24:08.662902+0000","last_clean":"2024-07-24T16:24:08.662902+0000","last_became_active":"2024-07-24T16:24:03.413765+0000","last_became_peered":"2024-07-24T16:24:03.413765+0000","last_unstale":"2024-07-24T16:24:08.662902+0000","last_undegraded":"2024-07-24T16:24:08.662902+0000","last_fullsized":"2024-07-24T16:24:08.662902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:11.929285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930215+0000","last_change":"2024-07-24T16:24:02.424488+0000","last_active":"2024-07-24T16:24:08.930215+0000","last_peered":"2024-07-24T16:24:08.930215+0000","last_clean":"2024-07-24T16:24:08.930215+0000","last_became_active":"2024-07-24T16:24:02.424175+0000","last_became_peered":"2024-07-24T16:24:02.424175+0000","last_unstale":"2024-07-24T16:24:08.930215+0000","last_undegraded":"2024-07-24T16:24:08.930215+0000","last_fullsized":"2024-07-24T16:24:08.930215+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930944+0000","last_change":"2024-07-24T16:24:07.689275+0000","last_active":"2024-07-24T16:24:08.930944+0000","last_peered":"2024-07-24T16:24:08.930944+0000","last_clean":"2024-07-24T16:24:08.930944+0000","last_became_active":"2024-07-24T16:24:07.688814+0000","last_became_peered":"2024-07-24T16:24:07.688814+0000","last_unstale":"2024-07-24T16:24:08.930944+0000","last_undegraded":"2024-07-24T16:24:08.930944+0000","last_fullsized":"2024-07-24T16:24:08.930944+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:50:06.081975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759861+0000","last_change":"2024-07-24T16:24:03.410501+0000","last_active":"2024-07-24T16:24:08.759861+0000","last_peered":"2024-07-24T16:24:08.759861+0000","last_clean":"2024-07-24T16:24:08.759861+0000","last_became_active":"2024-07-24T16:24:03.410221+0000","last_became_peered":"2024-07-24T16:24:03.410221+0000","last_unstale":"2024-07-24T16:24:08.759861+0000","last_undegraded":"2024-07-24T16:24:08.759861+0000","last_fullsized":"2024-07-24T16:24:08.759861+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:07.509173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930886+0000","last_change":"2024-07-24T16:24:02.424500+0000","last_active":"2024-07-24T16:24:08.930886+0000","last_peered":"2024-07-24T16:24:08.930886+0000","last_clean":"2024-07-24T16:24:08.930886+0000","last_became_active":"2024-07-24T16:24:02.423974+0000","last_became_peered":"2024-07-24T16:24:02.423974+0000","last_unstale":"2024-07-24T16:24:08.930886+0000","last_undegraded":"2024-07-24T16:24:08.930886+0000","last_fullsized":"2024-07-24T16:24:08.930886+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760199+0000","last_change":"2024-07-24T16:24:07.446830+0000","last_active":"2024-07-24T16:24:08.760199+0000","last_peered":"2024-07-24T16:24:08.760199+0000","last_clean":"2024-07-24T16:24:08.760199+0000","last_became_active":"2024-07-24T16:24:07.446412+0000","last_became_peered":"2024-07-24T16:24:07.446412+0000","last_unstale":"2024-07-24T16:24:08.760199+0000","last_undegraded":"2024-07-24T16:24:08.760199+0000","last_fullsized":"2024-07-24T16:24:08.760199+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:46.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441614+0000","last_change":"2024-07-24T16:24:03.418856+0000","last_active":"2024-07-24T16:24:08.441614+0000","last_peered":"2024-07-24T16:24:08.441614+0000","last_clean":"2024-07-24T16:24:08.441614+0000","last_became_active":"2024-07-24T16:24:03.418584+0000","last_became_peered":"2024-07-24T16:24:03.418584+0000","last_unstale":"2024-07-24T16:24:08.441614+0000","last_undegraded":"2024-07-24T16:24:08.441614+0000","last_fullsized":"2024-07-24T16:24:08.441614+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931815+0000","last_change":"2024-07-24T16:24:02.424481+0000","last_active":"2024-07-24T16:24:08.931815+0000","last_peered":"2024-07-24T16:24:08.931815+0000","last_clean":"2024-07-24T16:24:08.931815+0000","last_became_active":"2024-07-24T16:24:02.424223+0000","last_became_peered":"2024-07-24T16:24:02.424223+0000","last_unstale":"2024-07-24T16:24:08.931815+0000","last_undegraded":"2024-07-24T16:24:08.931815+0000","last_fullsized":"2024-07-24T16:24:08.931815+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759577+0000","last_change":"2024-07-24T16:24:07.689438+0000","last_active":"2024-07-24T16:24:08.759577+0000","last_peered":"2024-07-24T16:24:08.759577+0000","last_clean":"2024-07-24T16:24:08.759577+0000","last_became_active":"2024-07-24T16:24:07.689062+0000","last_became_peered":"2024-07-24T16:24:07.689062+0000","last_unstale":"2024-07-24T16:24:08.759577+0000","last_undegraded":"2024-07-24T16:24:08.759577+0000","last_fullsized":"2024-07-24T16:24:08.759577+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:15.957949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663604+0000","last_change":"2024-07-24T16:24:03.420566+0000","last_active":"2024-07-24T16:24:08.663604+0000","last_peered":"2024-07-24T16:24:08.663604+0000","last_clean":"2024-07-24T16:24:08.663604+0000","last_became_active":"2024-07-24T16:24:03.420294+0000","last_became_peered":"2024-07-24T16:24:03.420294+0000","last_unstale":"2024-07-24T16:24:08.663604+0000","last_undegraded":"2024-07-24T16:24:08.663604+0000","last_fullsized":"2024-07-24T16:24:08.663604+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:01.499631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930843+0000","last_change":"2024-07-24T16:24:02.417701+0000","last_active":"2024-07-24T16:24:08.930843+0000","last_peered":"2024-07-24T16:24:08.930843+0000","last_clean":"2024-07-24T16:24:08.930843+0000","last_became_active":"2024-07-24T16:24:02.417387+0000","last_became_peered":"2024-07-24T16:24:02.417387+0000","last_unstale":"2024-07-24T16:24:08.930843+0000","last_undegraded":"2024-07-24T16:24:08.930843+0000","last_fullsized":"2024-07-24T16:24:08.930843+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662631+0000","last_change":"2024-07-24T16:24:07.692448+0000","last_active":"2024-07-24T16:24:08.662631+0000","last_peered":"2024-07-24T16:24:08.662631+0000","last_clean":"2024-07-24T16:24:08.662631+0000","last_became_active":"2024-07-24T16:24:07.691926+0000","last_became_peered":"2024-07-24T16:24:07.691926+0000","last_unstale":"2024-07-24T16:24:08.662631+0000","last_undegraded":"2024-07-24T16:24:08.662631+0000","last_fullsized":"2024-07-24T16:24:08.662631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:53:01.459934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930611+0000","last_change":"2024-07-24T16:24:03.407657+0000","last_active":"2024-07-24T16:24:08.930611+0000","last_peered":"2024-07-24T16:24:08.930611+0000","last_clean":"2024-07-24T16:24:08.930611+0000","last_became_active":"2024-07-24T16:24:03.407207+0000","last_became_peered":"2024-07-24T16:24:03.407207+0000","last_unstale":"2024-07-24T16:24:08.930611+0000","last_undegraded":"2024-07-24T16:24:08.930611+0000","last_fullsized":"2024-07-24T16:24:08.930611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932275+0000","last_change":"2024-07-24T16:24:02.424314+0000","last_active":"2024-07-24T16:24:08.932275+0000","last_peered":"2024-07-24T16:24:08.932275+0000","last_clean":"2024-07-24T16:24:08.932275+0000","last_became_active":"2024-07-24T16:24:02.424058+0000","last_became_peered":"2024-07-24T16:24:02.424058+0000","last_unstale":"2024-07-24T16:24:08.932275+0000","last_undegraded":"2024-07-24T16:24:08.932275+0000","last_fullsized":"2024-07-24T16:24:08.932275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:56:35.089759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441392+0000","last_change":"2024-07-24T16:24:07.689455+0000","last_active":"2024-07-24T16:24:08.441392+0000","last_peered":"2024-07-24T16:24:08.441392+0000","last_clean":"2024-07-24T16:24:08.441392+0000","last_became_active":"2024-07-24T16:24:07.689096+0000","last_became_peered":"2024-07-24T16:24:07.689096+0000","last_unstale":"2024-07-24T16:24:08.441392+0000","last_undegraded":"2024-07-24T16:24:08.441392+0000","last_fullsized":"2024-07-24T16:24:08.441392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:46.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442272+0000","last_change":"2024-07-24T16:24:03.418605+0000","last_active":"2024-07-24T16:24:08.442272+0000","last_peered":"2024-07-24T16:24:08.442272+0000","last_clean":"2024-07-24T16:24:08.442272+0000","last_became_active":"2024-07-24T16:24:03.417882+0000","last_became_peered":"2024-07-24T16:24:03.417882+0000","last_unstale":"2024-07-24T16:24:08.442272+0000","last_undegraded":"2024-07-24T16:24:08.442272+0000","last_fullsized":"2024-07-24T16:24:08.442272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:01.499631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930686+0000","last_change":"2024-07-24T16:24:02.414441+0000","last_active":"2024-07-24T16:24:08.930686+0000","last_peered":"2024-07-24T16:24:08.930686+0000","last_clean":"2024-07-24T16:24:08.930686+0000","last_became_active":"2024-07-24T16:24:02.414195+0000","last_became_peered":"2024-07-24T16:24:02.414195+0000","last_unstale":"2024-07-24T16:24:08.930686+0000","last_undegraded":"2024-07-24T16:24:08.930686+0000","last_fullsized":"2024-07-24T16:24:08.930686+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:11:26.148830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930197+0000","last_change":"2024-07-24T16:24:07.456656+0000","last_active":"2024-07-24T16:24:08.930197+0000","last_peered":"2024-07-24T16:24:08.930197+0000","last_clean":"2024-07-24T16:24:08.930197+0000","last_became_active":"2024-07-24T16:24:07.456253+0000","last_became_peered":"2024-07-24T16:24:07.456253+0000","last_unstale":"2024-07-24T16:24:08.930197+0000","last_undegraded":"2024-07-24T16:24:08.930197+0000","last_fullsized":"2024-07-24T16:24:08.930197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:46.578444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760097+0000","last_change":"2024-07-24T16:24:03.419761+0000","last_active":"2024-07-24T16:24:08.760097+0000","last_peered":"2024-07-24T16:24:08.760097+0000","last_clean":"2024-07-24T16:24:08.760097+0000","last_became_active":"2024-07-24T16:24:03.419479+0000","last_became_peered":"2024-07-24T16:24:03.419479+0000","last_unstale":"2024-07-24T16:24:08.760097+0000","last_undegraded":"2024-07-24T16:24:08.760097+0000","last_fullsized":"2024-07-24T16:24:08.760097+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:45:49.295282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442191+0000","last_change":"2024-07-24T16:24:02.414549+0000","last_active":"2024-07-24T16:24:08.442191+0000","last_peered":"2024-07-24T16:24:08.442191+0000","last_clean":"2024-07-24T16:24:08.442191+0000","last_became_active":"2024-07-24T16:24:02.414271+0000","last_became_peered":"2024-07-24T16:24:02.414271+0000","last_unstale":"2024-07-24T16:24:08.442191+0000","last_undegraded":"2024-07-24T16:24:08.442191+0000","last_fullsized":"2024-07-24T16:24:08.442191+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:16.099812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930578+0000","last_change":"2024-07-24T16:24:07.446913+0000","last_active":"2024-07-24T16:24:08.930578+0000","last_peered":"2024-07-24T16:24:08.930578+0000","last_clean":"2024-07-24T16:24:08.930578+0000","last_became_active":"2024-07-24T16:24:07.446002+0000","last_became_peered":"2024-07-24T16:24:07.446002+0000","last_unstale":"2024-07-24T16:24:08.930578+0000","last_undegraded":"2024-07-24T16:24:08.930578+0000","last_fullsized":"2024-07-24T16:24:08.930578+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:41.634001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930229+0000","last_change":"2024-07-24T16:24:03.406743+0000","last_active":"2024-07-24T16:24:08.930229+0000","last_peered":"2024-07-24T16:24:08.930229+0000","last_clean":"2024-07-24T16:24:08.930229+0000","last_became_active":"2024-07-24T16:24:03.406481+0000","last_became_peered":"2024-07-24T16:24:03.406481+0000","last_unstale":"2024-07-24T16:24:08.930229+0000","last_undegraded":"2024-07-24T16:24:08.930229+0000","last_fullsized":"2024-07-24T16:24:08.930229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.439757+0000","last_change":"2024-07-24T16:24:02.412920+0000","last_active":"2024-07-24T16:24:08.439757+0000","last_peered":"2024-07-24T16:24:08.439757+0000","last_clean":"2024-07-24T16:24:08.439757+0000","last_became_active":"2024-07-24T16:24:02.412548+0000","last_became_peered":"2024-07-24T16:24:02.412548+0000","last_unstale":"2024-07-24T16:24:08.439757+0000","last_undegraded":"2024-07-24T16:24:08.439757+0000","last_fullsized":"2024-07-24T16:24:08.439757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930950+0000","last_change":"2024-07-24T16:24:07.456001+0000","last_active":"2024-07-24T16:24:08.930950+0000","last_peered":"2024-07-24T16:24:08.930950+0000","last_clean":"2024-07-24T16:24:08.930950+0000","last_became_active":"2024-07-24T16:24:07.455608+0000","last_became_peered":"2024-07-24T16:24:07.455608+0000","last_unstale":"2024-07-24T16:24:08.930950+0000","last_undegraded":"2024-07-24T16:24:08.930950+0000","last_fullsized":"2024-07-24T16:24:08.930950+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:48:55.180884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441022+0000","last_change":"2024-07-24T16:24:03.421468+0000","last_active":"2024-07-24T16:24:08.441022+0000","last_peered":"2024-07-24T16:24:08.441022+0000","last_clean":"2024-07-24T16:24:08.441022+0000","last_became_active":"2024-07-24T16:24:03.420885+0000","last_became_peered":"2024-07-24T16:24:03.420885+0000","last_unstale":"2024-07-24T16:24:08.441022+0000","last_undegraded":"2024-07-24T16:24:08.441022+0000","last_fullsized":"2024-07-24T16:24:08.441022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930925+0000","last_change":"2024-07-24T16:24:02.424655+0000","last_active":"2024-07-24T16:24:08.930925+0000","last_peered":"2024-07-24T16:24:08.930925+0000","last_clean":"2024-07-24T16:24:08.930925+0000","last_became_active":"2024-07-24T16:24:02.424258+0000","last_became_peered":"2024-07-24T16:24:02.424258+0000","last_unstale":"2024-07-24T16:24:08.930925+0000","last_undegraded":"2024-07-24T16:24:08.930925+0000","last_fullsized":"2024-07-24T16:24:08.930925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441444+0000","last_change":"2024-07-24T16:24:07.689063+0000","last_active":"2024-07-24T16:24:08.441444+0000","last_peered":"2024-07-24T16:24:08.441444+0000","last_clean":"2024-07-24T16:24:08.441444+0000","last_became_active":"2024-07-24T16:24:07.688668+0000","last_became_peered":"2024-07-24T16:24:07.688668+0000","last_unstale":"2024-07-24T16:24:08.441444+0000","last_undegraded":"2024-07-24T16:24:08.441444+0000","last_fullsized":"2024-07-24T16:24:08.441444+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:41.279030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663032+0000","last_change":"2024-07-24T16:24:03.414611+0000","last_active":"2024-07-24T16:24:08.663032+0000","last_peered":"2024-07-24T16:24:08.663032+0000","last_clean":"2024-07-24T16:24:08.663032+0000","last_became_active":"2024-07-24T16:24:03.414234+0000","last_became_peered":"2024-07-24T16:24:03.414234+0000","last_unstale":"2024-07-24T16:24:08.663032+0000","last_undegraded":"2024-07-24T16:24:08.663032+0000","last_fullsized":"2024-07-24T16:24:08.663032+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442285+0000","last_change":"2024-07-24T16:24:02.413921+0000","last_active":"2024-07-24T16:24:08.442285+0000","last_peered":"2024-07-24T16:24:08.442285+0000","last_clean":"2024-07-24T16:24:08.442285+0000","last_became_active":"2024-07-24T16:24:02.413460+0000","last_became_peered":"2024-07-24T16:24:02.413460+0000","last_unstale":"2024-07-24T16:24:08.442285+0000","last_undegraded":"2024-07-24T16:24:08.442285+0000","last_fullsized":"2024-07-24T16:24:08.442285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":117,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930636+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:24:08.930636+0000","last_peered":"2024-07-24T16:24:08.930636+0000","last_clean":"2024-07-24T16:24:08.930636+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:24:08.930636+0000","last_undegraded":"2024-07-24T16:24:08.930636+0000","last_fullsized":"2024-07-24T16:24:08.930636+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931362+0000","last_change":"2024-07-24T16:24:07.691109+0000","last_active":"2024-07-24T16:24:08.931362+0000","last_peered":"2024-07-24T16:24:08.931362+0000","last_clean":"2024-07-24T16:24:08.931362+0000","last_became_active":"2024-07-24T16:24:07.690690+0000","last_became_peered":"2024-07-24T16:24:07.690690+0000","last_unstale":"2024-07-24T16:24:08.931362+0000","last_undegraded":"2024-07-24T16:24:08.931362+0000","last_fullsized":"2024-07-24T16:24:08.931362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:00.032046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931993+0000","last_change":"2024-07-24T16:24:03.425855+0000","last_active":"2024-07-24T16:24:08.931993+0000","last_peered":"2024-07-24T16:24:08.931993+0000","last_clean":"2024-07-24T16:24:08.931993+0000","last_became_active":"2024-07-24T16:24:03.425039+0000","last_became_peered":"2024-07-24T16:24:03.425039+0000","last_unstale":"2024-07-24T16:24:08.931993+0000","last_undegraded":"2024-07-24T16:24:08.931993+0000","last_fullsized":"2024-07-24T16:24:08.931993+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:32:56.003382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440339+0000","last_change":"2024-07-24T16:24:02.419130+0000","last_active":"2024-07-24T16:24:08.440339+0000","last_peered":"2024-07-24T16:24:08.440339+0000","last_clean":"2024-07-24T16:24:08.440339+0000","last_became_active":"2024-07-24T16:24:02.418877+0000","last_became_peered":"2024-07-24T16:24:02.418877+0000","last_unstale":"2024-07-24T16:24:08.440339+0000","last_undegraded":"2024-07-24T16:24:08.440339+0000","last_fullsized":"2024-07-24T16:24:08.440339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:11:26.148830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931126+0000","last_change":"2024-07-24T16:24:07.689387+0000","last_active":"2024-07-24T16:24:08.931126+0000","last_peered":"2024-07-24T16:24:08.931126+0000","last_clean":"2024-07-24T16:24:08.931126+0000","last_became_active":"2024-07-24T16:24:07.688861+0000","last_became_peered":"2024-07-24T16:24:07.688861+0000","last_unstale":"2024-07-24T16:24:08.931126+0000","last_undegraded":"2024-07-24T16:24:08.931126+0000","last_fullsized":"2024-07-24T16:24:08.931126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:29.138058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442010+0000","last_change":"2024-07-24T16:24:03.414560+0000","last_active":"2024-07-24T16:24:08.442010+0000","last_peered":"2024-07-24T16:24:08.442010+0000","last_clean":"2024-07-24T16:24:08.442010+0000","last_became_active":"2024-07-24T16:24:03.414244+0000","last_became_peered":"2024-07-24T16:24:03.414244+0000","last_unstale":"2024-07-24T16:24:08.442010+0000","last_undegraded":"2024-07-24T16:24:08.442010+0000","last_fullsized":"2024-07-24T16:24:08.442010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:21.258885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930741+0000","last_change":"2024-07-24T16:24:02.414255+0000","last_active":"2024-07-24T16:24:08.930741+0000","last_peered":"2024-07-24T16:24:08.930741+0000","last_clean":"2024-07-24T16:24:08.930741+0000","last_became_active":"2024-07-24T16:24:02.413982+0000","last_became_peered":"2024-07-24T16:24:02.413982+0000","last_unstale":"2024-07-24T16:24:08.930741+0000","last_undegraded":"2024-07-24T16:24:08.930741+0000","last_fullsized":"2024-07-24T16:24:08.930741+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441533+0000","last_change":"2024-07-24T16:24:07.450463+0000","last_active":"2024-07-24T16:24:08.441533+0000","last_peered":"2024-07-24T16:24:08.441533+0000","last_clean":"2024-07-24T16:24:08.441533+0000","last_became_active":"2024-07-24T16:24:07.449717+0000","last_became_peered":"2024-07-24T16:24:07.449717+0000","last_unstale":"2024-07-24T16:24:08.441533+0000","last_undegraded":"2024-07-24T16:24:08.441533+0000","last_fullsized":"2024-07-24T16:24:08.441533+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:41.634001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932150+0000","last_change":"2024-07-24T16:24:03.421244+0000","last_active":"2024-07-24T16:24:08.932150+0000","last_peered":"2024-07-24T16:24:08.932150+0000","last_clean":"2024-07-24T16:24:08.932150+0000","last_became_active":"2024-07-24T16:24:03.420900+0000","last_became_peered":"2024-07-24T16:24:03.420900+0000","last_unstale":"2024-07-24T16:24:08.932150+0000","last_undegraded":"2024-07-24T16:24:08.932150+0000","last_fullsized":"2024-07-24T16:24:08.932150+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:48:51.152220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440222+0000","last_change":"2024-07-24T16:24:02.413448+0000","last_active":"2024-07-24T16:24:08.440222+0000","last_peered":"2024-07-24T16:24:08.440222+0000","last_clean":"2024-07-24T16:24:08.440222+0000","last_became_active":"2024-07-24T16:24:02.412569+0000","last_became_peered":"2024-07-24T16:24:02.412569+0000","last_unstale":"2024-07-24T16:24:08.440222+0000","last_undegraded":"2024-07-24T16:24:08.440222+0000","last_fullsized":"2024-07-24T16:24:08.440222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441408+0000","last_change":"2024-07-24T16:24:07.689773+0000","last_active":"2024-07-24T16:24:08.441408+0000","last_peered":"2024-07-24T16:24:08.441408+0000","last_clean":"2024-07-24T16:24:08.441408+0000","last_became_active":"2024-07-24T16:24:07.689367+0000","last_became_peered":"2024-07-24T16:24:07.689367+0000","last_unstale":"2024-07-24T16:24:08.441408+0000","last_undegraded":"2024-07-24T16:24:08.441408+0000","last_fullsized":"2024-07-24T16:24:08.441408+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:53:01.459934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932045+0000","last_change":"2024-07-24T16:24:03.420569+0000","last_active":"2024-07-24T16:24:08.932045+0000","last_peered":"2024-07-24T16:24:08.932045+0000","last_clean":"2024-07-24T16:24:08.932045+0000","last_became_active":"2024-07-24T16:24:03.420253+0000","last_became_peered":"2024-07-24T16:24:03.420253+0000","last_unstale":"2024-07-24T16:24:08.932045+0000","last_undegraded":"2024-07-24T16:24:08.932045+0000","last_fullsized":"2024-07-24T16:24:08.932045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:21.258885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760346+0000","last_change":"2024-07-24T16:24:02.417860+0000","last_active":"2024-07-24T16:24:08.760346+0000","last_peered":"2024-07-24T16:24:08.760346+0000","last_clean":"2024-07-24T16:24:08.760346+0000","last_became_active":"2024-07-24T16:24:02.417610+0000","last_became_peered":"2024-07-24T16:24:02.417610+0000","last_unstale":"2024-07-24T16:24:08.760346+0000","last_undegraded":"2024-07-24T16:24:08.760346+0000","last_fullsized":"2024-07-24T16:24:08.760346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:34:17.692339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759523+0000","last_change":"2024-07-24T16:24:07.447096+0000","last_active":"2024-07-24T16:24:08.759523+0000","last_peered":"2024-07-24T16:24:08.759523+0000","last_clean":"2024-07-24T16:24:08.759523+0000","last_became_active":"2024-07-24T16:24:07.446606+0000","last_became_peered":"2024-07-24T16:24:07.446606+0000","last_unstale":"2024-07-24T16:24:08.759523+0000","last_undegraded":"2024-07-24T16:24:08.759523+0000","last_fullsized":"2024-07-24T16:24:08.759523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:31.194762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931063+0000","last_change":"2024-07-24T16:24:03.425422+0000","last_active":"2024-07-24T16:24:08.931063+0000","last_peered":"2024-07-24T16:24:08.931063+0000","last_clean":"2024-07-24T16:24:08.931063+0000","last_became_active":"2024-07-24T16:24:03.421595+0000","last_became_peered":"2024-07-24T16:24:03.421595+0000","last_unstale":"2024-07-24T16:24:08.931063+0000","last_undegraded":"2024-07-24T16:24:08.931063+0000","last_fullsized":"2024-07-24T16:24:08.931063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:11.929285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.439657+0000","last_change":"2024-07-24T16:24:02.411221+0000","last_active":"2024-07-24T16:24:08.439657+0000","last_peered":"2024-07-24T16:24:08.439657+0000","last_clean":"2024-07-24T16:24:08.439657+0000","last_became_active":"2024-07-24T16:24:02.410863+0000","last_became_peered":"2024-07-24T16:24:02.410863+0000","last_unstale":"2024-07-24T16:24:08.439657+0000","last_undegraded":"2024-07-24T16:24:08.439657+0000","last_fullsized":"2024-07-24T16:24:08.439657+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:39:09.948306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441228+0000","last_change":"2024-07-24T16:24:07.451699+0000","last_active":"2024-07-24T16:24:08.441228+0000","last_peered":"2024-07-24T16:24:08.441228+0000","last_clean":"2024-07-24T16:24:08.441228+0000","last_became_active":"2024-07-24T16:24:07.451312+0000","last_became_peered":"2024-07-24T16:24:07.451312+0000","last_unstale":"2024-07-24T16:24:08.441228+0000","last_undegraded":"2024-07-24T16:24:08.441228+0000","last_fullsized":"2024-07-24T16:24:08.441228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:00.032046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930892+0000","last_change":"2024-07-24T16:24:03.423978+0000","last_active":"2024-07-24T16:24:08.930892+0000","last_peered":"2024-07-24T16:24:08.930892+0000","last_clean":"2024-07-24T16:24:08.930892+0000","last_became_active":"2024-07-24T16:24:03.423695+0000","last_became_peered":"2024-07-24T16:24:03.423695+0000","last_unstale":"2024-07-24T16:24:08.930892+0000","last_undegraded":"2024-07-24T16:24:08.930892+0000","last_fullsized":"2024-07-24T16:24:08.930892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930970+0000","last_change":"2024-07-24T16:24:02.420730+0000","last_active":"2024-07-24T16:24:08.930970+0000","last_peered":"2024-07-24T16:24:08.930970+0000","last_clean":"2024-07-24T16:24:08.930970+0000","last_became_active":"2024-07-24T16:24:02.420437+0000","last_became_peered":"2024-07-24T16:24:02.420437+0000","last_unstale":"2024-07-24T16:24:08.930970+0000","last_undegraded":"2024-07-24T16:24:08.930970+0000","last_fullsized":"2024-07-24T16:24:08.930970+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663486+0000","last_change":"2024-07-24T16:24:07.689640+0000","last_active":"2024-07-24T16:24:08.663486+0000","last_peered":"2024-07-24T16:24:08.663486+0000","last_clean":"2024-07-24T16:24:08.663486+0000","last_became_active":"2024-07-24T16:24:07.689279+0000","last_became_peered":"2024-07-24T16:24:07.689279+0000","last_unstale":"2024-07-24T16:24:08.663486+0000","last_undegraded":"2024-07-24T16:24:08.663486+0000","last_fullsized":"2024-07-24T16:24:08.663486+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:48:40.982486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931940+0000","last_change":"2024-07-24T16:24:03.422243+0000","last_active":"2024-07-24T16:24:08.931940+0000","last_peered":"2024-07-24T16:24:08.931940+0000","last_clean":"2024-07-24T16:24:08.931940+0000","last_became_active":"2024-07-24T16:24:03.419977+0000","last_became_peered":"2024-07-24T16:24:03.419977+0000","last_unstale":"2024-07-24T16:24:08.931940+0000","last_undegraded":"2024-07-24T16:24:08.931940+0000","last_fullsized":"2024-07-24T16:24:08.931940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:33:56.923986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442330+0000","last_change":"2024-07-24T16:24:02.415148+0000","last_active":"2024-07-24T16:24:08.442330+0000","last_peered":"2024-07-24T16:24:08.442330+0000","last_clean":"2024-07-24T16:24:08.442330+0000","last_became_active":"2024-07-24T16:24:02.414888+0000","last_became_peered":"2024-07-24T16:24:02.414888+0000","last_unstale":"2024-07-24T16:24:08.442330+0000","last_undegraded":"2024-07-24T16:24:08.442330+0000","last_fullsized":"2024-07-24T16:24:08.442330+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663297+0000","last_change":"2024-07-24T16:24:07.689067+0000","last_active":"2024-07-24T16:24:08.663297+0000","last_peered":"2024-07-24T16:24:08.663297+0000","last_clean":"2024-07-24T16:24:08.663297+0000","last_became_active":"2024-07-24T16:24:07.688641+0000","last_became_peered":"2024-07-24T16:24:07.688641+0000","last_unstale":"2024-07-24T16:24:08.663297+0000","last_undegraded":"2024-07-24T16:24:08.663297+0000","last_fullsized":"2024-07-24T16:24:08.663297+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:25:51.738843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441338+0000","last_change":"2024-07-24T16:24:03.431327+0000","last_active":"2024-07-24T16:24:08.441338+0000","last_peered":"2024-07-24T16:24:08.441338+0000","last_clean":"2024-07-24T16:24:08.441338+0000","last_became_active":"2024-07-24T16:24:03.430853+0000","last_became_peered":"2024-07-24T16:24:03.430853+0000","last_unstale":"2024-07-24T16:24:08.441338+0000","last_undegraded":"2024-07-24T16:24:08.441338+0000","last_fullsized":"2024-07-24T16:24:08.441338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441701+0000","last_change":"2024-07-24T16:24:02.420934+0000","last_active":"2024-07-24T16:24:08.441701+0000","last_peered":"2024-07-24T16:24:08.441701+0000","last_clean":"2024-07-24T16:24:08.441701+0000","last_became_active":"2024-07-24T16:24:02.420671+0000","last_became_peered":"2024-07-24T16:24:02.420671+0000","last_unstale":"2024-07-24T16:24:08.441701+0000","last_undegraded":"2024-07-24T16:24:08.441701+0000","last_fullsized":"2024-07-24T16:24:08.441701+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:34:17.692339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441875+0000","last_change":"2024-07-24T16:24:07.689105+0000","last_active":"2024-07-24T16:24:08.441875+0000","last_peered":"2024-07-24T16:24:08.441875+0000","last_clean":"2024-07-24T16:24:08.441875+0000","last_became_active":"2024-07-24T16:24:07.688653+0000","last_became_peered":"2024-07-24T16:24:07.688653+0000","last_unstale":"2024-07-24T16:24:08.441875+0000","last_undegraded":"2024-07-24T16:24:08.441875+0000","last_fullsized":"2024-07-24T16:24:08.441875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:53:17.994950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931785+0000","last_change":"2024-07-24T16:24:03.426312+0000","last_active":"2024-07-24T16:24:08.931785+0000","last_peered":"2024-07-24T16:24:08.931785+0000","last_clean":"2024-07-24T16:24:08.931785+0000","last_became_active":"2024-07-24T16:24:03.425604+0000","last_became_peered":"2024-07-24T16:24:03.425604+0000","last_unstale":"2024-07-24T16:24:08.931785+0000","last_undegraded":"2024-07-24T16:24:08.931785+0000","last_fullsized":"2024-07-24T16:24:08.931785+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:25.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":32,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:12.924059+0000","last_change":"2024-07-24T16:24:02.422934+0000","last_active":"2024-07-24T16:24:12.924059+0000","last_peered":"2024-07-24T16:24:12.924059+0000","last_clean":"2024-07-24T16:24:12.924059+0000","last_became_active":"2024-07-24T16:24:02.422695+0000","last_became_peered":"2024-07-24T16:24:02.422695+0000","last_unstale":"2024-07-24T16:24:12.924059+0000","last_undegraded":"2024-07-24T16:24:12.924059+0000","last_fullsized":"2024-07-24T16:24:12.924059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930364+0000","last_change":"2024-07-24T16:24:07.456345+0000","last_active":"2024-07-24T16:24:08.930364+0000","last_peered":"2024-07-24T16:24:08.930364+0000","last_clean":"2024-07-24T16:24:08.930364+0000","last_became_active":"2024-07-24T16:24:07.455655+0000","last_became_peered":"2024-07-24T16:24:07.455655+0000","last_unstale":"2024-07-24T16:24:08.930364+0000","last_undegraded":"2024-07-24T16:24:08.930364+0000","last_fullsized":"2024-07-24T16:24:08.930364+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:41.279030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760268+0000","last_change":"2024-07-24T16:24:03.421137+0000","last_active":"2024-07-24T16:24:08.760268+0000","last_peered":"2024-07-24T16:24:08.760268+0000","last_clean":"2024-07-24T16:24:08.760268+0000","last_became_active":"2024-07-24T16:24:03.420297+0000","last_became_peered":"2024-07-24T16:24:03.420297+0000","last_unstale":"2024-07-24T16:24:08.760268+0000","last_undegraded":"2024-07-24T16:24:08.760268+0000","last_fullsized":"2024-07-24T16:24:08.760268+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:56:36.133125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":26,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930677+0000","last_change":"2024-07-24T16:24:02.420388+0000","last_active":"2024-07-24T16:24:08.930677+0000","last_peered":"2024-07-24T16:24:08.930677+0000","last_clean":"2024-07-24T16:24:08.930677+0000","last_became_active":"2024-07-24T16:24:02.420112+0000","last_became_peered":"2024-07-24T16:24:02.420112+0000","last_unstale":"2024-07-24T16:24:08.930677+0000","last_undegraded":"2024-07-24T16:24:08.930677+0000","last_fullsized":"2024-07-24T16:24:08.930677+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:51:24.579495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759693+0000","last_change":"2024-07-24T16:24:07.448340+0000","last_active":"2024-07-24T16:24:08.759693+0000","last_peered":"2024-07-24T16:24:08.759693+0000","last_clean":"2024-07-24T16:24:08.759693+0000","last_became_active":"2024-07-24T16:24:07.447324+0000","last_became_peered":"2024-07-24T16:24:07.447324+0000","last_unstale":"2024-07-24T16:24:08.759693+0000","last_undegraded":"2024-07-24T16:24:08.759693+0000","last_fullsized":"2024-07-24T16:24:08.759693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:34:00.952650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441533+0000","last_change":"2024-07-24T16:24:03.426242+0000","last_active":"2024-07-24T16:24:08.441533+0000","last_peered":"2024-07-24T16:24:08.441533+0000","last_clean":"2024-07-24T16:24:08.441533+0000","last_became_active":"2024-07-24T16:24:03.425940+0000","last_became_peered":"2024-07-24T16:24:03.425940+0000","last_unstale":"2024-07-24T16:24:08.441533+0000","last_undegraded":"2024-07-24T16:24:08.441533+0000","last_fullsized":"2024-07-24T16:24:08.441533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442327+0000","last_change":"2024-07-24T16:24:02.419299+0000","last_active":"2024-07-24T16:24:08.442327+0000","last_peered":"2024-07-24T16:24:08.442327+0000","last_clean":"2024-07-24T16:24:08.442327+0000","last_became_active":"2024-07-24T16:24:02.419004+0000","last_became_peered":"2024-07-24T16:24:02.419004+0000","last_unstale":"2024-07-24T16:24:08.442327+0000","last_undegraded":"2024-07-24T16:24:08.442327+0000","last_fullsized":"2024-07-24T16:24:08.442327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662799+0000","last_change":"2024-07-24T16:24:07.446403+0000","last_active":"2024-07-24T16:24:08.662799+0000","last_peered":"2024-07-24T16:24:08.662799+0000","last_clean":"2024-07-24T16:24:08.662799+0000","last_became_active":"2024-07-24T16:24:07.445711+0000","last_became_peered":"2024-07-24T16:24:07.445711+0000","last_unstale":"2024-07-24T16:24:08.662799+0000","last_undegraded":"2024-07-24T16:24:08.662799+0000","last_fullsized":"2024-07-24T16:24:08.662799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:14:48.365984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441973+0000","last_change":"2024-07-24T16:24:03.421104+0000","last_active":"2024-07-24T16:24:08.441973+0000","last_peered":"2024-07-24T16:24:08.441973+0000","last_clean":"2024-07-24T16:24:08.441973+0000","last_became_active":"2024-07-24T16:24:03.420479+0000","last_became_peered":"2024-07-24T16:24:03.420479+0000","last_unstale":"2024-07-24T16:24:08.441973+0000","last_undegraded":"2024-07-24T16:24:08.441973+0000","last_fullsized":"2024-07-24T16:24:08.441973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:37.605337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931694+0000","last_change":"2024-07-24T16:24:02.424342+0000","last_active":"2024-07-24T16:24:08.931694+0000","last_peered":"2024-07-24T16:24:08.931694+0000","last_clean":"2024-07-24T16:24:08.931694+0000","last_became_active":"2024-07-24T16:24:02.424056+0000","last_became_peered":"2024-07-24T16:24:02.424056+0000","last_unstale":"2024-07-24T16:24:08.931694+0000","last_undegraded":"2024-07-24T16:24:08.931694+0000","last_fullsized":"2024-07-24T16:24:08.931694+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:25:06.465807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662718+0000","last_change":"2024-07-24T16:24:07.689112+0000","last_active":"2024-07-24T16:24:08.662718+0000","last_peered":"2024-07-24T16:24:08.662718+0000","last_clean":"2024-07-24T16:24:08.662718+0000","last_became_active":"2024-07-24T16:24:07.688763+0000","last_became_peered":"2024-07-24T16:24:07.688763+0000","last_unstale":"2024-07-24T16:24:08.662718+0000","last_undegraded":"2024-07-24T16:24:08.662718+0000","last_fullsized":"2024-07-24T16:24:08.662718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:53:17.994950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441200+0000","last_change":"2024-07-24T16:24:07.689772+0000","last_active":"2024-07-24T16:24:08.441200+0000","last_peered":"2024-07-24T16:24:08.441200+0000","last_clean":"2024-07-24T16:24:08.441200+0000","last_became_active":"2024-07-24T16:24:07.689417+0000","last_became_peered":"2024-07-24T16:24:07.689417+0000","last_unstale":"2024-07-24T16:24:08.441200+0000","last_undegraded":"2024-07-24T16:24:08.441200+0000","last_fullsized":"2024-07-24T16:24:08.441200+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:25.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930100+0000","last_change":"2024-07-24T16:24:03.416202+0000","last_active":"2024-07-24T16:24:08.930100+0000","last_peered":"2024-07-24T16:24:08.930100+0000","last_clean":"2024-07-24T16:24:08.930100+0000","last_became_active":"2024-07-24T16:24:03.415444+0000","last_became_peered":"2024-07-24T16:24:03.415444+0000","last_unstale":"2024-07-24T16:24:08.930100+0000","last_undegraded":"2024-07-24T16:24:08.930100+0000","last_fullsized":"2024-07-24T16:24:08.930100+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441673+0000","last_change":"2024-07-24T16:24:02.416160+0000","last_active":"2024-07-24T16:24:08.441673+0000","last_peered":"2024-07-24T16:24:08.441673+0000","last_clean":"2024-07-24T16:24:08.441673+0000","last_became_active":"2024-07-24T16:24:02.415685+0000","last_became_peered":"2024-07-24T16:24:02.415685+0000","last_unstale":"2024-07-24T16:24:08.441673+0000","last_undegraded":"2024-07-24T16:24:08.441673+0000","last_fullsized":"2024-07-24T16:24:08.441673+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931484+0000","last_change":"2024-07-24T16:24:07.453889+0000","last_active":"2024-07-24T16:24:08.931484+0000","last_peered":"2024-07-24T16:24:08.931484+0000","last_clean":"2024-07-24T16:24:08.931484+0000","last_became_active":"2024-07-24T16:24:07.453401+0000","last_became_peered":"2024-07-24T16:24:07.453401+0000","last_unstale":"2024-07-24T16:24:08.931484+0000","last_undegraded":"2024-07-24T16:24:08.931484+0000","last_fullsized":"2024-07-24T16:24:08.931484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:49:25.287549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662799+0000","last_change":"2024-07-24T16:24:03.422055+0000","last_active":"2024-07-24T16:24:08.662799+0000","last_peered":"2024-07-24T16:24:08.662799+0000","last_clean":"2024-07-24T16:24:08.662799+0000","last_became_active":"2024-07-24T16:24:03.420953+0000","last_became_peered":"2024-07-24T16:24:03.420953+0000","last_unstale":"2024-07-24T16:24:08.662799+0000","last_undegraded":"2024-07-24T16:24:08.662799+0000","last_fullsized":"2024-07-24T16:24:08.662799+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:57.571326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662904+0000","last_change":"2024-07-24T16:24:02.416293+0000","last_active":"2024-07-24T16:24:08.662904+0000","last_peered":"2024-07-24T16:24:08.662904+0000","last_clean":"2024-07-24T16:24:08.662904+0000","last_became_active":"2024-07-24T16:24:02.415990+0000","last_became_peered":"2024-07-24T16:24:02.415990+0000","last_unstale":"2024-07-24T16:24:08.662904+0000","last_undegraded":"2024-07-24T16:24:08.662904+0000","last_fullsized":"2024-07-24T16:24:08.662904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:16:32.586873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931260+0000","last_change":"2024-07-24T16:24:02.421954+0000","last_active":"2024-07-24T16:24:08.931260+0000","last_peered":"2024-07-24T16:24:08.931260+0000","last_clean":"2024-07-24T16:24:08.931260+0000","last_became_active":"2024-07-24T16:24:02.421684+0000","last_became_peered":"2024-07-24T16:24:02.421684+0000","last_unstale":"2024-07-24T16:24:08.931260+0000","last_undegraded":"2024-07-24T16:24:08.931260+0000","last_fullsized":"2024-07-24T16:24:08.931260+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:26:56.723826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441648+0000","last_change":"2024-07-24T16:24:03.421135+0000","last_active":"2024-07-24T16:24:08.441648+0000","last_peered":"2024-07-24T16:24:08.441648+0000","last_clean":"2024-07-24T16:24:08.441648+0000","last_became_active":"2024-07-24T16:24:03.420836+0000","last_became_peered":"2024-07-24T16:24:03.420836+0000","last_unstale":"2024-07-24T16:24:08.441648+0000","last_undegraded":"2024-07-24T16:24:08.441648+0000","last_fullsized":"2024-07-24T16:24:08.441648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:17:16.704958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440237+0000","last_change":"2024-07-24T16:24:07.456171+0000","last_active":"2024-07-24T16:24:08.440237+0000","last_peered":"2024-07-24T16:24:08.440237+0000","last_clean":"2024-07-24T16:24:08.440237+0000","last_became_active":"2024-07-24T16:24:07.455706+0000","last_became_peered":"2024-07-24T16:24:07.455706+0000","last_unstale":"2024-07-24T16:24:08.440237+0000","last_undegraded":"2024-07-24T16:24:08.440237+0000","last_fullsized":"2024-07-24T16:24:08.440237+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:57:59.034419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663222+0000","last_change":"2024-07-24T16:24:02.424430+0000","last_active":"2024-07-24T16:24:08.663222+0000","last_peered":"2024-07-24T16:24:08.663222+0000","last_clean":"2024-07-24T16:24:08.663222+0000","last_became_active":"2024-07-24T16:24:02.424131+0000","last_became_peered":"2024-07-24T16:24:02.424131+0000","last_unstale":"2024-07-24T16:24:08.663222+0000","last_undegraded":"2024-07-24T16:24:08.663222+0000","last_fullsized":"2024-07-24T16:24:08.663222+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:01.345866+0000","last_clean_scrub_stamp":"2024-07-24T16:24:01.345866+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:11:26.148830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.759757+0000","last_change":"2024-07-24T16:24:03.405739+0000","last_active":"2024-07-24T16:24:08.759757+0000","last_peered":"2024-07-24T16:24:08.759757+0000","last_clean":"2024-07-24T16:24:08.759757+0000","last_became_active":"2024-07-24T16:24:03.405465+0000","last_became_peered":"2024-07-24T16:24:03.405465+0000","last_unstale":"2024-07-24T16:24:08.759757+0000","last_undegraded":"2024-07-24T16:24:08.759757+0000","last_fullsized":"2024-07-24T16:24:08.759757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:17.143178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663324+0000","last_change":"2024-07-24T16:24:07.451902+0000","last_active":"2024-07-24T16:24:08.663324+0000","last_peered":"2024-07-24T16:24:08.663324+0000","last_clean":"2024-07-24T16:24:08.663324+0000","last_became_active":"2024-07-24T16:24:07.451243+0000","last_became_peered":"2024-07-24T16:24:07.451243+0000","last_unstale":"2024-07-24T16:24:08.663324+0000","last_undegraded":"2024-07-24T16:24:08.663324+0000","last_fullsized":"2024-07-24T16:24:08.663324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:06.417896+0000","last_clean_scrub_stamp":"2024-07-24T16:24:06.417896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:32:02.239427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930768+0000","last_change":"2024-07-24T16:24:03.426344+0000","last_active":"2024-07-24T16:24:08.930768+0000","last_peered":"2024-07-24T16:24:08.930768+0000","last_clean":"2024-07-24T16:24:08.930768+0000","last_became_active":"2024-07-24T16:24:03.426064+0000","last_became_peered":"2024-07-24T16:24:03.426064+0000","last_unstale":"2024-07-24T16:24:08.930768+0000","last_undegraded":"2024-07-24T16:24:08.930768+0000","last_fullsized":"2024-07-24T16:24:08.930768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:17:16.704958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.439822+0000","last_change":"2024-07-24T16:24:03.414954+0000","last_active":"2024-07-24T16:24:08.439822+0000","last_peered":"2024-07-24T16:24:08.439822+0000","last_clean":"2024-07-24T16:24:08.439822+0000","last_became_active":"2024-07-24T16:24:03.414684+0000","last_became_peered":"2024-07-24T16:24:03.414684+0000","last_unstale":"2024-07-24T16:24:08.439822+0000","last_undegraded":"2024-07-24T16:24:08.439822+0000","last_fullsized":"2024-07-24T16:24:08.439822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:28:17.143178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441834+0000","last_change":"2024-07-24T16:24:03.420882+0000","last_active":"2024-07-24T16:24:08.441834+0000","last_peered":"2024-07-24T16:24:08.441834+0000","last_clean":"2024-07-24T16:24:08.441834+0000","last_became_active":"2024-07-24T16:24:03.420555+0000","last_became_peered":"2024-07-24T16:24:03.420555+0000","last_unstale":"2024-07-24T16:24:08.441834+0000","last_undegraded":"2024-07-24T16:24:08.441834+0000","last_fullsized":"2024-07-24T16:24:08.441834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:37.250366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441536+0000","last_change":"2024-07-24T16:24:03.419648+0000","last_active":"2024-07-24T16:24:08.441536+0000","last_peered":"2024-07-24T16:24:08.441536+0000","last_clean":"2024-07-24T16:24:08.441536+0000","last_became_active":"2024-07-24T16:24:03.419390+0000","last_became_peered":"2024-07-24T16:24:03.419390+0000","last_unstale":"2024-07-24T16:24:08.441536+0000","last_undegraded":"2024-07-24T16:24:08.441536+0000","last_fullsized":"2024-07-24T16:24:08.441536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663423+0000","last_change":"2024-07-24T16:24:03.420527+0000","last_active":"2024-07-24T16:24:08.663423+0000","last_peered":"2024-07-24T16:24:08.663423+0000","last_clean":"2024-07-24T16:24:08.663423+0000","last_became_active":"2024-07-24T16:24:03.419368+0000","last_became_peered":"2024-07-24T16:24:03.419368+0000","last_unstale":"2024-07-24T16:24:08.663423+0000","last_undegraded":"2024-07-24T16:24:08.663423+0000","last_fullsized":"2024-07-24T16:24:08.663423+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:25.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930580+0000","last_change":"2024-07-24T16:24:03.416673+0000","last_active":"2024-07-24T16:24:08.930580+0000","last_peered":"2024-07-24T16:24:08.930580+0000","last_clean":"2024-07-24T16:24:08.930580+0000","last_became_active":"2024-07-24T16:24:03.416375+0000","last_became_peered":"2024-07-24T16:24:03.416375+0000","last_unstale":"2024-07-24T16:24:08.930580+0000","last_undegraded":"2024-07-24T16:24:08.930580+0000","last_fullsized":"2024-07-24T16:24:08.930580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931645+0000","last_change":"2024-07-24T16:24:03.424087+0000","last_active":"2024-07-24T16:24:08.931645+0000","last_peered":"2024-07-24T16:24:08.931645+0000","last_clean":"2024-07-24T16:24:08.931645+0000","last_became_active":"2024-07-24T16:24:03.423409+0000","last_became_peered":"2024-07-24T16:24:03.423409+0000","last_unstale":"2024-07-24T16:24:08.931645+0000","last_undegraded":"2024-07-24T16:24:08.931645+0000","last_fullsized":"2024-07-24T16:24:08.931645+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663596+0000","last_change":"2024-07-24T16:24:03.418712+0000","last_active":"2024-07-24T16:24:08.663596+0000","last_peered":"2024-07-24T16:24:08.663596+0000","last_clean":"2024-07-24T16:24:08.663596+0000","last_became_active":"2024-07-24T16:24:03.418419+0000","last_became_peered":"2024-07-24T16:24:03.418419+0000","last_unstale":"2024-07-24T16:24:08.663596+0000","last_undegraded":"2024-07-24T16:24:08.663596+0000","last_fullsized":"2024-07-24T16:24:08.663596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441633+0000","last_change":"2024-07-24T16:24:03.418720+0000","last_active":"2024-07-24T16:24:08.441633+0000","last_peered":"2024-07-24T16:24:08.441633+0000","last_clean":"2024-07-24T16:24:08.441633+0000","last_became_active":"2024-07-24T16:24:03.418318+0000","last_became_peered":"2024-07-24T16:24:03.418318+0000","last_unstale":"2024-07-24T16:24:08.441633+0000","last_undegraded":"2024-07-24T16:24:08.441633+0000","last_fullsized":"2024-07-24T16:24:08.441633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:11.929285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662844+0000","last_change":"2024-07-24T16:24:03.418662+0000","last_active":"2024-07-24T16:24:08.662844+0000","last_peered":"2024-07-24T16:24:08.662844+0000","last_clean":"2024-07-24T16:24:08.662844+0000","last_became_active":"2024-07-24T16:24:03.418378+0000","last_became_peered":"2024-07-24T16:24:03.418378+0000","last_unstale":"2024-07-24T16:24:08.662844+0000","last_undegraded":"2024-07-24T16:24:08.662844+0000","last_fullsized":"2024-07-24T16:24:08.662844+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441710+0000","last_change":"2024-07-24T16:24:03.418038+0000","last_active":"2024-07-24T16:24:08.441710+0000","last_peered":"2024-07-24T16:24:08.441710+0000","last_clean":"2024-07-24T16:24:08.441710+0000","last_became_active":"2024-07-24T16:24:03.417007+0000","last_became_peered":"2024-07-24T16:24:03.417007+0000","last_unstale":"2024-07-24T16:24:08.441710+0000","last_undegraded":"2024-07-24T16:24:08.441710+0000","last_fullsized":"2024-07-24T16:24:08.441710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:42.549780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441338+0000","last_change":"2024-07-24T16:24:03.431911+0000","last_active":"2024-07-24T16:24:08.441338+0000","last_peered":"2024-07-24T16:24:08.441338+0000","last_clean":"2024-07-24T16:24:08.441338+0000","last_became_active":"2024-07-24T16:24:03.431609+0000","last_became_peered":"2024-07-24T16:24:03.431609+0000","last_unstale":"2024-07-24T16:24:08.441338+0000","last_undegraded":"2024-07-24T16:24:08.441338+0000","last_fullsized":"2024-07-24T16:24:08.441338+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:48:51.593685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931556+0000","last_change":"2024-07-24T16:24:03.421743+0000","last_active":"2024-07-24T16:24:08.931556+0000","last_peered":"2024-07-24T16:24:08.931556+0000","last_clean":"2024-07-24T16:24:08.931556+0000","last_became_active":"2024-07-24T16:24:03.419448+0000","last_became_peered":"2024-07-24T16:24:03.419448+0000","last_unstale":"2024-07-24T16:24:08.931556+0000","last_undegraded":"2024-07-24T16:24:08.931556+0000","last_fullsized":"2024-07-24T16:24:08.931556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932230+0000","last_change":"2024-07-24T16:24:03.426083+0000","last_active":"2024-07-24T16:24:08.932230+0000","last_peered":"2024-07-24T16:24:08.932230+0000","last_clean":"2024-07-24T16:24:08.932230+0000","last_became_active":"2024-07-24T16:24:03.425305+0000","last_became_peered":"2024-07-24T16:24:03.425305+0000","last_unstale":"2024-07-24T16:24:08.932230+0000","last_undegraded":"2024-07-24T16:24:08.932230+0000","last_fullsized":"2024-07-24T16:24:08.932230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:37.250366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.440125+0000","last_change":"2024-07-24T16:24:03.414343+0000","last_active":"2024-07-24T16:24:08.440125+0000","last_peered":"2024-07-24T16:24:08.440125+0000","last_clean":"2024-07-24T16:24:08.440125+0000","last_became_active":"2024-07-24T16:24:03.414057+0000","last_became_peered":"2024-07-24T16:24:03.414057+0000","last_unstale":"2024-07-24T16:24:08.440125+0000","last_undegraded":"2024-07-24T16:24:08.440125+0000","last_fullsized":"2024-07-24T16:24:08.440125+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:45:49.295282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.442181+0000","last_change":"2024-07-24T16:24:03.420932+0000","last_active":"2024-07-24T16:24:08.442181+0000","last_peered":"2024-07-24T16:24:08.442181+0000","last_clean":"2024-07-24T16:24:08.442181+0000","last_became_active":"2024-07-24T16:24:03.420642+0000","last_became_peered":"2024-07-24T16:24:03.420642+0000","last_unstale":"2024-07-24T16:24:08.442181+0000","last_undegraded":"2024-07-24T16:24:08.442181+0000","last_fullsized":"2024-07-24T16:24:08.442181+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:39:27.166098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441303+0000","last_change":"2024-07-24T16:24:03.425237+0000","last_active":"2024-07-24T16:24:08.441303+0000","last_peered":"2024-07-24T16:24:08.441303+0000","last_clean":"2024-07-24T16:24:08.441303+0000","last_became_active":"2024-07-24T16:24:03.424915+0000","last_became_peered":"2024-07-24T16:24:03.424915+0000","last_unstale":"2024-07-24T16:24:08.441303+0000","last_undegraded":"2024-07-24T16:24:08.441303+0000","last_fullsized":"2024-07-24T16:24:08.441303+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:55:02.594058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930172+0000","last_change":"2024-07-24T16:24:03.404488+0000","last_active":"2024-07-24T16:24:08.930172+0000","last_peered":"2024-07-24T16:24:08.930172+0000","last_clean":"2024-07-24T16:24:08.930172+0000","last_became_active":"2024-07-24T16:24:03.404145+0000","last_became_peered":"2024-07-24T16:24:03.404145+0000","last_unstale":"2024-07-24T16:24:08.930172+0000","last_undegraded":"2024-07-24T16:24:08.930172+0000","last_fullsized":"2024-07-24T16:24:08.930172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441452+0000","last_change":"2024-07-24T16:24:03.421865+0000","last_active":"2024-07-24T16:24:08.441452+0000","last_peered":"2024-07-24T16:24:08.441452+0000","last_clean":"2024-07-24T16:24:08.441452+0000","last_became_active":"2024-07-24T16:24:03.421569+0000","last_became_peered":"2024-07-24T16:24:03.421569+0000","last_unstale":"2024-07-24T16:24:08.441452+0000","last_undegraded":"2024-07-24T16:24:08.441452+0000","last_fullsized":"2024-07-24T16:24:08.441452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.663120+0000","last_change":"2024-07-24T16:24:03.414078+0000","last_active":"2024-07-24T16:24:08.663120+0000","last_peered":"2024-07-24T16:24:08.663120+0000","last_clean":"2024-07-24T16:24:08.663120+0000","last_became_active":"2024-07-24T16:24:03.413790+0000","last_became_peered":"2024-07-24T16:24:03.413790+0000","last_unstale":"2024-07-24T16:24:08.663120+0000","last_undegraded":"2024-07-24T16:24:08.663120+0000","last_fullsized":"2024-07-24T16:24:08.663120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:05.808945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.760147+0000","last_change":"2024-07-24T16:24:03.415097+0000","last_active":"2024-07-24T16:24:08.760147+0000","last_peered":"2024-07-24T16:24:08.760147+0000","last_clean":"2024-07-24T16:24:08.760147+0000","last_became_active":"2024-07-24T16:24:03.413714+0000","last_became_peered":"2024-07-24T16:24:03.413714+0000","last_unstale":"2024-07-24T16:24:08.760147+0000","last_undegraded":"2024-07-24T16:24:08.760147+0000","last_fullsized":"2024-07-24T16:24:08.760147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:35:31.460220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931494+0000","last_change":"2024-07-24T16:24:03.414407+0000","last_active":"2024-07-24T16:24:08.931494+0000","last_peered":"2024-07-24T16:24:08.931494+0000","last_clean":"2024-07-24T16:24:08.931494+0000","last_became_active":"2024-07-24T16:24:03.414130+0000","last_became_peered":"2024-07-24T16:24:03.414130+0000","last_unstale":"2024-07-24T16:24:08.931494+0000","last_undegraded":"2024-07-24T16:24:08.931494+0000","last_fullsized":"2024-07-24T16:24:08.931494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:32:21.669479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931527+0000","last_change":"2024-07-24T16:24:03.423751+0000","last_active":"2024-07-24T16:24:08.931527+0000","last_peered":"2024-07-24T16:24:08.931527+0000","last_clean":"2024-07-24T16:24:08.931527+0000","last_became_active":"2024-07-24T16:24:03.423474+0000","last_became_peered":"2024-07-24T16:24:03.423474+0000","last_unstale":"2024-07-24T16:24:08.931527+0000","last_undegraded":"2024-07-24T16:24:08.931527+0000","last_fullsized":"2024-07-24T16:24:08.931527+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.932077+0000","last_change":"2024-07-24T16:24:03.427935+0000","last_active":"2024-07-24T16:24:08.932077+0000","last_peered":"2024-07-24T16:24:08.932077+0000","last_clean":"2024-07-24T16:24:08.932077+0000","last_became_active":"2024-07-24T16:24:03.427533+0000","last_became_peered":"2024-07-24T16:24:03.427533+0000","last_unstale":"2024-07-24T16:24:08.932077+0000","last_undegraded":"2024-07-24T16:24:08.932077+0000","last_fullsized":"2024-07-24T16:24:08.932077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:59:37.605337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.662710+0000","last_change":"2024-07-24T16:24:03.426562+0000","last_active":"2024-07-24T16:24:08.662710+0000","last_peered":"2024-07-24T16:24:08.662710+0000","last_clean":"2024-07-24T16:24:08.662710+0000","last_became_active":"2024-07-24T16:24:03.426289+0000","last_became_peered":"2024-07-24T16:24:03.426289+0000","last_unstale":"2024-07-24T16:24:08.662710+0000","last_undegraded":"2024-07-24T16:24:08.662710+0000","last_fullsized":"2024-07-24T16:24:08.662710+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:36.601644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930924+0000","last_change":"2024-07-24T16:24:03.425133+0000","last_active":"2024-07-24T16:24:08.930924+0000","last_peered":"2024-07-24T16:24:08.930924+0000","last_clean":"2024-07-24T16:24:08.930924+0000","last_became_active":"2024-07-24T16:24:03.424694+0000","last_became_peered":"2024-07-24T16:24:03.424694+0000","last_unstale":"2024-07-24T16:24:08.930924+0000","last_undegraded":"2024-07-24T16:24:08.930924+0000","last_fullsized":"2024-07-24T16:24:08.930924+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:04:05.808945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441560+0000","last_change":"2024-07-24T16:24:03.424756+0000","last_active":"2024-07-24T16:24:08.441560+0000","last_peered":"2024-07-24T16:24:08.441560+0000","last_clean":"2024-07-24T16:24:08.441560+0000","last_became_active":"2024-07-24T16:24:03.424496+0000","last_became_peered":"2024-07-24T16:24:03.424496+0000","last_unstale":"2024-07-24T16:24:08.441560+0000","last_undegraded":"2024-07-24T16:24:08.441560+0000","last_fullsized":"2024-07-24T16:24:08.441560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:14:25.109394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931259+0000","last_change":"2024-07-24T16:24:03.424754+0000","last_active":"2024-07-24T16:24:08.931259+0000","last_peered":"2024-07-24T16:24:08.931259+0000","last_clean":"2024-07-24T16:24:08.931259+0000","last_became_active":"2024-07-24T16:24:03.421220+0000","last_became_peered":"2024-07-24T16:24:03.421220+0000","last_unstale":"2024-07-24T16:24:08.931259+0000","last_undegraded":"2024-07-24T16:24:08.931259+0000","last_fullsized":"2024-07-24T16:24:08.931259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:01.499631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441829+0000","last_change":"2024-07-24T16:24:03.419695+0000","last_active":"2024-07-24T16:24:08.441829+0000","last_peered":"2024-07-24T16:24:08.441829+0000","last_clean":"2024-07-24T16:24:08.441829+0000","last_became_active":"2024-07-24T16:24:03.416727+0000","last_became_peered":"2024-07-24T16:24:03.416727+0000","last_unstale":"2024-07-24T16:24:08.441829+0000","last_undegraded":"2024-07-24T16:24:08.441829+0000","last_fullsized":"2024-07-24T16:24:08.441829+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:33:56.923986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.441260+0000","last_change":"2024-07-24T16:24:03.422051+0000","last_active":"2024-07-24T16:24:08.441260+0000","last_peered":"2024-07-24T16:24:08.441260+0000","last_clean":"2024-07-24T16:24:08.441260+0000","last_became_active":"2024-07-24T16:24:03.421771+0000","last_became_peered":"2024-07-24T16:24:03.421771+0000","last_unstale":"2024-07-24T16:24:08.441260+0000","last_undegraded":"2024-07-24T16:24:08.441260+0000","last_fullsized":"2024-07-24T16:24:08.441260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:07:14.015059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.930778+0000","last_change":"2024-07-24T16:24:03.419502+0000","last_active":"2024-07-24T16:24:08.930778+0000","last_peered":"2024-07-24T16:24:08.930778+0000","last_clean":"2024-07-24T16:24:08.930778+0000","last_became_active":"2024-07-24T16:24:03.419206+0000","last_became_peered":"2024-07-24T16:24:03.419206+0000","last_unstale":"2024-07-24T16:24:08.930778+0000","last_undegraded":"2024-07-24T16:24:08.930778+0000","last_fullsized":"2024-07-24T16:24:08.930778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:26:23.529952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-07-24T16:24:08.931978+0000","last_change":"2024-07-24T16:24:03.419857+0000","last_active":"2024-07-24T16:24:08.931978+0000","last_peered":"2024-07-24T16:24:08.931978+0000","last_clean":"2024-07-24T16:24:08.931978+0000","last_became_active":"2024-07-24T16:24:03.419599+0000","last_became_peered":"2024-07-24T16:24:03.419599+0000","last_unstale":"2024-07-24T16:24:08.931978+0000","last_undegraded":"2024-07-24T16:24:08.931978+0000","last_fullsized":"2024-07-24T16:24:08.931978+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:02.389232+0000","last_clean_scrub_stamp":"2024-07-24T16:24:02.389232+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:33:42.549780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":690820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":99960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":99996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":103712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":253952,"data_stored":99870,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":100030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27864,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343976,"statfs":{"total":96636764160,"available":96608231424,"internally_reserved":0,"allocated":860160,"data_stored":690876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:24:28.584 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-07-24T16:24:28.584 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-07-24T16:24:28.584 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-07-24T16:24:28.584 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-07-24T16:24:28.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.720+0000 7fb919b8b640 1 -- 172.21.15.159:0/1484470788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb914073c10 msgr2=0x7fb914074080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.720+0000 7fb919b8b640 1 --2- 172.21.15.159:0/1484470788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb914073c10 0x7fb914074080 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb90c005fd0 tx=0x7fb90c02a8b0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.720+0000 7fb919b8b640 1 -- 172.21.15.159:0/1484470788 shutdown_connections 2024-07-24T16:24:28.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.720+0000 7fb919b8b640 1 --2- 172.21.15.159:0/1484470788 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb914073c10 0x7fb914074080 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.720+0000 7fb919b8b640 1 --2- 172.21.15.159:0/1484470788 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb91415ba20 0x7fb91415fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.720+0000 7fb919b8b640 1 -- 172.21.15.159:0/1484470788 >> 172.21.15.159:0/1484470788 conn(0x7fb91406fd50 msgr2=0x7fb914070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:28.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.720+0000 7fb919b8b640 1 -- 172.21.15.159:0/1484470788 shutdown_connections 2024-07-24T16:24:28.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.720+0000 7fb919b8b640 1 -- 172.21.15.159:0/1484470788 wait complete. 2024-07-24T16:24:28.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.721+0000 7fb919b8b640 1 Processor -- start 2024-07-24T16:24:28.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.721+0000 7fb919b8b640 1 -- start start 2024-07-24T16:24:28.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.722+0000 7fb919b8b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb914073c10 0x7fb9140b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:28.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.722+0000 7fb919b8b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9140b0c40 0x7fb914153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:28.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.722+0000 7fb919b8b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb91415ba20 0x7fb91415dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:28.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.722+0000 7fb919b8b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb9140d1750 con 0x7fb91415ba20 2024-07-24T16:24:28.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.722+0000 7fb919b8b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb9140d15d0 con 0x7fb9140b0c40 2024-07-24T16:24:28.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.722+0000 7fb919b8b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb9140d18d0 con 0x7fb914073c10 2024-07-24T16:24:28.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.722+0000 7fb913fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb91415ba20 0x7fb91415dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:28.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.722+0000 7fb913fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb91415ba20 0x7fb91415dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60092/0 (socket says 172.21.15.159:60092) 2024-07-24T16:24:28.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.722+0000 7fb913fff640 1 -- 172.21.15.159:0/1169614562 learned_addr learned my addr 172.21.15.159:0/1169614562 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:28.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.722+0000 7fb912ffd640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9140b0c40 0x7fb914153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:28.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.722+0000 7fb9137fe640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb914073c10 0x7fb9140b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:28.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.723+0000 7fb913fff640 1 -- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb914073c10 msgr2=0x7fb9140b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.723+0000 7fb913fff640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb914073c10 0x7fb9140b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.723+0000 7fb913fff640 1 -- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9140b0c40 msgr2=0x7fb914153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.723+0000 7fb913fff640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9140b0c40 0x7fb914153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.723+0000 7fb913fff640 1 -- 172.21.15.159:0/1169614562 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9141f5730 con 0x7fb91415ba20 2024-07-24T16:24:28.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.723+0000 7fb912ffd640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9140b0c40 0x7fb914153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:28.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.723+0000 7fb913fff640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb91415ba20 0x7fb91415dde0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009cd0 tx=0x7fb90c0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:28.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.723+0000 7fb8fbfff640 1 -- 172.21.15.159:0/1169614562 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c040070 con 0x7fb91415ba20 2024-07-24T16:24:28.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.723+0000 7fb919b8b640 1 -- 172.21.15.159:0/1169614562 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9141f5cc0 con 0x7fb91415ba20 2024-07-24T16:24:28.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.723+0000 7fb8fbfff640 1 -- 172.21.15.159:0/1169614562 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb90c004040 con 0x7fb91415ba20 2024-07-24T16:24:28.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.723+0000 7fb8fbfff640 1 -- 172.21.15.159:0/1169614562 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb90c004470 con 0x7fb91415ba20 2024-07-24T16:24:28.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.723+0000 7fb919b8b640 1 -- 172.21.15.159:0/1169614562 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9141f1c50 con 0x7fb91415ba20 2024-07-24T16:24:28.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.724+0000 7fb919b8b640 1 -- 172.21.15.159:0/1169614562 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9141f1eb0 con 0x7fb91415ba20 2024-07-24T16:24:28.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.724+0000 7fb8fbfff640 1 -- 172.21.15.159:0/1169614562 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb90c039040 con 0x7fb91415ba20 2024-07-24T16:24:28.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.725+0000 7fb8fbfff640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb900077010 0x7fb9000794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:28.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.725+0000 7fb8fbfff640 1 -- 172.21.15.159:0/1169614562 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb90c0ba070 con 0x7fb91415ba20 2024-07-24T16:24:28.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.725+0000 7fb9137fe640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb900077010 0x7fb9000794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:28.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.726+0000 7fb9137fe640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb900077010 0x7fb9000794d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb9040016b0 tx=0x7fb904009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:28.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.729+0000 7fb8fbfff640 1 -- 172.21.15.159:0/1169614562 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fb90c082fd0 con 0x7fb91415ba20 2024-07-24T16:24:28.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.951+0000 7fb919b8b640 1 -- 172.21.15.159:0/1169614562 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb9140d1d80 con 0x7fb91415ba20 2024-07-24T16:24:28.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.951+0000 7fb8fbfff640 1 -- 172.21.15.159:0/1169614562 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb90c08b210 con 0x7fb91415ba20 2024-07-24T16:24:28.954 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:28.954 INFO:teuthology.orchestra.run.smithi159.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-07-24T16:24:28.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.953+0000 7fb919b8b640 1 -- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb900077010 msgr2=0x7fb9000794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.953+0000 7fb919b8b640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb900077010 0x7fb9000794d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb9040016b0 tx=0x7fb904009040 comp rx=0 tx=0).stop 2024-07-24T16:24:28.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.953+0000 7fb919b8b640 1 -- 172.21.15.159:0/1169614562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb91415ba20 msgr2=0x7fb91415dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:28.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.953+0000 7fb919b8b640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb91415ba20 0x7fb91415dde0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fb90c009cd0 tx=0x7fb90c0316f0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.953+0000 7fb919b8b640 1 -- 172.21.15.159:0/1169614562 shutdown_connections 2024-07-24T16:24:28.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.953+0000 7fb919b8b640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb900077010 0x7fb9000794d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.953+0000 7fb919b8b640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb91415ba20 0x7fb91415dde0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.953+0000 7fb919b8b640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9140b0c40 0x7fb914153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.953+0000 7fb919b8b640 1 --2- 172.21.15.159:0/1169614562 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb914073c10 0x7fb9140b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:28.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.953+0000 7fb919b8b640 1 -- 172.21.15.159:0/1169614562 >> 172.21.15.159:0/1169614562 conn(0x7fb91406fd50 msgr2=0x7fb914070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:28.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.953+0000 7fb919b8b640 1 -- 172.21.15.159:0/1169614562 shutdown_connections 2024-07-24T16:24:28.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:28.953+0000 7fb919b8b640 1 -- 172.21.15.159:0/1169614562 wait complete. 2024-07-24T16:24:28.968 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-07-24T16:24:28.968 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:24:29.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.069+0000 7f97f75ed640 1 -- 172.21.15.159:0/3699567066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97d8004800 msgr2=0x7f97d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.069+0000 7f97f75ed640 1 --2- 172.21.15.159:0/3699567066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97d8004800 0x7f97d8004c80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f97e400c4a0 tx=0x7f97d8005830 comp rx=0 tx=0).stop 2024-07-24T16:24:29.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.069+0000 7f97f75ed640 1 -- 172.21.15.159:0/3699567066 shutdown_connections 2024-07-24T16:24:29.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.069+0000 7f97f75ed640 1 --2- 172.21.15.159:0/3699567066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97d8004800 0x7f97d8004c80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.069+0000 7f97f75ed640 1 -- 172.21.15.159:0/3699567066 >> 172.21.15.159:0/3699567066 conn(0x7f97f00b33c0 msgr2=0x7f97f00b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:29.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.069+0000 7f97f75ed640 1 -- 172.21.15.159:0/3699567066 shutdown_connections 2024-07-24T16:24:29.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.069+0000 7f97f75ed640 1 -- 172.21.15.159:0/3699567066 wait complete. 2024-07-24T16:24:29.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.070+0000 7f97f75ed640 1 Processor -- start 2024-07-24T16:24:29.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.070+0000 7f97f75ed640 1 -- start start 2024-07-24T16:24:29.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f75ed640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97d8004800 0x7f97f01f1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:29.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f75ed640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97f00c7040 0x7f97f0157ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:29.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f75ed640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97f01f4870 0x7f97f00c7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:29.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f75ed640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f97f0074130 con 0x7f97f01f4870 2024-07-24T16:24:29.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f75ed640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f97f0073fb0 con 0x7f97f00c7040 2024-07-24T16:24:29.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f75ed640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f97f00742b0 con 0x7f97d8004800 2024-07-24T16:24:29.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f5b8a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97f01f4870 0x7f97f00c7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:29.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f5389640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97d8004800 0x7f97f01f1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:29.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f5b8a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97f01f4870 0x7f97f00c7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60110/0 (socket says 172.21.15.159:60110) 2024-07-24T16:24:29.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f5b8a640 1 -- 172.21.15.159:0/662133305 learned_addr learned my addr 172.21.15.159:0/662133305 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:29.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f4b88640 1 --2- 172.21.15.159:0/662133305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97f00c7040 0x7f97f0157ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:29.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f5b8a640 1 -- 172.21.15.159:0/662133305 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97d8004800 msgr2=0x7f97f01f1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f5b8a640 1 --2- 172.21.15.159:0/662133305 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97d8004800 0x7f97f01f1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f5b8a640 1 -- 172.21.15.159:0/662133305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97f00c7040 msgr2=0x7f97f0157ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f5b8a640 1 --2- 172.21.15.159:0/662133305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97f00c7040 0x7f97f0157ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f5b8a640 1 -- 172.21.15.159:0/662133305 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f00c75b0 con 0x7f97f01f4870 2024-07-24T16:24:29.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f5b8a640 1 --2- 172.21.15.159:0/662133305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97f01f4870 0x7f97f00c7860 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f97f00b5d20 tx=0x7f97e8011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:29.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97edffb640 1 -- 172.21.15.159:0/662133305 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e8004230 con 0x7f97f01f4870 2024-07-24T16:24:29.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97edffb640 1 -- 172.21.15.159:0/662133305 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97e800f860 con 0x7f97f01f4870 2024-07-24T16:24:29.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.071+0000 7f97f75ed640 1 -- 172.21.15.159:0/662133305 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f0154c90 con 0x7f97f01f4870 2024-07-24T16:24:29.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.072+0000 7f97edffb640 1 -- 172.21.15.159:0/662133305 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e80044c0 con 0x7f97f01f4870 2024-07-24T16:24:29.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.072+0000 7f97f75ed640 1 -- 172.21.15.159:0/662133305 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f0155250 con 0x7f97f01f4870 2024-07-24T16:24:29.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.073+0000 7f97f75ed640 1 -- 172.21.15.159:0/662133305 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f015be60 con 0x7f97f01f4870 2024-07-24T16:24:29.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.073+0000 7f97edffb640 1 -- 172.21.15.159:0/662133305 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f97e800fcb0 con 0x7f97f01f4870 2024-07-24T16:24:29.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.074+0000 7f97edffb640 1 --2- 172.21.15.159:0/662133305 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f97dc077010 0x7f97dc0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:29.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.074+0000 7f97edffb640 1 -- 172.21.15.159:0/662133305 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f97e8099580 con 0x7f97f01f4870 2024-07-24T16:24:29.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.074+0000 7f97f5389640 1 --2- 172.21.15.159:0/662133305 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f97dc077010 0x7f97dc0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:29.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.074+0000 7f97f5389640 1 --2- 172.21.15.159:0/662133305 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f97dc077010 0x7f97dc0794d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f97e0004fd0 tx=0x7f97e0004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:29.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.078+0000 7f97edffb640 1 -- 172.21.15.159:0/662133305 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f97e8061f10 con 0x7f97f01f4870 2024-07-24T16:24:29.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.295+0000 7f97f75ed640 1 -- 172.21.15.159:0/662133305 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97f01f20b0 con 0x7f97f01f4870 2024-07-24T16:24:29.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.296+0000 7f97edffb640 1 -- 172.21.15.159:0/662133305 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f97e8066460 con 0x7f97f01f4870 2024-07-24T16:24:29.299 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:29.299 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":9,"btime":"2024-07-24T16:24:22:479106+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1307622320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1307622320},{"type":"v1","addr":"172.21.15.193:6837","nonce":1307622320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3191234203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3191234203},{"type":"v1","addr":"172.21.15.159:6833","nonce":3191234203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4336,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4102467909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":4102467909},{"type":"v1","addr":"172.21.15.159:6835","nonce":4102467909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:02.762268+0000","modified":"2024-07-24T16:24:21.842971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4348":{"gid":4348,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1274628948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1274628948},{"type":"v1","addr":"172.21.15.193:6836","nonce":1274628948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4348,"qdb_cluster":[4348]},"id":1}]} 2024-07-24T16:24:29.299 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 9 2024-07-24T16:24:29.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.298+0000 7f97f75ed640 1 -- 172.21.15.159:0/662133305 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f97dc077010 msgr2=0x7f97dc0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.298+0000 7f97f75ed640 1 --2- 172.21.15.159:0/662133305 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f97dc077010 0x7f97dc0794d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f97e0004fd0 tx=0x7f97e0004ab0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.298+0000 7f97f75ed640 1 -- 172.21.15.159:0/662133305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97f01f4870 msgr2=0x7f97f00c7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.298+0000 7f97f75ed640 1 --2- 172.21.15.159:0/662133305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97f01f4870 0x7f97f00c7860 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f97f00b5d20 tx=0x7f97e8011b10 comp rx=0 tx=0).stop 2024-07-24T16:24:29.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.298+0000 7f97f75ed640 1 -- 172.21.15.159:0/662133305 shutdown_connections 2024-07-24T16:24:29.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.298+0000 7f97f75ed640 1 --2- 172.21.15.159:0/662133305 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f97dc077010 0x7f97dc0794d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.298+0000 7f97f75ed640 1 --2- 172.21.15.159:0/662133305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97f01f4870 0x7f97f00c7860 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.298+0000 7f97f75ed640 1 --2- 172.21.15.159:0/662133305 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97f00c7040 0x7f97f0157ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.298+0000 7f97f75ed640 1 --2- 172.21.15.159:0/662133305 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97d8004800 0x7f97f01f1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.298+0000 7f97f75ed640 1 -- 172.21.15.159:0/662133305 >> 172.21.15.159:0/662133305 conn(0x7f97f00b33c0 msgr2=0x7f97f0159e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:29.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.298+0000 7f97f75ed640 1 -- 172.21.15.159:0/662133305 shutdown_connections 2024-07-24T16:24:29.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.298+0000 7f97f75ed640 1 -- 172.21.15.159:0/662133305 wait complete. 2024-07-24T16:24:29.312 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:24:29.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.413+0000 7fba76e5e640 1 -- 172.21.15.159:0/3824453484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba70157510 msgr2=0x7fba70159d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.413+0000 7fba76e5e640 1 --2- 172.21.15.159:0/3824453484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba70157510 0x7fba70159d80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fba6000b330 tx=0x7fba6002ac70 comp rx=0 tx=0).stop 2024-07-24T16:24:29.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.413+0000 7fba76e5e640 1 -- 172.21.15.159:0/3824453484 shutdown_connections 2024-07-24T16:24:29.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.413+0000 7fba76e5e640 1 --2- 172.21.15.159:0/3824453484 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba70157510 0x7fba70159d80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.413+0000 7fba76e5e640 1 -- 172.21.15.159:0/3824453484 >> 172.21.15.159:0/3824453484 conn(0x7fba7006c560 msgr2=0x7fba7006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:29.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.413+0000 7fba76e5e640 1 -- 172.21.15.159:0/3824453484 shutdown_connections 2024-07-24T16:24:29.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.413+0000 7fba76e5e640 1 -- 172.21.15.159:0/3824453484 wait complete. 2024-07-24T16:24:29.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.414+0000 7fba76e5e640 1 Processor -- start 2024-07-24T16:24:29.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.414+0000 7fba76e5e640 1 -- start start 2024-07-24T16:24:29.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba76e5e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba700cfc10 0x7fba70156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:29.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba76e5e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba70157130 0x7fba700ad6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:29.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba76e5e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba70157510 0x7fba700adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:29.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba76e5e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fba701429b0 con 0x7fba70157130 2024-07-24T16:24:29.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba76e5e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fba70142830 con 0x7fba70157510 2024-07-24T16:24:29.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba76e5e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fba70142b30 con 0x7fba700cfc10 2024-07-24T16:24:29.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba6ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba70157130 0x7fba700ad6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:29.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba6ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba70157130 0x7fba700ad6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60122/0 (socket says 172.21.15.159:60122) 2024-07-24T16:24:29.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba6ffff640 1 -- 172.21.15.159:0/1473343026 learned_addr learned my addr 172.21.15.159:0/1473343026 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:29.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba74bfa640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba700cfc10 0x7fba70156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:29.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba753fb640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba70157510 0x7fba700adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:29.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba6ffff640 1 -- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba700cfc10 msgr2=0x7fba70156010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba6ffff640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba700cfc10 0x7fba70156010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba6ffff640 1 -- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba70157510 msgr2=0x7fba700adbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba6ffff640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba70157510 0x7fba700adbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba6ffff640 1 -- 172.21.15.159:0/1473343026 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba701f1b90 con 0x7fba70157130 2024-07-24T16:24:29.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba6ffff640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba70157130 0x7fba700ad6a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fba60000c00 tx=0x7fba6002b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:29.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba6d7fa640 1 -- 172.21.15.159:0/1473343026 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba60042020 con 0x7fba70157130 2024-07-24T16:24:29.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba6d7fa640 1 -- 172.21.15.159:0/1473343026 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba600095a0 con 0x7fba70157130 2024-07-24T16:24:29.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba76e5e640 1 -- 172.21.15.159:0/1473343026 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba701f1e70 con 0x7fba70157130 2024-07-24T16:24:29.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba6d7fa640 1 -- 172.21.15.159:0/1473343026 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba60038040 con 0x7fba70157130 2024-07-24T16:24:29.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.415+0000 7fba76e5e640 1 -- 172.21.15.159:0/1473343026 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba701f2430 con 0x7fba70157130 2024-07-24T16:24:29.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.417+0000 7fba76e5e640 1 -- 172.21.15.159:0/1473343026 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba70143060 con 0x7fba70157130 2024-07-24T16:24:29.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.417+0000 7fba6d7fa640 1 -- 172.21.15.159:0/1473343026 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fba60045070 con 0x7fba70157130 2024-07-24T16:24:29.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.418+0000 7fba6d7fa640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fba50077010 0x7fba500794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:29.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.418+0000 7fba6d7fa640 1 -- 172.21.15.159:0/1473343026 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fba600b8a20 con 0x7fba70157130 2024-07-24T16:24:29.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.418+0000 7fba74bfa640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fba50077010 0x7fba500794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:29.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.418+0000 7fba74bfa640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fba50077010 0x7fba500794d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fba680012e0 tx=0x7fba68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:29.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.422+0000 7fba6d7fa640 1 -- 172.21.15.159:0/1473343026 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fba60081a00 con 0x7fba70157130 2024-07-24T16:24:29.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.641+0000 7fba76e5e640 1 -- 172.21.15.159:0/1473343026 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba7006f020 con 0x7fba70157130 2024-07-24T16:24:29.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.641+0000 7fba6d7fa640 1 -- 172.21.15.159:0/1473343026 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7fba60081300 con 0x7fba70157130 2024-07-24T16:24:29.644 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:29.644 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":9,"btime":"2024-07-24T16:24:22:479106+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1307622320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1307622320},{"type":"v1","addr":"172.21.15.193:6837","nonce":1307622320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3191234203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3191234203},{"type":"v1","addr":"172.21.15.159:6833","nonce":3191234203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4336,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4102467909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":4102467909},{"type":"v1","addr":"172.21.15.159:6835","nonce":4102467909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:02.762268+0000","modified":"2024-07-24T16:24:21.842971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4348":{"gid":4348,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1274628948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1274628948},{"type":"v1","addr":"172.21.15.193:6836","nonce":1274628948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4348,"qdb_cluster":[4348]},"id":1}]} 2024-07-24T16:24:29.644 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 9 2024-07-24T16:24:29.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.643+0000 7fba76e5e640 1 -- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fba50077010 msgr2=0x7fba500794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.643+0000 7fba76e5e640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fba50077010 0x7fba500794d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fba680012e0 tx=0x7fba68009040 comp rx=0 tx=0).stop 2024-07-24T16:24:29.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.643+0000 7fba76e5e640 1 -- 172.21.15.159:0/1473343026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba70157130 msgr2=0x7fba700ad6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.643+0000 7fba76e5e640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba70157130 0x7fba700ad6a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fba60000c00 tx=0x7fba6002b5b0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.643+0000 7fba76e5e640 1 -- 172.21.15.159:0/1473343026 shutdown_connections 2024-07-24T16:24:29.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.643+0000 7fba76e5e640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fba50077010 0x7fba500794d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.643+0000 7fba76e5e640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fba70157510 0x7fba700adbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.643+0000 7fba76e5e640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fba70157130 0x7fba700ad6a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.643+0000 7fba76e5e640 1 --2- 172.21.15.159:0/1473343026 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fba700cfc10 0x7fba70156010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.644+0000 7fba76e5e640 1 -- 172.21.15.159:0/1473343026 >> 172.21.15.159:0/1473343026 conn(0x7fba7006c560 msgr2=0x7fba700b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:29.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.644+0000 7fba76e5e640 1 -- 172.21.15.159:0/1473343026 shutdown_connections 2024-07-24T16:24:29.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.644+0000 7fba76e5e640 1 -- 172.21.15.159:0/1473343026 wait complete. 2024-07-24T16:24:29.657 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:29.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.758+0000 7f685364e640 1 -- 172.21.15.159:0/2818413136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68340039e0 msgr2=0x7f6834003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.758+0000 7f685364e640 1 --2- 172.21.15.159:0/2818413136 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68340039e0 0x7f6834003dc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f683c00c520 tx=0x7f6834005830 comp rx=0 tx=0).stop 2024-07-24T16:24:29.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.758+0000 7f6851beb640 1 -- 172.21.15.159:0/2818413136 reap_dead start 2024-07-24T16:24:29.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.758+0000 7f685364e640 1 -- 172.21.15.159:0/2818413136 shutdown_connections 2024-07-24T16:24:29.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.758+0000 7f685364e640 1 -- 172.21.15.159:0/2818413136 >> 172.21.15.159:0/2818413136 conn(0x7f684c09cd30 msgr2=0x7f684c0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:29.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.758+0000 7f685364e640 1 -- 172.21.15.159:0/2818413136 shutdown_connections 2024-07-24T16:24:29.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.758+0000 7f685364e640 1 -- 172.21.15.159:0/2818413136 wait complete. 2024-07-24T16:24:29.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.759+0000 7f685364e640 1 Processor -- start 2024-07-24T16:24:29.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.759+0000 7f685364e640 1 -- start start 2024-07-24T16:24:29.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f685364e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68340039e0 0x7f684c160a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:29.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f685364e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f684c0ccb70 0x7f684c0ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:29.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f685364e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f684c155b00 0x7f684c155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:29.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f685364e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f684c0d0b70 con 0x7f68340039e0 2024-07-24T16:24:29.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f685364e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f684c0d09f0 con 0x7f684c0ccb70 2024-07-24T16:24:29.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f685364e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f684c161f20 con 0x7f684c155b00 2024-07-24T16:24:29.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f68513ea640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68340039e0 0x7f684c160a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:29.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f68513ea640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68340039e0 0x7f684c160a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60134/0 (socket says 172.21.15.159:60134) 2024-07-24T16:24:29.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f68513ea640 1 -- 172.21.15.159:0/3090611299 learned_addr learned my addr 172.21.15.159:0/3090611299 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:29.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f6850be9640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f684c0ccb70 0x7f684c0ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:29.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f6851beb640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f684c155b00 0x7f684c155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:29.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f68513ea640 1 -- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f684c155b00 msgr2=0x7f684c155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f68513ea640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f684c155b00 0x7f684c155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f68513ea640 1 -- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f684c0ccb70 msgr2=0x7f684c0ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f68513ea640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f684c0ccb70 0x7f684c0ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f68513ea640 1 -- 172.21.15.159:0/3090611299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f684c0cd530 con 0x7f68340039e0 2024-07-24T16:24:29.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f68513ea640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68340039e0 0x7f684c160a70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f683c00c640 tx=0x7f683c001310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:29.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f6849ffb640 1 -- 172.21.15.159:0/3090611299 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c004e60 con 0x7f68340039e0 2024-07-24T16:24:29.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f6849ffb640 1 -- 172.21.15.159:0/3090611299 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f683c02bb00 con 0x7f68340039e0 2024-07-24T16:24:29.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f6849ffb640 1 -- 172.21.15.159:0/3090611299 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f683c006070 con 0x7f68340039e0 2024-07-24T16:24:29.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.760+0000 7f685364e640 1 -- 172.21.15.159:0/3090611299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684c15f330 con 0x7f68340039e0 2024-07-24T16:24:29.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.761+0000 7f685364e640 1 -- 172.21.15.159:0/3090611299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f684c15f8f0 con 0x7f68340039e0 2024-07-24T16:24:29.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.762+0000 7f685364e640 1 -- 172.21.15.159:0/3090611299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f684c0cfc20 con 0x7f68340039e0 2024-07-24T16:24:29.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.762+0000 7f6849ffb640 1 -- 172.21.15.159:0/3090611299 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f683c006210 con 0x7f68340039e0 2024-07-24T16:24:29.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.763+0000 7f6849ffb640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6838077010 0x7f68380794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:29.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.763+0000 7f6849ffb640 1 -- 172.21.15.159:0/3090611299 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f683c0b93b0 con 0x7f68340039e0 2024-07-24T16:24:29.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.763+0000 7f6850be9640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6838077010 0x7f68380794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:29.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.763+0000 7f6850be9640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6838077010 0x7f68380794d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f684c0cda30 tx=0x7f6840005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:29.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.767+0000 7f6849ffb640 1 -- 172.21.15.159:0/3090611299 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f683c082300 con 0x7f68340039e0 2024-07-24T16:24:29.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.953+0000 7f685364e640 1 -- 172.21.15.159:0/3090611299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f684c06cbe0 con 0x7f68340039e0 2024-07-24T16:24:29.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.954+0000 7f6849ffb640 1 -- 172.21.15.159:0/3090611299 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f683c081c00 con 0x7f68340039e0 2024-07-24T16:24:29.957 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:29.957 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:07.801757+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:00.757174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:01.708421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-24T16:24:05.423097+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:29.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.957+0000 7f685364e640 1 -- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6838077010 msgr2=0x7f68380794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.957+0000 7f685364e640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6838077010 0x7f68380794d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f684c0cda30 tx=0x7f6840005f90 comp rx=0 tx=0).stop 2024-07-24T16:24:29.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.957+0000 7f685364e640 1 -- 172.21.15.159:0/3090611299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68340039e0 msgr2=0x7f684c160a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:29.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.957+0000 7f685364e640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68340039e0 0x7f684c160a70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f683c00c640 tx=0x7f683c001310 comp rx=0 tx=0).stop 2024-07-24T16:24:29.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.957+0000 7f685364e640 1 -- 172.21.15.159:0/3090611299 shutdown_connections 2024-07-24T16:24:29.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.957+0000 7f685364e640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6838077010 0x7f68380794d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.957+0000 7f685364e640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f684c155b00 0x7f684c155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.957+0000 7f685364e640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f684c0ccb70 0x7f684c0ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.957+0000 7f685364e640 1 --2- 172.21.15.159:0/3090611299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f68340039e0 0x7f684c160a70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:29.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.957+0000 7f685364e640 1 -- 172.21.15.159:0/3090611299 >> 172.21.15.159:0/3090611299 conn(0x7f684c09cd30 msgr2=0x7f684c0b6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:29.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.957+0000 7f685364e640 1 -- 172.21.15.159:0/3090611299 shutdown_connections 2024-07-24T16:24:29.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:29.957+0000 7f685364e640 1 -- 172.21.15.159:0/3090611299 wait complete. 2024-07-24T16:24:29.971 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:24:30.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.071+0000 7f7203e31640 1 -- 172.21.15.159:0/2315599441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71fc15a220 msgr2=0x7f71fc0b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.071+0000 7f7203e31640 1 --2- 172.21.15.159:0/2315599441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71fc15a220 0x7f71fc0b58a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f71ec005fd0 tx=0x7f71ec02a7c0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.071+0000 7f7203e31640 1 -- 172.21.15.159:0/2315599441 shutdown_connections 2024-07-24T16:24:30.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.071+0000 7f7203e31640 1 --2- 172.21.15.159:0/2315599441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71fc15a220 0x7f71fc0b58a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.071+0000 7f7203e31640 1 -- 172.21.15.159:0/2315599441 >> 172.21.15.159:0/2315599441 conn(0x7f71fc071140 msgr2=0x7f71fc06d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:30.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.071+0000 7f7203e31640 1 -- 172.21.15.159:0/2315599441 shutdown_connections 2024-07-24T16:24:30.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.071+0000 7f7203e31640 1 -- 172.21.15.159:0/2315599441 wait complete. 2024-07-24T16:24:30.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.073+0000 7f7203e31640 1 Processor -- start 2024-07-24T16:24:30.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.073+0000 7f7203e31640 1 -- start start 2024-07-24T16:24:30.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.073+0000 7f7203e31640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71fc0b5de0 0x7f71fc13fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.073+0000 7f7203e31640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f71fc0ceb10 0x7f71fc1f1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.073+0000 7f7203e31640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71fc15a220 0x7f71fc153bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.073+0000 7f7203e31640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc06f660 con 0x7f71fc0b5de0 2024-07-24T16:24:30.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.073+0000 7f7203e31640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f71fc06f4e0 con 0x7f71fc15a220 2024-07-24T16:24:30.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.073+0000 7f7203e31640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f71fc06f7e0 con 0x7f71fc0ceb10 2024-07-24T16:24:30.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.073+0000 7f7201bcd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71fc0b5de0 0x7f71fc13fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.073+0000 7f7201bcd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71fc0b5de0 0x7f71fc13fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60156/0 (socket says 172.21.15.159:60156) 2024-07-24T16:24:30.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.073+0000 7f7201bcd640 1 -- 172.21.15.159:0/2914917006 learned_addr learned my addr 172.21.15.159:0/2914917006 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:30.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.074+0000 7f72023ce640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71fc15a220 0x7f71fc153bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.074+0000 7f72013cc640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f71fc0ceb10 0x7f71fc1f1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.074+0000 7f7201bcd640 1 -- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f71fc0ceb10 msgr2=0x7f71fc1f1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.074+0000 7f7201bcd640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f71fc0ceb10 0x7f71fc1f1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.074+0000 7f7201bcd640 1 -- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71fc15a220 msgr2=0x7f71fc153bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.074+0000 7f7201bcd640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71fc15a220 0x7f71fc153bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.074+0000 7f7201bcd640 1 -- 172.21.15.159:0/2914917006 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71fc140490 con 0x7f71fc0b5de0 2024-07-24T16:24:30.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.074+0000 7f7201bcd640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71fc0b5de0 0x7f71fc13fb90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71ec006010 tx=0x7f71ec032f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:30.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.074+0000 7f71fa7fc640 1 -- 172.21.15.159:0/2914917006 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec041020 con 0x7f71fc0b5de0 2024-07-24T16:24:30.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.074+0000 7f71fa7fc640 1 -- 172.21.15.159:0/2914917006 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f71ec004330 con 0x7f71fc0b5de0 2024-07-24T16:24:30.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.074+0000 7f7203e31640 1 -- 172.21.15.159:0/2914917006 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71fc140770 con 0x7f71fc0b5de0 2024-07-24T16:24:30.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.074+0000 7f71fa7fc640 1 -- 172.21.15.159:0/2914917006 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71ec036040 con 0x7f71fc0b5de0 2024-07-24T16:24:30.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.074+0000 7f7203e31640 1 -- 172.21.15.159:0/2914917006 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71fc1577d0 con 0x7f71fc0b5de0 2024-07-24T16:24:30.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.075+0000 7f7203e31640 1 -- 172.21.15.159:0/2914917006 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71fc0b58a0 con 0x7f71fc0b5de0 2024-07-24T16:24:30.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.076+0000 7f71fa7fc640 1 -- 172.21.15.159:0/2914917006 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f71ec044020 con 0x7f71fc0b5de0 2024-07-24T16:24:30.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.076+0000 7f71fa7fc640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f71e8077010 0x7f71e80794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.076+0000 7f71fa7fc640 1 -- 172.21.15.159:0/2914917006 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f71ec0b9b70 con 0x7f71fc0b5de0 2024-07-24T16:24:30.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.076+0000 7f72013cc640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f71e8077010 0x7f71e80794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.077+0000 7f72013cc640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f71e8077010 0x7f71e80794d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f71fc1e8040 tx=0x7f71f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:30.083 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.080+0000 7f71fa7fc640 1 -- 172.21.15.159:0/2914917006 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f71ec04b030 con 0x7f71fc0b5de0 2024-07-24T16:24:30.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.307+0000 7f7203e31640 1 -- 172.21.15.159:0/2914917006 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71fc0cd8c0 con 0x7f71fc0b5de0 2024-07-24T16:24:30.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.308+0000 7f71fa7fc640 1 -- 172.21.15.159:0/2914917006 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f71ec082b50 con 0x7f71fc0b5de0 2024-07-24T16:24:30.311 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:30.311 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":9,"btime":"2024-07-24T16:24:22:479106+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1307622320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1307622320},{"type":"v1","addr":"172.21.15.193:6837","nonce":1307622320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3191234203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3191234203},{"type":"v1","addr":"172.21.15.159:6833","nonce":3191234203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4336,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4102467909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":4102467909},{"type":"v1","addr":"172.21.15.159:6835","nonce":4102467909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:02.762268+0000","modified":"2024-07-24T16:24:21.842971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4348":{"gid":4348,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1274628948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1274628948},{"type":"v1","addr":"172.21.15.193:6836","nonce":1274628948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4348,"qdb_cluster":[4348]},"id":1}]} 2024-07-24T16:24:30.311 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 9 2024-07-24T16:24:30.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.310+0000 7f7203e31640 1 -- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f71e8077010 msgr2=0x7f71e80794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.310+0000 7f7203e31640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f71e8077010 0x7f71e80794d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f71fc1e8040 tx=0x7f71f0009040 comp rx=0 tx=0).stop 2024-07-24T16:24:30.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.310+0000 7f7203e31640 1 -- 172.21.15.159:0/2914917006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71fc0b5de0 msgr2=0x7f71fc13fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.310+0000 7f7203e31640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71fc0b5de0 0x7f71fc13fb90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f71ec006010 tx=0x7f71ec032f10 comp rx=0 tx=0).stop 2024-07-24T16:24:30.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.310+0000 7f7203e31640 1 -- 172.21.15.159:0/2914917006 shutdown_connections 2024-07-24T16:24:30.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.310+0000 7f7203e31640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f71e8077010 0x7f71e80794d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.310+0000 7f7203e31640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f71fc15a220 0x7f71fc153bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.310+0000 7f7203e31640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f71fc0ceb10 0x7f71fc1f1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.310+0000 7f7203e31640 1 --2- 172.21.15.159:0/2914917006 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f71fc0b5de0 0x7f71fc13fb90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.310+0000 7f7203e31640 1 -- 172.21.15.159:0/2914917006 >> 172.21.15.159:0/2914917006 conn(0x7f71fc071140 msgr2=0x7f71fc15a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:30.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.310+0000 7f7203e31640 1 -- 172.21.15.159:0/2914917006 shutdown_connections 2024-07-24T16:24:30.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.310+0000 7f7203e31640 1 -- 172.21.15.159:0/2914917006 wait complete. 2024-07-24T16:24:30.727 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-24T16:24:02.762268+0000', 'modified': '2024-07-24T16:24:21.842971+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4348}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4348': {'gid': 4348, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.193:6836/1274628948', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.193:6834', 'nonce': 1274628948}, {'type': 'v1', 'addr': '172.21.15.193:6836', 'nonce': 1274628948}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4348, 'qdb_cluster': [4348]} 2024-07-24T16:24:30.728 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-07-24T16:24:30.728 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-07-24T16:24:30.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.831+0000 7ffb15afd640 1 -- 172.21.15.159:0/1570270305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb100cf840 msgr2=0x7ffb100cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.831+0000 7ffb15afd640 1 --2- 172.21.15.159:0/1570270305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb100cf840 0x7ffb100cca20 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb04005fd0 tx=0x7ffb0402a4a0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.831+0000 7ffb15afd640 1 -- 172.21.15.159:0/1570270305 shutdown_connections 2024-07-24T16:24:30.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.831+0000 7ffb15afd640 1 --2- 172.21.15.159:0/1570270305 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb100cf840 0x7ffb100cca20 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.831+0000 7ffb15afd640 1 --2- 172.21.15.159:0/1570270305 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffb101524f0 0x7ffb100af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.831+0000 7ffb15afd640 1 -- 172.21.15.159:0/1570270305 >> 172.21.15.159:0/1570270305 conn(0x7ffb1006d450 msgr2=0x7ffb1006d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:30.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.831+0000 7ffb15afd640 1 -- 172.21.15.159:0/1570270305 shutdown_connections 2024-07-24T16:24:30.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.831+0000 7ffb15afd640 1 -- 172.21.15.159:0/1570270305 wait complete. 2024-07-24T16:24:30.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.832+0000 7ffb15afd640 1 Processor -- start 2024-07-24T16:24:30.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.832+0000 7ffb15afd640 1 -- start start 2024-07-24T16:24:30.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.833+0000 7ffb15afd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb100ccf60 0x7ffb101587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.833+0000 7ffb15afd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb100cf840 0x7ffb101f4110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.833+0000 7ffb15afd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffb101524f0 0x7ffb100ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.833+0000 7ffb15afd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1015cc60 con 0x7ffb100cf840 2024-07-24T16:24:30.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.833+0000 7ffb15afd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1015cae0 con 0x7ffb100ccf60 2024-07-24T16:24:30.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.833+0000 7ffb15afd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1015f6d0 con 0x7ffb101524f0 2024-07-24T16:24:30.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.833+0000 7ffb0effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb100cf840 0x7ffb101f4110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.833+0000 7ffb0effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb100cf840 0x7ffb101f4110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60170/0 (socket says 172.21.15.159:60170) 2024-07-24T16:24:30.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.833+0000 7ffb0effd640 1 -- 172.21.15.159:0/449223873 learned_addr learned my addr 172.21.15.159:0/449223873 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:30.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.834+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb100ccf60 0x7ffb101587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.834+0000 7ffb0ffff640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffb101524f0 0x7ffb100ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.834+0000 7ffb0effd640 1 -- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffb101524f0 msgr2=0x7ffb100ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.834+0000 7ffb0effd640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffb101524f0 0x7ffb100ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.834+0000 7ffb0effd640 1 -- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb100ccf60 msgr2=0x7ffb101587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.834+0000 7ffb0effd640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb100ccf60 0x7ffb101587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.834+0000 7ffb0effd640 1 -- 172.21.15.159:0/449223873 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb101f4bc0 con 0x7ffb100cf840 2024-07-24T16:24:30.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.834+0000 7ffb0effd640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb100cf840 0x7ffb101f4110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009850 tx=0x7ffb040039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:30.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.834+0000 7ffaf7fff640 1 -- 172.21.15.159:0/449223873 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0403f070 con 0x7ffb100cf840 2024-07-24T16:24:30.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.834+0000 7ffaf7fff640 1 -- 172.21.15.159:0/449223873 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb04004890 con 0x7ffb100cf840 2024-07-24T16:24:30.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.834+0000 7ffb15afd640 1 -- 172.21.15.159:0/449223873 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb101f4ea0 con 0x7ffb100cf840 2024-07-24T16:24:30.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.834+0000 7ffaf7fff640 1 -- 172.21.15.159:0/449223873 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb04035030 con 0x7ffb100cf840 2024-07-24T16:24:30.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.834+0000 7ffb15afd640 1 -- 172.21.15.159:0/449223873 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb101582b0 con 0x7ffb100cf840 2024-07-24T16:24:30.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.836+0000 7ffaf7fff640 1 -- 172.21.15.159:0/449223873 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ffb04042070 con 0x7ffb100cf840 2024-07-24T16:24:30.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.836+0000 7ffaf7fff640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ffafc077010 0x7ffafc0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.836+0000 7ffaf7fff640 1 -- 172.21.15.159:0/449223873 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ffb040b9a70 con 0x7ffb100cf840 2024-07-24T16:24:30.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.836+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ffafc077010 0x7ffafc0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.837+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ffafc077010 0x7ffafc0794d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009f20 tx=0x7ffb000094f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:30.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.837+0000 7ffb18853740 1 Processor -- start 2024-07-24T16:24:30.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.837+0000 7ffb18853740 1 -- start start 2024-07-24T16:24:30.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb18853740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dccdf6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb18853740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dcce082c0 0x564dccdf2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb18853740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dccdcde30 0x564dccdf2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb18853740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564dccd3f270 con 0x564dccdf68a0 2024-07-24T16:24:30.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb18853740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564dccd2e770 con 0x564dccdcde30 2024-07-24T16:24:30.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb18853740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x564dccd327b0 con 0x564dcce082c0 2024-07-24T16:24:30.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb0f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dccdf6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb0f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dccdf6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60176/0 (socket says 172.21.15.159:60176) 2024-07-24T16:24:30.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb0f7fe640 1 -- 172.21.15.159:0/4108989904 learned_addr learned my addr 172.21.15.159:0/4108989904 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:30.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb0effd640 1 --2- 172.21.15.159:0/4108989904 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dcce082c0 0x564dccdf2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb0ffff640 1 --2- 172.21.15.159:0/4108989904 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dccdcde30 0x564dccdf2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb0f7fe640 1 -- 172.21.15.159:0/4108989904 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dcce082c0 msgr2=0x564dccdf2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:30.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/4108989904 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dcce082c0 0x564dccdf2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb0f7fe640 1 -- 172.21.15.159:0/4108989904 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dccdcde30 msgr2=0x564dccdf2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:30.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/4108989904 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dccdcde30 0x564dccdf2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb0f7fe640 1 -- 172.21.15.159:0/4108989904 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dcccdbe20 con 0x564dccdf68a0 2024-07-24T16:24:30.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/4108989904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dccdf6c80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb00017770 tx=0x7ffb00011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d78141c1700673fa server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:30.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffaf57fa640 1 -- 172.21.15.159:0/4108989904 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00027070 con 0x564dccdf68a0 2024-07-24T16:24:30.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffaf57fa640 1 -- 172.21.15.159:0/4108989904 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb00017e20 con 0x564dccdf68a0 2024-07-24T16:24:30.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.838+0000 7ffaf57fa640 1 -- 172.21.15.159:0/4108989904 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00022420 con 0x564dccdf68a0 2024-07-24T16:24:30.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.839+0000 7ffb18853740 1 -- 172.21.15.159:0/4108989904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 msgr2=0x564dccdf6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.839+0000 7ffb18853740 1 --2- 172.21.15.159:0/4108989904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dccdf6c80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb00017770 tx=0x7ffb00011000 comp rx=0 tx=0).stop 2024-07-24T16:24:30.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.839+0000 7ffb18853740 1 -- 172.21.15.159:0/4108989904 shutdown_connections 2024-07-24T16:24:30.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.839+0000 7ffb18853740 1 --2- 172.21.15.159:0/4108989904 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dccdcde30 0x564dccdf2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.839+0000 7ffb18853740 1 --2- 172.21.15.159:0/4108989904 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dcce082c0 0x564dccdf2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.839+0000 7ffb18853740 1 --2- 172.21.15.159:0/4108989904 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dccdf6c80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.839+0000 7ffb18853740 1 -- 172.21.15.159:0/4108989904 >> 172.21.15.159:0/4108989904 conn(0x564dccdc8e80 msgr2=0x564dccdcc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:30.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.839+0000 7ffb18853740 1 -- 172.21.15.159:0/4108989904 shutdown_connections 2024-07-24T16:24:30.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.839+0000 7ffb18853740 1 -- 172.21.15.159:0/4108989904 wait complete. 2024-07-24T16:24:30.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.840+0000 7ffb18853740 1 -- start start 2024-07-24T16:24:30.849 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.840+0000 7ffb18853740 1 Processor -- start 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb18853740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dccdefeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb18853740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 0x564dccdecec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb18853740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf56a0 0x564dccdf5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb18853740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564dccaa1620 con 0x564dccdf68a0 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb18853740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x564dcccb6840 con 0x564dcce082c0 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb18853740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x564dccdf7380 con 0x564dccdf56a0 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb18853740 10 client.0 _ll_register_callbacks cb 0x564dccd275b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb0f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dccdefeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb0f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dccdefeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60186/0 (socket says 172.21.15.159:60186) 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb0f7fe640 1 -- 172.21.15.159:0/4287236582 learned_addr learned my addr 172.21.15.159:0/4287236582 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb0effd640 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 0x564dccdecec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb0ffff640 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf56a0 0x564dccdf5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb0f7fe640 1 -- 172.21.15.159:0/4287236582 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf56a0 msgr2=0x564dccdf5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:30.850 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf56a0 0x564dccdf5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb0f7fe640 1 -- 172.21.15.159:0/4287236582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 msgr2=0x564dccdecec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:30.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 0x564dccdecec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb0f7fe640 1 -- 172.21.15.159:0/4287236582 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dcca92850 con 0x564dccdf68a0 2024-07-24T16:24:30.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb0ffff640 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf56a0 0x564dccdf5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:30.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dccdefeb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009810 tx=0x7ffb000227e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed53cdc87ca16c2 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:30.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffaee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-07-24T16:24:30.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffaee7fc640 1 -- 172.21.15.159:0/4287236582 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00027040 con 0x564dccdf68a0 2024-07-24T16:24:30.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffaee7fc640 1 -- 172.21.15.159:0/4287236582 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ffb00022850 con 0x564dccdf68a0 2024-07-24T16:24:30.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb18853740 1 -- 172.21.15.159:0/4287236582 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb00017e20 con 0x564dccdf68a0 2024-07-24T16:24:30.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffaee7fc640 1 -- 172.21.15.159:0/4287236582 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ffb00039050 con 0x564dccdf68a0 2024-07-24T16:24:30.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb18853740 10 client.4794 fetch_fsmap learned FSMap version 9 2024-07-24T16:24:30.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.841+0000 7ffb18853740 1 -- 172.21.15.159:0/4287236582 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x564dccb096b0 con 0x564dccdf68a0 2024-07-24T16:24:30.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.842+0000 7ffaee7fc640 1 -- 172.21.15.159:0/4287236582 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb00017e20 con 0x564dccdf68a0 2024-07-24T16:24:30.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.842+0000 7ffaee7fc640 1 -- 172.21.15.159:0/4287236582 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7ffb0003c020 con 0x564dccdf68a0 2024-07-24T16:24:30.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.842+0000 7ffb18853740 10 client.4794 fetch_fsmap finished waiting for FSMap version 9 2024-07-24T16:24:30.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.842+0000 7ffb18853740 10 client.4794 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-24T16:24:30.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.842+0000 7ffb18853740 20 client.4794 populate_metadata read hostname 'smithi159' 2024-07-24T16:24:30.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.842+0000 7ffb18853740 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x564dccdf2220 0x564dccdf2600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.852 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.842+0000 7ffb18853740 4 client.4794 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T16:24:30.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.842+0000 7ffb18853740 1 -- 172.21.15.159:0/4287236582 --> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564dccd411c0 con 0x564dccdf2220 2024-07-24T16:24:30.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.842+0000 7ffb0effd640 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x564dccdf2220 0x564dccdf2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.842+0000 7ffb0effd640 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x564dccdf2220 0x564dccdf2600 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c2fac2d8ae36c37 server_cookie=debd2f1031c8813c in_seq=0 out_seq=0 2024-07-24T16:24:30.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.842+0000 7ffaee7fc640 10 client.4794 ms_handle_connect on v2:172.21.15.193:6834/1274628948 2024-07-24T16:24:30.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffaee7fc640 1 -- 172.21.15.159:0/4287236582 <== mds.0 v2:172.21.15.193:6834/1274628948 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564dccd411c0 con 0x564dccdf2220 2024-07-24T16:24:30.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffaee7fc640 10 client.4794 handle_command_reply: tid=0 2024-07-24T16:24:30.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffb18853740 1 client.4794 shutdown 2024-07-24T16:24:30.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffb18853740 1 -- 172.21.15.159:0/4287236582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 msgr2=0x564dccdefeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffb18853740 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dccdefeb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009810 tx=0x7ffb000227e0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffb18853740 1 -- 172.21.15.159:0/4287236582 shutdown_connections 2024-07-24T16:24:30.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffb18853740 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x564dccdf2220 0x564dccdf2600 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.853 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffb18853740 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf56a0 0x564dccdf5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffaee7fc640 0 client.4794 ms_handle_reset on v2:172.21.15.193:6834/1274628948 2024-07-24T16:24:30.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffb18853740 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 0x564dccdecec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffb18853740 1 --2- 172.21.15.159:0/4287236582 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dccdefeb0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffb18853740 1 -- 172.21.15.159:0/4287236582 >> 172.21.15.159:0/4287236582 conn(0x564dccdcde30 msgr2=0x564dccdf3e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:30.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffb18853740 1 -- 172.21.15.159:0/4287236582 shutdown_connections 2024-07-24T16:24:30.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffb18853740 1 -- 172.21.15.159:0/4287236582 wait complete. 2024-07-24T16:24:30.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.843+0000 7ffb18853740 20 client.4794 trim_cache size 0 max 16384 2024-07-24T16:24:30.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.862+0000 7ffb18853740 1 Processor -- start 2024-07-24T16:24:30.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.862+0000 7ffb18853740 1 -- start start 2024-07-24T16:24:30.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb18853740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf56a0 0x564dcce35d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.867 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb18853740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dcce0b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb18853740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 0x564dccdef5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb18853740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ffb10201f30 con 0x564dccdf68a0 2024-07-24T16:24:30.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb18853740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffb10200f90 con 0x564dcce082c0 2024-07-24T16:24:30.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb18853740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ffb10072a50 con 0x564dccdf56a0 2024-07-24T16:24:30.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb0effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dcce0b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb0effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dcce0b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60196/0 (socket says 172.21.15.159:60196) 2024-07-24T16:24:30.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb0effd640 1 -- 172.21.15.159:0/1291984201 learned_addr learned my addr 172.21.15.159:0/1291984201 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:30.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb0ffff640 1 --2- 172.21.15.159:0/1291984201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 0x564dccdef5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb0effd640 1 -- 172.21.15.159:0/1291984201 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf56a0 msgr2=0x564dcce35d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:30.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/1291984201 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf56a0 0x564dcce35d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb0effd640 1 --2- 172.21.15.159:0/1291984201 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf56a0 0x564dcce35d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb0effd640 1 -- 172.21.15.159:0/1291984201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 msgr2=0x564dccdef5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:30.868 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb0effd640 1 --2- 172.21.15.159:0/1291984201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 0x564dccdef5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb0effd640 1 -- 172.21.15.159:0/1291984201 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564dccdc2e80 con 0x564dccdf68a0 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb0ffff640 1 --2- 172.21.15.159:0/1291984201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 0x564dccdef5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.863+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/1291984201 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf56a0 0x564dcce35d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.864+0000 7ffb0effd640 1 --2- 172.21.15.159:0/1291984201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dcce0b400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb04082050 tx=0x7ffb040b7bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b51d9ffe03720064 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.864+0000 7ffaf4ff9640 1 -- 172.21.15.159:0/1291984201 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb040b5070 con 0x564dccdf68a0 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.864+0000 7ffaf4ff9640 1 -- 172.21.15.159:0/1291984201 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb04082a50 con 0x564dccdf68a0 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.864+0000 7ffaf4ff9640 1 -- 172.21.15.159:0/1291984201 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb04049040 con 0x564dccdf68a0 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.864+0000 7ffb18853740 1 -- 172.21.15.159:0/1291984201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 msgr2=0x564dcce0b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.864+0000 7ffb18853740 1 --2- 172.21.15.159:0/1291984201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dcce0b400 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb04082050 tx=0x7ffb040b7bc0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.864+0000 7ffb18853740 1 -- 172.21.15.159:0/1291984201 shutdown_connections 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.864+0000 7ffb18853740 1 --2- 172.21.15.159:0/1291984201 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 0x564dccdef5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.864+0000 7ffb18853740 1 --2- 172.21.15.159:0/1291984201 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf68a0 0x564dcce0b400 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.864+0000 7ffb18853740 1 --2- 172.21.15.159:0/1291984201 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf56a0 0x564dcce35d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.864+0000 7ffb18853740 1 -- 172.21.15.159:0/1291984201 >> 172.21.15.159:0/1291984201 conn(0x564dccdcde30 msgr2=0x564dccdf3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:30.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.864+0000 7ffb18853740 1 -- 172.21.15.159:0/1291984201 shutdown_connections 2024-07-24T16:24:30.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.864+0000 7ffb18853740 1 -- 172.21.15.159:0/1291984201 wait complete. 2024-07-24T16:24:30.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.865+0000 7ffb18853740 1 -- start start 2024-07-24T16:24:30.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.865+0000 7ffb18853740 1 Processor -- start 2024-07-24T16:24:30.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb18853740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf56a0 0x564dcce93f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb18853740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf68a0 0x564dcce75e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb18853740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 0x564dcce909a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb18853740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x564dcce25fa0 con 0x564dccdf56a0 2024-07-24T16:24:30.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb18853740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ffb10200b00 con 0x564dcce082c0 2024-07-24T16:24:30.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb18853740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x564dcce25950 con 0x564dccdf68a0 2024-07-24T16:24:30.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb18853740 10 client.0 _ll_register_callbacks cb 0x7ffb00025070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T16:24:30.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb0f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf56a0 0x564dcce93f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb0f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf56a0 0x564dcce93f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60200/0 (socket says 172.21.15.159:60200) 2024-07-24T16:24:30.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb0f7fe640 1 -- 172.21.15.159:0/4152944842 learned_addr learned my addr 172.21.15.159:0/4152944842 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:30.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb0effd640 1 --2- 172.21.15.159:0/4152944842 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf68a0 0x564dcce75e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb0ffff640 1 --2- 172.21.15.159:0/4152944842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 0x564dcce909a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb0f7fe640 1 -- 172.21.15.159:0/4152944842 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf68a0 msgr2=0x564dcce75e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:30.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/4152944842 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf68a0 0x564dcce75e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb0f7fe640 1 -- 172.21.15.159:0/4152944842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 msgr2=0x564dcce909a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:24:30.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/4152944842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 0x564dcce909a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb0f7fe640 1 -- 172.21.15.159:0/4152944842 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564dcce0b560 con 0x564dccdf56a0 2024-07-24T16:24:30.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffb0f7fe640 1 --2- 172.21.15.159:0/4152944842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf56a0 0x564dcce93f50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffb00034520 tx=0x7ffb00034550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db968e0a04379e9f server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:30.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.866+0000 7ffaee7fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-07-24T16:24:30.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffaee7fc640 1 -- 172.21.15.159:0/4152944842 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00027040 con 0x564dccdf56a0 2024-07-24T16:24:30.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffaee7fc640 1 -- 172.21.15.159:0/4152944842 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7ffb00022850 con 0x564dccdf56a0 2024-07-24T16:24:30.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffb18853740 1 -- 172.21.15.159:0/4152944842 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb04082a50 con 0x564dccdf56a0 2024-07-24T16:24:30.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffaee7fc640 1 -- 172.21.15.159:0/4152944842 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7ffb00049050 con 0x564dccdf56a0 2024-07-24T16:24:30.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffb18853740 10 client.4800 fetch_fsmap learned FSMap version 9 2024-07-24T16:24:30.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffb18853740 1 -- 172.21.15.159:0/4152944842 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x564dcce901a0 con 0x564dccdf56a0 2024-07-24T16:24:30.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffaee7fc640 1 -- 172.21.15.159:0/4152944842 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb04082a50 con 0x564dccdf56a0 2024-07-24T16:24:30.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffaee7fc640 1 -- 172.21.15.159:0/4152944842 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 9) ==== 3510+0+0 (secure 0 0 0) 0x7ffb0004c020 con 0x564dccdf56a0 2024-07-24T16:24:30.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffb18853740 10 client.4800 fetch_fsmap finished waiting for FSMap version 9 2024-07-24T16:24:30.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffb18853740 10 client.4800 resolve_mds: resolved name 'b' to daemon mds.b 2024-07-24T16:24:30.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffb18853740 20 client.4800 populate_metadata read hostname 'smithi159' 2024-07-24T16:24:30.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffb18853740 1 --2- 172.21.15.159:0/4152944842 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x564dcce140d0 0x564dccdc7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:30.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffb18853740 4 client.4800 mds_command: new command op to 4348 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-24T16:24:30.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffb18853740 1 -- 172.21.15.159:0/4152944842 --> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] -- command(tid 0: {"prefix": "status"}) -- 0x564dccd3cc60 con 0x564dcce140d0 2024-07-24T16:24:30.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.867+0000 7ffb0effd640 1 --2- 172.21.15.159:0/4152944842 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x564dcce140d0 0x564dccdc7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:30.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffaee7fc640 10 client.4800 ms_handle_connect on v2:172.21.15.193:6834/1274628948 2024-07-24T16:24:30.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffb0effd640 1 --2- 172.21.15.159:0/4152944842 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x564dcce140d0 0x564dccdc7520 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d91ae37f04332ee5 server_cookie=8aab5dc7c6888bf3 in_seq=0 out_seq=0 2024-07-24T16:24:30.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffaee7fc640 1 -- 172.21.15.159:0/4152944842 <== mds.0 v2:172.21.15.193:6834/1274628948 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x564dccd3cc60 con 0x564dcce140d0 2024-07-24T16:24:30.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffaee7fc640 10 client.4800 handle_command_reply: tid=0 2024-07-24T16:24:30.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffb18853740 1 client.4800 shutdown 2024-07-24T16:24:30.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffb18853740 1 -- 172.21.15.159:0/4152944842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf56a0 msgr2=0x564dcce93f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffb18853740 1 --2- 172.21.15.159:0/4152944842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf56a0 0x564dcce93f50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffb00034520 tx=0x7ffb00034550 comp rx=0 tx=0).stop 2024-07-24T16:24:30.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffb18853740 1 -- 172.21.15.159:0/4152944842 shutdown_connections 2024-07-24T16:24:30.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffb18853740 1 --2- 172.21.15.159:0/4152944842 >> [v2:172.21.15.193:6834/1274628948,v1:172.21.15.193:6836/1274628948] conn(0x564dcce140d0 0x564dccdc7520 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffb18853740 1 --2- 172.21.15.159:0/4152944842 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x564dcce082c0 0x564dcce909a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffb18853740 1 --2- 172.21.15.159:0/4152944842 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x564dccdf68a0 0x564dcce75e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffaee7fc640 0 client.4800 ms_handle_reset on v2:172.21.15.193:6834/1274628948 2024-07-24T16:24:30.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffb18853740 1 --2- 172.21.15.159:0/4152944842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x564dccdf56a0 0x564dcce93f50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffb18853740 1 -- 172.21.15.159:0/4152944842 >> 172.21.15.159:0/4152944842 conn(0x564dccdcde30 msgr2=0x564dccdf5c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:30.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffb18853740 1 -- 172.21.15.159:0/4152944842 shutdown_connections 2024-07-24T16:24:30.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffb18853740 1 -- 172.21.15.159:0/4152944842 wait complete. 2024-07-24T16:24:30.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.868+0000 7ffb18853740 20 client.4800 trim_cache size 0 max 16384 2024-07-24T16:24:30.878 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:24:30.878 INFO:teuthology.orchestra.run.smithi159.stdout: "cluster_fsid": "15e9c2b9-79b9-45cf-833e-5ce98c29c7f6", 2024-07-24T16:24:30.878 INFO:teuthology.orchestra.run.smithi159.stdout: "whoami": 0, 2024-07-24T16:24:30.878 INFO:teuthology.orchestra.run.smithi159.stdout: "id": 4348, 2024-07-24T16:24:30.878 INFO:teuthology.orchestra.run.smithi159.stdout: "want_state": "up:active", 2024-07-24T16:24:30.878 INFO:teuthology.orchestra.run.smithi159.stdout: "state": "up:active", 2024-07-24T16:24:30.878 INFO:teuthology.orchestra.run.smithi159.stdout: "fs_name": "cephfs", 2024-07-24T16:24:30.878 INFO:teuthology.orchestra.run.smithi159.stdout: "rank_uptime": 27.471239106999999, 2024-07-24T16:24:30.879 INFO:teuthology.orchestra.run.smithi159.stdout: "mdsmap_epoch": 9, 2024-07-24T16:24:30.879 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch": 24, 2024-07-24T16:24:30.879 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch_barrier": 24, 2024-07-24T16:24:30.879 INFO:teuthology.orchestra.run.smithi159.stdout: "uptime": 33.353661842999998 2024-07-24T16:24:30.879 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:24:30.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.869+0000 7ffb15afd640 1 -- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ffafc077010 msgr2=0x7ffafc0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.869+0000 7ffb15afd640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ffafc077010 0x7ffafc0794d0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009f20 tx=0x7ffb000094f0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.869+0000 7ffb15afd640 1 -- 172.21.15.159:0/449223873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb100cf840 msgr2=0x7ffb101f4110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:30.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.869+0000 7ffb15afd640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb100cf840 0x7ffb101f4110 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009850 tx=0x7ffb040039e0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.869+0000 7ffb15afd640 1 -- 172.21.15.159:0/449223873 shutdown_connections 2024-07-24T16:24:30.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.869+0000 7ffb15afd640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ffafc077010 0x7ffafc0794d0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.869+0000 7ffb15afd640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ffb101524f0 0x7ffb100ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.869+0000 7ffb15afd640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ffb100cf840 0x7ffb101f4110 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.869+0000 7ffb15afd640 1 --2- 172.21.15.159:0/449223873 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ffb100ccf60 0x7ffb101587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:30.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.869+0000 7ffb15afd640 1 -- 172.21.15.159:0/449223873 >> 172.21.15.159:0/449223873 conn(0x7ffb1006d450 msgr2=0x7ffb1006d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:30.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.869+0000 7ffb15afd640 1 -- 172.21.15.159:0/449223873 shutdown_connections 2024-07-24T16:24:30.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:30.869+0000 7ffb15afd640 1 -- 172.21.15.159:0/449223873 wait complete. 2024-07-24T16:24:30.882 INFO:teuthology.run_tasks:Running task sequential... 2024-07-24T16:24:30.892 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-07-24T16:24:30.892 INFO:teuthology.task.sequential:In sequential, running task print... 2024-07-24T16:24:30.892 INFO:teuthology.task.print:Enabling mgr modules 2024-07-24T16:24:30.892 INFO:teuthology.run_tasks:Running task kclient... 2024-07-24T16:24:30.904 INFO:tasks.kclient:Mounting kernel clients... 2024-07-24T16:24:30.904 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-07-24T16:24:30.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:30.905 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-07-24T16:24:30.920 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-07-24T16:24:30.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:30.920 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-07-24T16:24:30.985 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:30.985 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2024-07-24T16:24:31.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:31.089 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-07-24T16:24:31.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:31.104 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2024-07-24T16:24:31.173 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2024-07-24T16:24:31.174 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T16:24:31.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:31.175 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-07-24T16:24:31.194 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:31.195 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link delete ceph-brx 2024-07-24T16:24:31.267 INFO:teuthology.orchestra.run.smithi193.stderr:Cannot find device "ceph-brx" 2024-07-24T16:24:31.268 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T16:24:31.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:31.269 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-07-24T16:24:31.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:31.328 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link delete ceph-brx 2024-07-24T16:24:31.398 INFO:teuthology.orchestra.run.smithi193.stderr:Cannot find device "ceph-brx" 2024-07-24T16:24:31.399 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T16:24:31.400 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-07-24T16:24:31.400 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-07-24T16:24:31.400 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-24T16:24:31.400 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-24T16:24:31.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.503+0000 7fa455bb1640 1 -- 172.21.15.159:0/144520277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4500b3e20 msgr2=0x7fa4500cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:31.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.503+0000 7fa455bb1640 1 --2- 172.21.15.159:0/144520277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4500b3e20 0x7fa4500cbc10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa448009be0 tx=0x7fa44802a960 comp rx=0 tx=0).stop 2024-07-24T16:24:31.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.503+0000 7fa455bb1640 1 -- 172.21.15.159:0/144520277 shutdown_connections 2024-07-24T16:24:31.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.503+0000 7fa455bb1640 1 --2- 172.21.15.159:0/144520277 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4500b3e20 0x7fa4500cbc10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:31.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.503+0000 7fa455bb1640 1 -- 172.21.15.159:0/144520277 >> 172.21.15.159:0/144520277 conn(0x7fa45006c560 msgr2=0x7fa45006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:31.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.503+0000 7fa455bb1640 1 -- 172.21.15.159:0/144520277 shutdown_connections 2024-07-24T16:24:31.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.503+0000 7fa455bb1640 1 -- 172.21.15.159:0/144520277 wait complete. 2024-07-24T16:24:31.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.504+0000 7fa455bb1640 1 Processor -- start 2024-07-24T16:24:31.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.505+0000 7fa455bb1640 1 -- start start 2024-07-24T16:24:31.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.505+0000 7fa455bb1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa45006dba0 0x7fa4501f2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:31.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.505+0000 7fa455bb1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4500b3e20 0x7fa4501f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:31.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.505+0000 7fa455bb1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4500cf770 0x7fa4500ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:31.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.505+0000 7fa455bb1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa4500aef70 con 0x7fa4500cf770 2024-07-24T16:24:31.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.505+0000 7fa455bb1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa4500aedf0 con 0x7fa4500b3e20 2024-07-24T16:24:31.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.505+0000 7fa455bb1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa45015b4b0 con 0x7fa45006dba0 2024-07-24T16:24:31.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.505+0000 7fa44ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4500cf770 0x7fa4500ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:31.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.505+0000 7fa44ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4500cf770 0x7fa4500ab560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43392/0 (socket says 172.21.15.159:43392) 2024-07-24T16:24:31.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.505+0000 7fa44ffff640 1 -- 172.21.15.159:0/1906591700 learned_addr learned my addr 172.21.15.159:0/1906591700 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:31.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.506+0000 7fa446ffd640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4500b3e20 0x7fa4501f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:31.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.506+0000 7fa44f7fe640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa45006dba0 0x7fa4501f2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:31.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.506+0000 7fa44ffff640 1 -- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa45006dba0 msgr2=0x7fa4501f2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:31.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.506+0000 7fa44ffff640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa45006dba0 0x7fa4501f2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:31.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.506+0000 7fa44ffff640 1 -- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4500b3e20 msgr2=0x7fa4501f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:31.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.506+0000 7fa44ffff640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4500b3e20 0x7fa4501f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:31.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.506+0000 7fa44ffff640 1 -- 172.21.15.159:0/1906591700 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4501f5860 con 0x7fa4500cf770 2024-07-24T16:24:31.614 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.506+0000 7fa44ffff640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4500cf770 0x7fa4500ab560 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa448009be0 tx=0x7fa448003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:31.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.506+0000 7fa44cff9640 1 -- 172.21.15.159:0/1906591700 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa448004240 con 0x7fa4500cf770 2024-07-24T16:24:31.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.506+0000 7fa44cff9640 1 -- 172.21.15.159:0/1906591700 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4480043e0 con 0x7fa4500cf770 2024-07-24T16:24:31.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.506+0000 7fa455bb1640 1 -- 172.21.15.159:0/1906591700 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4500a9480 con 0x7fa4500cf770 2024-07-24T16:24:31.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.506+0000 7fa44cff9640 1 -- 172.21.15.159:0/1906591700 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4480047d0 con 0x7fa4500cf770 2024-07-24T16:24:31.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.506+0000 7fa455bb1640 1 -- 172.21.15.159:0/1906591700 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4501f5de0 con 0x7fa4500cf770 2024-07-24T16:24:31.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.507+0000 7fa455bb1640 1 -- 172.21.15.159:0/1906591700 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4500ae4d0 con 0x7fa4500cf770 2024-07-24T16:24:31.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.508+0000 7fa44cff9640 1 -- 172.21.15.159:0/1906591700 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fa44803a450 con 0x7fa4500cf770 2024-07-24T16:24:31.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.508+0000 7fa44cff9640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa430077010 0x7fa4300794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:31.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.508+0000 7fa44cff9640 1 -- 172.21.15.159:0/1906591700 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa4480ba7b0 con 0x7fa4500cf770 2024-07-24T16:24:31.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.508+0000 7fa44f7fe640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa430077010 0x7fa4300794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:31.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.509+0000 7fa44f7fe640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa430077010 0x7fa4300794d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa440000f60 tx=0x7fa440009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:31.615 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.512+0000 7fa44cff9640 1 -- 172.21.15.159:0/1906591700 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa44802d070 con 0x7fa4500cf770 2024-07-24T16:24:31.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.735+0000 7fa455bb1640 1 -- 172.21.15.159:0/1906591700 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa45015e130 con 0x7fa4500cf770 2024-07-24T16:24:31.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.735+0000 7fa44cff9640 1 -- 172.21.15.159:0/1906591700 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fa448083140 con 0x7fa4500cf770 2024-07-24T16:24:31.738 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-07-24T16:24:31.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.737+0000 7fa455bb1640 1 -- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa430077010 msgr2=0x7fa4300794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:31.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.737+0000 7fa455bb1640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa430077010 0x7fa4300794d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fa440000f60 tx=0x7fa440009040 comp rx=0 tx=0).stop 2024-07-24T16:24:31.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.737+0000 7fa455bb1640 1 -- 172.21.15.159:0/1906591700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4500cf770 msgr2=0x7fa4500ab560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:31.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.737+0000 7fa455bb1640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4500cf770 0x7fa4500ab560 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa448009be0 tx=0x7fa448003c90 comp rx=0 tx=0).stop 2024-07-24T16:24:31.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.737+0000 7fa455bb1640 1 -- 172.21.15.159:0/1906591700 shutdown_connections 2024-07-24T16:24:31.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.737+0000 7fa455bb1640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa430077010 0x7fa4300794d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:31.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.737+0000 7fa455bb1640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa4500cf770 0x7fa4500ab560 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:31.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.737+0000 7fa455bb1640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa4500b3e20 0x7fa4501f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:31.741 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.737+0000 7fa455bb1640 1 --2- 172.21.15.159:0/1906591700 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa45006dba0 0x7fa4501f2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:31.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.737+0000 7fa455bb1640 1 -- 172.21.15.159:0/1906591700 >> 172.21.15.159:0/1906591700 conn(0x7fa45006c560 msgr2=0x7fa4500b2da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:31.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.737+0000 7fa455bb1640 1 -- 172.21.15.159:0/1906591700 shutdown_connections 2024-07-24T16:24:31.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31.737+0000 7fa455bb1640 1 -- 172.21.15.159:0/1906591700 wait complete. 2024-07-24T16:24:31.751 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-07-24T16:24:31.751 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-24T16:24:31.751 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2024-07-24T16:24:31.751 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-07-24T16:24:31.752 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-24T16:24:31.752 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-07-24T16:24:31.752 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-07-24T16:24:31.752 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-24T16:24:31.752 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-24T16:24:31.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:31.752 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2024-07-24T16:24:31.768 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-24T16:24:31.768 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-24T16:24:31.768 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2024-07-24T16:24:31.768 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:31.768 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2024-07-24T16:24:31.768 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:31.768 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:31.768 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:31.768 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2024-07-24T16:24:31.769 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:31.769 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:31.769 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2024-07-24T16:24:31.769 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:31.769 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:31.769 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-24T16:24:31.769 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:31.769 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-24T16:24:31.769 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42749sec preferred_lft 42749sec 2024-07-24T16:24:31.769 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2024-07-24T16:24:31.769 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:31.770 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-07-24T16:24:31.770 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:31.770 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:31.770 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add name ceph-brx type bridge 2024-07-24T16:24:31.770 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr flush dev ceph-brx 2024-07-24T16:24:31.770 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set ceph-brx up 2024-07-24T16:24:31.770 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-07-24T16:24:31.770 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:31.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:31.901 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:31.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:31.908 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-24T16:24:31.931 INFO:teuthology.orchestra.run.smithi159.stdout:1 2024-07-24T16:24:31.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:31.933 DEBUG:teuthology.orchestra.run.smithi159:> route 2024-07-24T16:24:31.990 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2024-07-24T16:24:31.990 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-24T16:24:31.990 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-24T16:24:31.990 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-24T16:24:31.990 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-24T16:24:31.991 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:31.991 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:31.991 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-24T16:24:31.991 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-24T16:24:31.991 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-24T16:24:31.991 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:32.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:32.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:32.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:32.118 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-07-24T16:24:32.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:32.134 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2024-07-24T16:24:32.190 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:32.190 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:32.190 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-24T16:24:32.190 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-07-24T16:24:32.190 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:32.278 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:32.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:32.308 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-07-24T16:24:32.308 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:32.308 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:32.308 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-07-24T16:24:32.308 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-07-24T16:24:32.308 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-07-24T16:24:32.309 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-07-24T16:24:32.309 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-07-24T16:24:32.309 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:32.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:32.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:32.422 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:32.422 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:32.423 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2024-07-24T16:24:32.423 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.0 master ceph-brx 2024-07-24T16:24:32.423 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:32.471 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:32.493 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:32.500 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:24:32.500 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-07-24T16:24:32.515 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-07-24T16:24:32.515 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:24:32.515 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-07-24T16:24:32.571 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-07-24T16:24:32.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:32.571 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-07-24T16:24:32.655 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-07-24T16:24:32.655 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-07-24T16:24:32.655 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-07-24T16:24:32.776 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-07-24T16:24:32.777 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-07-24T16:24:32.777 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-07-24T16:24:32.777 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.159:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-07-24T16:24:32.777 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2024-07-24T16:24:32.781 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-07-24T16:24:32.781 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-07-24T16:24:32.782 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-07-24T16:24:32.782 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.159:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-07-24T16:24:32.782 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2024-07-24T16:24:32.782 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.159:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-07-24T16:24:32.782 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.159:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-07-24T16:24:32.782 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=15e9c2b9-79b9-45cf-833e-5ce98c29c7f6" will pass to kernel 2024-07-24T16:24:32.785 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-07-24T16:24:32.785 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2024-07-24T16:24:32.785 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-24T16:24:32.785 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2024-07-24T16:24:32.785 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-24T16:24:32.785 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-24T16:24:32.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:32.785 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-07-24T16:24:32.815 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:24:32.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:32 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:24:32.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:32.912 INFO:teuthology.orchestra.run.smithi159.stdout:client4702 2024-07-24T16:24:32.912 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:24:32.912 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:32.928 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:24:33.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:24:33.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:33.026 INFO:teuthology.orchestra.run.smithi159.stdout:client4702 2024-07-24T16:24:33.026 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:24:33.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:24:33.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:33.082 INFO:teuthology.orchestra.run.smithi159.stdout:client4702 2024-07-24T16:24:33.082 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/15e9c2b9-79b9-45cf-833e-5ce98c29c7f6.client4702/status') 2024-07-24T16:24:33.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:33.140 INFO:teuthology.orchestra.run.smithi159.stdout:instance: client.4702 (3)172.21.15.159:0/1659482670 2024-07-24T16:24:33.141 INFO:teuthology.orchestra.run.smithi159.stdout:blocklisted: false 2024-07-24T16:24:33.141 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records in 2024-07-24T16:24:33.141 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records out 2024-07-24T16:24:33.141 INFO:teuthology.orchestra.run.smithi159.stderr:71 bytes copied, 2.1708e-05 s, 3.3 MB/s 2024-07-24T16:24:33.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:33.148 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-07-24T16:24:33.148 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-07-24T16:24:33.148 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-07-24T16:24:33.148 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-24T16:24:33.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.248+0000 7fe86a0a9640 1 -- 172.21.15.159:0/3576434805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe864150cc0 msgr2=0x7fe86415ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:33.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.248+0000 7fe86a0a9640 1 --2- 172.21.15.159:0/3576434805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe864150cc0 0x7fe86415ad80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fe864073aa0 tx=0x7fe85402a790 comp rx=0 tx=0).stop 2024-07-24T16:24:33.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.248+0000 7fe86a0a9640 1 -- 172.21.15.159:0/3576434805 shutdown_connections 2024-07-24T16:24:33.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.248+0000 7fe86a0a9640 1 --2- 172.21.15.159:0/3576434805 >> v2:172.21.15.193:3300/0 conn(0x7fe8640b41d0 0x7fe8640b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:33.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.248+0000 7fe86a0a9640 1 --2- 172.21.15.159:0/3576434805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe864150cc0 0x7fe86415ad80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:33.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.248+0000 7fe86a0a9640 1 -- 172.21.15.159:0/3576434805 >> 172.21.15.159:0/3576434805 conn(0x7fe86406c560 msgr2=0x7fe86406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:33.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.248+0000 7fe86a0a9640 1 -- 172.21.15.159:0/3576434805 shutdown_connections 2024-07-24T16:24:33.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.248+0000 7fe86a0a9640 1 -- 172.21.15.159:0/3576434805 wait complete. 2024-07-24T16:24:33.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.249+0000 7fe86a0a9640 1 Processor -- start 2024-07-24T16:24:33.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.249+0000 7fe86a0a9640 1 -- start start 2024-07-24T16:24:33.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.250+0000 7fe86a0a9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe86406d670 0x7fe8640ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:33.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.250+0000 7fe86a0a9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8640b41d0 0x7fe8641583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:33.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.250+0000 7fe86a0a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe864150cc0 0x7fe864158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:33.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.250+0000 7fe86a0a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe8640724a0 con 0x7fe864150cc0 2024-07-24T16:24:33.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.250+0000 7fe86a0a9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe864072320 con 0x7fe8640b41d0 2024-07-24T16:24:33.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.250+0000 7fe86a0a9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe86406dae0 con 0x7fe86406d670 2024-07-24T16:24:33.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.250+0000 7fe863fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe864150cc0 0x7fe864158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:33.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.250+0000 7fe863fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe864150cc0 0x7fe864158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43410/0 (socket says 172.21.15.159:43410) 2024-07-24T16:24:33.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.250+0000 7fe863fff640 1 -- 172.21.15.159:0/1257357283 learned_addr learned my addr 172.21.15.159:0/1257357283 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:33.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.250+0000 7fe862ffd640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8640b41d0 0x7fe8641583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:33.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.250+0000 7fe8637fe640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe86406d670 0x7fe8640ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:33.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.251+0000 7fe863fff640 1 -- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe86406d670 msgr2=0x7fe8640ad350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:33.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.251+0000 7fe863fff640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe86406d670 0x7fe8640ad350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:33.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.251+0000 7fe863fff640 1 -- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8640b41d0 msgr2=0x7fe8641583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:33.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.251+0000 7fe863fff640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8640b41d0 0x7fe8641583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:33.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.251+0000 7fe863fff640 1 -- 172.21.15.159:0/1257357283 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8640adc10 con 0x7fe864150cc0 2024-07-24T16:24:33.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.251+0000 7fe8637fe640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe86406d670 0x7fe8640ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:33.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.251+0000 7fe863fff640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe864150cc0 0x7fe864158930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00c4d0 tx=0x7fe85c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:33.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.251+0000 7fe84bfff640 1 -- 172.21.15.159:0/1257357283 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c016020 con 0x7fe864150cc0 2024-07-24T16:24:33.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.251+0000 7fe84bfff640 1 -- 172.21.15.159:0/1257357283 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe85c012920 con 0x7fe864150cc0 2024-07-24T16:24:33.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.251+0000 7fe84bfff640 1 -- 172.21.15.159:0/1257357283 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe85c012d10 con 0x7fe864150cc0 2024-07-24T16:24:33.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.251+0000 7fe86a0a9640 1 -- 172.21.15.159:0/1257357283 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8640adef0 con 0x7fe864150cc0 2024-07-24T16:24:33.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.251+0000 7fe86a0a9640 1 -- 172.21.15.159:0/1257357283 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe864155f50 con 0x7fe864150cc0 2024-07-24T16:24:33.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.252+0000 7fe86a0a9640 1 -- 172.21.15.159:0/1257357283 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe864156150 con 0x7fe864150cc0 2024-07-24T16:24:33.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.253+0000 7fe84bfff640 1 -- 172.21.15.159:0/1257357283 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fe85c019020 con 0x7fe864150cc0 2024-07-24T16:24:33.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.253+0000 7fe84bfff640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe850077010 0x7fe8500794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:33.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.253+0000 7fe84bfff640 1 -- 172.21.15.159:0/1257357283 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe85c098ad0 con 0x7fe864150cc0 2024-07-24T16:24:33.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.253+0000 7fe8637fe640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe850077010 0x7fe8500794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:33.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.254+0000 7fe8637fe640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe850077010 0x7fe8500794d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe854033000 tx=0x7fe854004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:33.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.257+0000 7fe84bfff640 1 -- 172.21.15.159:0/1257357283 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fe864156150 con 0x7fe864150cc0 2024-07-24T16:24:33.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.479+0000 7fe86a0a9640 1 -- 172.21.15.159:0/1257357283 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe86406df90 con 0x7fe864150cc0 2024-07-24T16:24:33.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.479+0000 7fe84bfff640 1 -- 172.21.15.159:0/1257357283 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fe85c020020 con 0x7fe864150cc0 2024-07-24T16:24:33.482 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-07-24T16:24:33.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.482+0000 7fe86a0a9640 1 -- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe850077010 msgr2=0x7fe8500794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:33.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.482+0000 7fe86a0a9640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe850077010 0x7fe8500794d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe854033000 tx=0x7fe854004ab0 comp rx=0 tx=0).stop 2024-07-24T16:24:33.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.482+0000 7fe86a0a9640 1 -- 172.21.15.159:0/1257357283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe864150cc0 msgr2=0x7fe864158930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:33.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.482+0000 7fe86a0a9640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe864150cc0 0x7fe864158930 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe85c00c4d0 tx=0x7fe85c00c990 comp rx=0 tx=0).stop 2024-07-24T16:24:33.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.482+0000 7fe86a0a9640 1 -- 172.21.15.159:0/1257357283 shutdown_connections 2024-07-24T16:24:33.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.482+0000 7fe86a0a9640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fe850077010 0x7fe8500794d0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:33.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.482+0000 7fe86a0a9640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe864150cc0 0x7fe864158930 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:33.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.482+0000 7fe86a0a9640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe8640b41d0 0x7fe8641583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:33.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.482+0000 7fe86a0a9640 1 --2- 172.21.15.159:0/1257357283 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe86406d670 0x7fe8640ad350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:33.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.482+0000 7fe86a0a9640 1 -- 172.21.15.159:0/1257357283 >> 172.21.15.159:0/1257357283 conn(0x7fe86406c560 msgr2=0x7fe86414fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:33.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.482+0000 7fe86a0a9640 1 -- 172.21.15.159:0/1257357283 shutdown_connections 2024-07-24T16:24:33.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33.482+0000 7fe86a0a9640 1 -- 172.21.15.159:0/1257357283 wait complete. 2024-07-24T16:24:33.495 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-07-24T16:24:33.495 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-24T16:24:33.495 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2024-07-24T16:24:33.496 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-07-24T16:24:33.496 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-07-24T16:24:33.496 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-07-24T16:24:33.496 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-07-24T16:24:33.496 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-24T16:24:33.496 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-07-24T16:24:33.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:33.496 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2024-07-24T16:24:33.511 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-24T16:24:33.511 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-24T16:24:33.512 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2024-07-24T16:24:33.512 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:33.512 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2024-07-24T16:24:33.512 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:33.512 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:33.512 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:33.512 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2024-07-24T16:24:33.512 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:33.512 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:33.512 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2024-07-24T16:24:33.512 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:33.512 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:33.512 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-24T16:24:33.513 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:33.513 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-24T16:24:33.513 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42747sec preferred_lft 42747sec 2024-07-24T16:24:33.513 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2024-07-24T16:24:33.513 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:33.513 INFO:teuthology.orchestra.run.smithi159.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-24T16:24:33.513 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether ba:13:bc:12:98:84 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:33.513 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-07-24T16:24:33.513 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:33.513 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::d8bc:3bff:fe37:4033/64 scope link 2024-07-24T16:24:33.513 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:33.513 INFO:teuthology.orchestra.run.smithi159.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-24T16:24:33.513 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether ba:13:bc:12:98:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-24T16:24:33.514 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::b813:bcff:fe12:9884/64 scope link tentative 2024-07-24T16:24:33.514 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:33.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:33.514 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-24T16:24:33.576 INFO:teuthology.orchestra.run.smithi159.stdout:1 2024-07-24T16:24:33.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:33.577 DEBUG:teuthology.orchestra.run.smithi159:> route 2024-07-24T16:24:33.634 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2024-07-24T16:24:33.634 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-24T16:24:33.634 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-24T16:24:33.634 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-24T16:24:33.634 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-24T16:24:33.634 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:33.634 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:33.635 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-24T16:24:33.635 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-24T16:24:33.635 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-24T16:24:33.635 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:33.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:33.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:33.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:33.760 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-07-24T16:24:33.776 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-07-24T16:24:33.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:33.776 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list-id 2024-07-24T16:24:33.831 INFO:teuthology.orchestra.run.smithi159.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-07-24T16:24:33.832 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:33.832 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:33.832 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-07-24T16:24:33.832 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-07-24T16:24:33.832 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:33.921 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:33.944 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:33.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:33.950 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-07-24T16:24:33.974 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-24T16:24:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-24T16:24:33.974 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2024-07-24T16:24:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2024-07-24T16:24:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:33.975 INFO:teuthology.orchestra.run.smithi159.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-24T16:24:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether ba:d8:c6:3e:3f:a0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-07-24T16:24:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-07-24T16:24:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::b8d8:c6ff:fe3e:3fa0/64 scope link 2024-07-24T16:24:33.975 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:33.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:33.976 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-07-24T16:24:34.041 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-24T16:24:34.041 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-24T16:24:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2024-07-24T16:24:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2024-07-24T16:24:34.042 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:34.042 INFO:teuthology.orchestra.run.smithi159.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-24T16:24:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether ba:d8:c6:3e:3f:a0 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-07-24T16:24:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-07-24T16:24:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::b8d8:c6ff:fe3e:3fa0/64 scope link 2024-07-24T16:24:34.043 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:34.045 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-07-24T16:24:34.045 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:34.045 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:34.045 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-07-24T16:24:34.045 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-07-24T16:24:34.045 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-07-24T16:24:34.045 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-07-24T16:24:34.046 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-07-24T16:24:34.046 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:34.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:34.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:34.199 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:34.199 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:24:34.199 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.1 up 2024-07-24T16:24:34.199 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set dev brx.1 master ceph-brx 2024-07-24T16:24:34.199 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:24:34.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:34.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:34.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:24:34.278 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-07-24T16:24:34.293 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-07-24T16:24:34.293 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:24:34.293 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-07-24T16:24:34.349 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-07-24T16:24:34.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:34.349 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-07-24T16:24:34.434 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-07-24T16:24:34.434 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-07-24T16:24:34.434 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-07-24T16:24:34.442 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-07-24T16:24:34.443 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-07-24T16:24:34.443 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-07-24T16:24:34.443 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.159:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-07-24T16:24:34.443 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2024-07-24T16:24:34.447 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-07-24T16:24:34.448 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-07-24T16:24:34.448 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-07-24T16:24:34.448 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.159:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-07-24T16:24:34.448 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2024-07-24T16:24:34.448 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.159:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-07-24T16:24:34.448 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.159:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-07-24T16:24:34.448 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=15e9c2b9-79b9-45cf-833e-5ce98c29c7f6" will pass to kernel 2024-07-24T16:24:34.448 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-07-24T16:24:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2024-07-24T16:24:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-24T16:24:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2024-07-24T16:24:34.449 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-24T16:24:34.450 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-24T16:24:34.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:34.451 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-07-24T16:24:34.475 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:24:34.565 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:24:34.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:34.573 INFO:teuthology.orchestra.run.smithi159.stdout:client4568 2024-07-24T16:24:34.573 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:24:34.573 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:34.590 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:24:34.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:24:34.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:34.686 INFO:teuthology.orchestra.run.smithi159.stdout:client4568 2024-07-24T16:24:34.687 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:24:34.736 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:24:34.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:34.744 INFO:teuthology.orchestra.run.smithi159.stdout:client4568 2024-07-24T16:24:34.744 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/15e9c2b9-79b9-45cf-833e-5ce98c29c7f6.client4568/status') 2024-07-24T16:24:34.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:34.803 INFO:teuthology.orchestra.run.smithi159.stdout:instance: client.4568 (3)172.21.15.159:0/3918203742 2024-07-24T16:24:34.803 INFO:teuthology.orchestra.run.smithi159.stdout:blocklisted: false 2024-07-24T16:24:34.803 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records in 2024-07-24T16:24:34.804 INFO:teuthology.orchestra.run.smithi159.stderr:0+1 records out 2024-07-24T16:24:34.804 INFO:teuthology.orchestra.run.smithi159.stderr:71 bytes copied, 2.1713e-05 s, 3.3 MB/s 2024-07-24T16:24:34.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:34.811 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-07-24T16:24:34.811 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-07-24T16:24:34.811 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-07-24T16:24:34.811 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-24T16:24:34.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.912+0000 7f1403a24640 1 -- 172.21.15.159:0/1718756027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc1524f0 msgr2=0x7f13fc0af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:34.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.912+0000 7f1403a24640 1 --2- 172.21.15.159:0/1718756027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc1524f0 0x7f13fc0af020 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f13fc068cc0 tx=0x7f13f802a530 comp rx=0 tx=0).stop 2024-07-24T16:24:34.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.912+0000 7f1403a24640 1 -- 172.21.15.159:0/1718756027 shutdown_connections 2024-07-24T16:24:34.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.912+0000 7f1403a24640 1 --2- 172.21.15.159:0/1718756027 >> v2:172.21.15.193:3300/0 conn(0x7f13fc0cf840 0x7f13fc0cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:34.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.912+0000 7f1403a24640 1 --2- 172.21.15.159:0/1718756027 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc1524f0 0x7f13fc0af020 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:34.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.912+0000 7f1403a24640 1 -- 172.21.15.159:0/1718756027 >> 172.21.15.159:0/1718756027 conn(0x7f13fc06d450 msgr2=0x7f13fc06d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:34.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.912+0000 7f1403a24640 1 -- 172.21.15.159:0/1718756027 shutdown_connections 2024-07-24T16:24:34.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.912+0000 7f1403a24640 1 -- 172.21.15.159:0/1718756027 wait complete. 2024-07-24T16:24:34.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.913+0000 7f1403a24640 1 Processor -- start 2024-07-24T16:24:34.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.913+0000 7f1403a24640 1 -- start start 2024-07-24T16:24:34.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1403a24640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f13fc0ccf60 0x7f13fc154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:34.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1403a24640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc0cf840 0x7f13fc0ae360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:34.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1403a24640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13fc1524f0 0x7f13fc0abb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:34.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1403a24640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc15cc60 con 0x7f13fc0cf840 2024-07-24T16:24:34.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1403a24640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f13fc15cae0 con 0x7f13fc1524f0 2024-07-24T16:24:34.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1403a24640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f13fc15f6d0 con 0x7f13fc0ccf60 2024-07-24T16:24:34.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1400fbf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc0cf840 0x7f13fc0ae360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:34.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1400fbf640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc0cf840 0x7f13fc0ae360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43440/0 (socket says 172.21.15.159:43440) 2024-07-24T16:24:34.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1400fbf640 1 -- 172.21.15.159:0/1670664157 learned_addr learned my addr 172.21.15.159:0/1670664157 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:34.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1401fc1640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13fc1524f0 0x7f13fc0abb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:34.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f14017c0640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f13fc0ccf60 0x7f13fc154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:34.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1400fbf640 1 -- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f13fc0ccf60 msgr2=0x7f13fc154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:34.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1400fbf640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f13fc0ccf60 0x7f13fc154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:34.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1400fbf640 1 -- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13fc1524f0 msgr2=0x7f13fc0abb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:34.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1400fbf640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13fc1524f0 0x7f13fc0abb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:34.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1400fbf640 1 -- 172.21.15.159:0/1670664157 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13fc153480 con 0x7f13fc0cf840 2024-07-24T16:24:34.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1400fbf640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc0cf840 0x7f13fc0ae360 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00d980 tx=0x7f13ec00de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:34.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f13f1ffb640 1 -- 172.21.15.159:0/1670664157 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec017070 con 0x7f13fc0cf840 2024-07-24T16:24:34.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f13f1ffb640 1 -- 172.21.15.159:0/1670664157 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f13ec009d20 con 0x7f13fc0cf840 2024-07-24T16:24:34.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f1403a24640 1 -- 172.21.15.159:0/1670664157 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13fc153760 con 0x7f13fc0cf840 2024-07-24T16:24:34.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.914+0000 7f13f1ffb640 1 -- 172.21.15.159:0/1670664157 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13ec0106c0 con 0x7f13fc0cf840 2024-07-24T16:24:34.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.915+0000 7f1403a24640 1 -- 172.21.15.159:0/1670664157 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13fc153d20 con 0x7f13fc0cf840 2024-07-24T16:24:34.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.916+0000 7f1403a24640 1 -- 172.21.15.159:0/1670664157 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13fc15fbd0 con 0x7f13fc0cf840 2024-07-24T16:24:34.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.916+0000 7f13f1ffb640 1 -- 172.21.15.159:0/1670664157 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f13ec010860 con 0x7f13fc0cf840 2024-07-24T16:24:34.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.916+0000 7f13f1ffb640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f13e0077010 0x7f13e00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:34.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.917+0000 7f13f1ffb640 1 -- 172.21.15.159:0/1670664157 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f13ec098f80 con 0x7f13fc0cf840 2024-07-24T16:24:34.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.917+0000 7f14017c0640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f13e0077010 0x7f13e00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:34.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.917+0000 7f14017c0640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f13e0077010 0x7f13e00794d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13f8034000 tx=0x7f13f8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:34.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:34.921+0000 7f13f1ffb640 1 -- 172.21.15.159:0/1670664157 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f13ec061ed0 con 0x7f13fc0cf840 2024-07-24T16:24:35.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.144+0000 7f1403a24640 1 -- 172.21.15.159:0/1670664157 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f13fc15ee40 con 0x7f13fc0cf840 2024-07-24T16:24:35.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.145+0000 7f13f1ffb640 1 -- 172.21.15.159:0/1670664157 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7f13ec0617d0 con 0x7f13fc0cf840 2024-07-24T16:24:35.147 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-07-24T16:24:35.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.147+0000 7f1403a24640 1 -- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f13e0077010 msgr2=0x7f13e00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:35.149 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.147+0000 7f1403a24640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f13e0077010 0x7f13e00794d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f13f8034000 tx=0x7f13f8004730 comp rx=0 tx=0).stop 2024-07-24T16:24:35.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.147+0000 7f1403a24640 1 -- 172.21.15.159:0/1670664157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc0cf840 msgr2=0x7f13fc0ae360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:35.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.147+0000 7f1403a24640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc0cf840 0x7f13fc0ae360 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f13ec00d980 tx=0x7f13ec00de40 comp rx=0 tx=0).stop 2024-07-24T16:24:35.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.147+0000 7f1403a24640 1 -- 172.21.15.159:0/1670664157 shutdown_connections 2024-07-24T16:24:35.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.147+0000 7f1403a24640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f13e0077010 0x7f13e00794d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:35.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.147+0000 7f1403a24640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f13fc1524f0 0x7f13fc0abb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:35.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.147+0000 7f1403a24640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f13fc0cf840 0x7f13fc0ae360 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:35.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.147+0000 7f1403a24640 1 --2- 172.21.15.159:0/1670664157 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f13fc0ccf60 0x7f13fc154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:35.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.147+0000 7f1403a24640 1 -- 172.21.15.159:0/1670664157 >> 172.21.15.159:0/1670664157 conn(0x7f13fc06d450 msgr2=0x7f13fc0702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:35.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.147+0000 7f1403a24640 1 -- 172.21.15.159:0/1670664157 shutdown_connections 2024-07-24T16:24:35.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:35.147+0000 7f1403a24640 1 -- 172.21.15.159:0/1670664157 wait complete. 2024-07-24T16:24:35.160 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-07-24T16:24:35.160 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-24T16:24:35.160 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi193.front.sepia.ceph.com 2024-07-24T16:24:35.160 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-07-24T16:24:35.160 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-07-24T16:24:35.160 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-07-24T16:24:35.160 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-07-24T16:24:35.161 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-24T16:24:35.161 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-07-24T16:24:35.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:35.161 DEBUG:teuthology.orchestra.run.smithi193:> ip addr 2024-07-24T16:24:35.180 INFO:teuthology.orchestra.run.smithi193.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-24T16:24:35.180 INFO:teuthology.orchestra.run.smithi193.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-24T16:24:35.180 INFO:teuthology.orchestra.run.smithi193.stdout: inet 127.0.0.1/8 scope host lo 2024-07-24T16:24:35.180 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:35.180 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 ::1/128 scope host 2024-07-24T16:24:35.180 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:35.180 INFO:teuthology.orchestra.run.smithi193.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:35.180 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:d9:38:b6 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:35.180 INFO:teuthology.orchestra.run.smithi193.stdout: altname enp7s0f0 2024-07-24T16:24:35.181 INFO:teuthology.orchestra.run.smithi193.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:35.181 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:d9:38:b7 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:35.181 INFO:teuthology.orchestra.run.smithi193.stdout: altname enp7s0f1 2024-07-24T16:24:35.181 INFO:teuthology.orchestra.run.smithi193.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:35.181 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:88:72:52 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:35.181 INFO:teuthology.orchestra.run.smithi193.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-24T16:24:35.181 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:88:72:53 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:35.181 INFO:teuthology.orchestra.run.smithi193.stdout: inet 172.21.15.193/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-24T16:24:35.181 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft 42734sec preferred_lft 42734sec 2024-07-24T16:24:35.181 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 fe80::ec4:7aff:fe88:7253/64 scope link 2024-07-24T16:24:35.181 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:35.182 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-07-24T16:24:35.182 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:35.182 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-07-24T16:24:35.182 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link add name ceph-brx type bridge 2024-07-24T16:24:35.182 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip addr flush dev ceph-brx 2024-07-24T16:24:35.182 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link set ceph-brx up 2024-07-24T16:24:35.182 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-07-24T16:24:35.182 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-07-24T16:24:35.275 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:35.396 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:35.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:35.402 DEBUG:teuthology.orchestra.run.smithi193:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-24T16:24:35.428 INFO:teuthology.orchestra.run.smithi193.stdout:1 2024-07-24T16:24:35.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:35.430 DEBUG:teuthology.orchestra.run.smithi193:> route 2024-07-24T16:24:35.498 INFO:teuthology.orchestra.run.smithi193.stdout:Kernel IP routing table 2024-07-24T16:24:35.498 INFO:teuthology.orchestra.run.smithi193.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-24T16:24:35.498 INFO:teuthology.orchestra.run.smithi193.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-24T16:24:35.498 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-24T16:24:35.499 INFO:teuthology.orchestra.run.smithi193.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-24T16:24:35.499 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:35.499 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-07-24T16:24:35.499 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-24T16:24:35.499 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-24T16:24:35.499 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-24T16:24:35.499 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-07-24T16:24:35.586 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:35.820 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:35.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:35.827 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-07-24T16:24:35.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:35.842 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list-id 2024-07-24T16:24:35.898 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:35.898 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-07-24T16:24:35.898 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-07-24T16:24:35.898 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-07-24T16:24:35.899 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-07-24T16:24:35.988 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:35 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:36.012 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:36.019 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-07-24T16:24:36.019 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:36.019 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-07-24T16:24:36.019 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-07-24T16:24:36.019 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-07-24T16:24:36.020 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-07-24T16:24:36.020 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-07-24T16:24:36.020 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-07-24T16:24:36.020 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-07-24T16:24:36.070 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:36.138 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:36.144 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:36.144 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-07-24T16:24:36.145 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link set brx.0 up 2024-07-24T16:24:36.145 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link set dev brx.0 master ceph-brx 2024-07-24T16:24:36.145 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-07-24T16:24:36.194 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:36.216 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:36.223 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:24:36.223 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-07-24T16:24:36.238 INFO:teuthology.orchestra.run.smithi193.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-07-24T16:24:36.239 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:24:36.239 DEBUG:teuthology.orchestra.run.smithi193:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-07-24T16:24:36.295 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-07-24T16:24:36.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:36.296 DEBUG:teuthology.orchestra.run.smithi193:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-07-24T16:24:36.388 INFO:teuthology.orchestra.run.smithi193.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-07-24T16:24:36.389 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-07-24T16:24:36.389 INFO:teuthology.orchestra.run.smithi193.stdout:invalid new device string format 2024-07-24T16:24:36.526 INFO:teuthology.orchestra.run.smithi193.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-07-24T16:24:36.526 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-07-24T16:24:36.526 INFO:teuthology.orchestra.run.smithi193.stdout:invalid new device string format 2024-07-24T16:24:36.526 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: resolved to: "172.21.15.159:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-07-24T16:24:36.526 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: switching to using v1 address with old syntax 2024-07-24T16:24:36.531 INFO:teuthology.orchestra.run.smithi193.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-07-24T16:24:36.531 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-07-24T16:24:36.531 INFO:teuthology.orchestra.run.smithi193.stdout:invalid new device string format 2024-07-24T16:24:36.531 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: resolved to: "172.21.15.159:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-07-24T16:24:36.531 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: switching to using v1 address with old syntax 2024-07-24T16:24:36.531 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: resolved to: "172.21.15.159:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-07-24T16:24:36.531 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.159:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-07-24T16:24:36.531 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=15e9c2b9-79b9-45cf-833e-5ce98c29c7f6" will pass to kernel 2024-07-24T16:24:36.532 INFO:teuthology.orchestra.run.smithi193.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-07-24T16:24:36.532 INFO:teuthology.orchestra.run.smithi193.stdout: You just mounted a file system that supports labels which does not 2024-07-24T16:24:36.532 INFO:teuthology.orchestra.run.smithi193.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-24T16:24:36.533 INFO:teuthology.orchestra.run.smithi193.stdout: applications will generate AVC messages and not be allowed access to 2024-07-24T16:24:36.533 INFO:teuthology.orchestra.run.smithi193.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-24T16:24:36.534 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-24T16:24:36.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:36.535 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-07-24T16:24:36.559 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:24:36.648 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:24:36.650 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:36.655 INFO:teuthology.orchestra.run.smithi193.stdout:client4574 2024-07-24T16:24:36.656 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:24:36.656 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:36.672 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:24:36.760 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:24:36.762 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:36.768 INFO:teuthology.orchestra.run.smithi193.stdout:client4574 2024-07-24T16:24:36.768 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:24:36.816 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:36 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:24:36.818 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:36.824 INFO:teuthology.orchestra.run.smithi193.stdout:client4574 2024-07-24T16:24:36.824 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/15e9c2b9-79b9-45cf-833e-5ce98c29c7f6.client4574/status') 2024-07-24T16:24:36.873 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:36.882 INFO:teuthology.orchestra.run.smithi193.stdout:instance: client.4574 (3)192.168.0.1:0/753066951 2024-07-24T16:24:36.883 INFO:teuthology.orchestra.run.smithi193.stdout:blocklisted: false 2024-07-24T16:24:36.883 INFO:teuthology.orchestra.run.smithi193.stderr:0+1 records in 2024-07-24T16:24:36.883 INFO:teuthology.orchestra.run.smithi193.stderr:0+1 records out 2024-07-24T16:24:36.883 INFO:teuthology.orchestra.run.smithi193.stderr:68 bytes copied, 3.8508e-05 s, 1.8 MB/s 2024-07-24T16:24:36.883 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:36 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:36.890 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-07-24T16:24:36.890 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-07-24T16:24:36.890 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-07-24T16:24:36.890 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-24T16:24:37.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.003+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3894983649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8940af380 msgr2=0x7fd8940b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:37.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.003+0000 7fd89b9ed640 1 --2- 172.21.15.159:0/3894983649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8940af380 0x7fd8940b4410 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd8940b2b30 tx=0x7fd88802a5f0 comp rx=0 tx=0).stop 2024-07-24T16:24:37.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.003+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3894983649 shutdown_connections 2024-07-24T16:24:37.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.003+0000 7fd89b9ed640 1 --2- 172.21.15.159:0/3894983649 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8940af380 0x7fd8940b4410 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:37.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.003+0000 7fd89b9ed640 1 --2- 172.21.15.159:0/3894983649 >> v2:172.21.15.193:3300/0 conn(0x7fd89415d680 0x7fd8940b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:37.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.003+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3894983649 >> 172.21.15.159:0/3894983649 conn(0x7fd89406d450 msgr2=0x7fd89406d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:37.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.003+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3894983649 shutdown_connections 2024-07-24T16:24:37.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.003+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3894983649 wait complete. 2024-07-24T16:24:37.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.004+0000 7fd89b9ed640 1 Processor -- start 2024-07-24T16:24:37.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.004+0000 7fd89b9ed640 1 -- start start 2024-07-24T16:24:37.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd89b9ed640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8940af380 0x7fd8941f3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:37.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd89b9ed640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd8940b4b20 0x7fd8941521f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:37.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd89b9ed640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd89415d680 0x7fd8941e8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:37.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd89b9ed640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd8940adfa0 con 0x7fd8940af380 2024-07-24T16:24:37.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd89b9ed640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd894070550 con 0x7fd89415d680 2024-07-24T16:24:37.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd89b9ed640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd8940ae120 con 0x7fd8940b4b20 2024-07-24T16:24:37.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd899789640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8940af380 0x7fd8941f3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:37.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd899789640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8940af380 0x7fd8941f3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43460/0 (socket says 172.21.15.159:43460) 2024-07-24T16:24:37.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd899789640 1 -- 172.21.15.159:0/3822983137 learned_addr learned my addr 172.21.15.159:0/3822983137 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:37.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd899f8a640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd89415d680 0x7fd8941e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:37.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd898f88640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd8940b4b20 0x7fd8941521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:37.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd899789640 1 -- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd8940b4b20 msgr2=0x7fd8941521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:37.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd899789640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd8940b4b20 0x7fd8941521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:37.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd899789640 1 -- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd89415d680 msgr2=0x7fd8941e8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:37.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd899789640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd89415d680 0x7fd8941e8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:37.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd899789640 1 -- 172.21.15.159:0/3822983137 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd894153230 con 0x7fd8940af380 2024-07-24T16:24:37.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.005+0000 7fd898f88640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd8940b4b20 0x7fd8941521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:37.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.006+0000 7fd899789640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8940af380 0x7fd8941f3ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd88400e9f0 tx=0x7fd88400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:37.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.006+0000 7fd891ffb640 1 -- 172.21.15.159:0/3822983137 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd88400cd80 con 0x7fd8940af380 2024-07-24T16:24:37.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.006+0000 7fd891ffb640 1 -- 172.21.15.159:0/3822983137 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd884004c10 con 0x7fd8940af380 2024-07-24T16:24:37.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.006+0000 7fd891ffb640 1 -- 172.21.15.159:0/3822983137 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd884005020 con 0x7fd8940af380 2024-07-24T16:24:37.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.006+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3822983137 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd894152990 con 0x7fd8940af380 2024-07-24T16:24:37.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.006+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3822983137 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd894152f50 con 0x7fd8940af380 2024-07-24T16:24:37.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.007+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3822983137 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8940ae640 con 0x7fd8940af380 2024-07-24T16:24:37.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.007+0000 7fd891ffb640 1 -- 172.21.15.159:0/3822983137 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd8840051c0 con 0x7fd8940af380 2024-07-24T16:24:37.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.008+0000 7fd891ffb640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd880077010 0x7fd8800794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:37.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.008+0000 7fd891ffb640 1 -- 172.21.15.159:0/3822983137 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd884099500 con 0x7fd8940af380 2024-07-24T16:24:37.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.008+0000 7fd898f88640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd880077010 0x7fd8800794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:37.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.009+0000 7fd898f88640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd880077010 0x7fd8800794d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd888033000 tx=0x7fd888004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:37.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.012+0000 7fd891ffb640 1 -- 172.21.15.159:0/3822983137 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fd884016030 con 0x7fd8940af380 2024-07-24T16:24:37.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.232+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3822983137 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd894160b90 con 0x7fd8940af380 2024-07-24T16:24:37.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.232+0000 7fd891ffb640 1 -- 172.21.15.159:0/3822983137 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fd884062450 con 0x7fd8940af380 2024-07-24T16:24:37.235 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-07-24T16:24:37.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.234+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd880077010 msgr2=0x7fd8800794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:37.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.234+0000 7fd89b9ed640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd880077010 0x7fd8800794d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd888033000 tx=0x7fd888004730 comp rx=0 tx=0).stop 2024-07-24T16:24:37.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.234+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3822983137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8940af380 msgr2=0x7fd8941f3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:37.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.234+0000 7fd89b9ed640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8940af380 0x7fd8941f3ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd88400e9f0 tx=0x7fd88400eeb0 comp rx=0 tx=0).stop 2024-07-24T16:24:37.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.234+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3822983137 shutdown_connections 2024-07-24T16:24:37.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.234+0000 7fd89b9ed640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd880077010 0x7fd8800794d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:37.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.234+0000 7fd89b9ed640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd89415d680 0x7fd8941e8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:37.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.234+0000 7fd89b9ed640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd8940b4b20 0x7fd8941521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:37.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.234+0000 7fd89b9ed640 1 --2- 172.21.15.159:0/3822983137 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd8940af380 0x7fd8941f3ab0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:37.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.234+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3822983137 >> 172.21.15.159:0/3822983137 conn(0x7fd89406d450 msgr2=0x7fd89415fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:37.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.234+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3822983137 shutdown_connections 2024-07-24T16:24:37.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:37.234+0000 7fd89b9ed640 1 -- 172.21.15.159:0/3822983137 wait complete. 2024-07-24T16:24:37.248 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-07-24T16:24:37.248 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-24T16:24:37.248 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi193.front.sepia.ceph.com 2024-07-24T16:24:37.248 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-07-24T16:24:37.248 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-07-24T16:24:37.248 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-07-24T16:24:37.248 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-07-24T16:24:37.248 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-24T16:24:37.248 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-07-24T16:24:37.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:37.248 DEBUG:teuthology.orchestra.run.smithi193:> ip addr 2024-07-24T16:24:37.265 INFO:teuthology.orchestra.run.smithi193.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-24T16:24:37.265 INFO:teuthology.orchestra.run.smithi193.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-24T16:24:37.265 INFO:teuthology.orchestra.run.smithi193.stdout: inet 127.0.0.1/8 scope host lo 2024-07-24T16:24:37.265 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.265 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 ::1/128 scope host 2024-07-24T16:24:37.265 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.266 INFO:teuthology.orchestra.run.smithi193.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:37.266 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:d9:38:b6 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:37.266 INFO:teuthology.orchestra.run.smithi193.stdout: altname enp7s0f0 2024-07-24T16:24:37.266 INFO:teuthology.orchestra.run.smithi193.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:37.266 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:d9:38:b7 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:37.266 INFO:teuthology.orchestra.run.smithi193.stdout: altname enp7s0f1 2024-07-24T16:24:37.266 INFO:teuthology.orchestra.run.smithi193.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:24:37.266 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:88:72:52 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:37.266 INFO:teuthology.orchestra.run.smithi193.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-24T16:24:37.266 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 0c:c4:7a:88:72:53 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:37.266 INFO:teuthology.orchestra.run.smithi193.stdout: inet 172.21.15.193/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-24T16:24:37.266 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft 42732sec preferred_lft 42732sec 2024-07-24T16:24:37.266 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 fe80::ec4:7aff:fe88:7253/64 scope link 2024-07-24T16:24:37.267 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.267 INFO:teuthology.orchestra.run.smithi193.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-24T16:24:37.267 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 62:1b:d7:ca:c4:c9 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:24:37.267 INFO:teuthology.orchestra.run.smithi193.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-07-24T16:24:37.267 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.267 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 fe80::fca2:dfff:fe29:7870/64 scope link 2024-07-24T16:24:37.267 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.267 INFO:teuthology.orchestra.run.smithi193.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-24T16:24:37.267 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 62:1b:d7:ca:c4:c9 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-07-24T16:24:37.267 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 fe80::601b:d7ff:feca:c4c9/64 scope link tentative 2024-07-24T16:24:37.267 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.268 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:37.268 DEBUG:teuthology.orchestra.run.smithi193:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-24T16:24:37.329 INFO:teuthology.orchestra.run.smithi193.stdout:1 2024-07-24T16:24:37.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:37.330 DEBUG:teuthology.orchestra.run.smithi193:> route 2024-07-24T16:24:37.386 INFO:teuthology.orchestra.run.smithi193.stdout:Kernel IP routing table 2024-07-24T16:24:37.386 INFO:teuthology.orchestra.run.smithi193.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-24T16:24:37.386 INFO:teuthology.orchestra.run.smithi193.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-24T16:24:37.386 INFO:teuthology.orchestra.run.smithi193.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-24T16:24:37.387 INFO:teuthology.orchestra.run.smithi193.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-24T16:24:37.387 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:37.387 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-07-24T16:24:37.387 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-24T16:24:37.387 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-24T16:24:37.387 DEBUG:teuthology.orchestra.run.smithi193:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-24T16:24:37.387 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-07-24T16:24:37.475 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:37.507 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:37.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:37.514 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-07-24T16:24:37.530 INFO:teuthology.orchestra.run.smithi193.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-07-24T16:24:37.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:37.530 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list-id 2024-07-24T16:24:37.585 INFO:teuthology.orchestra.run.smithi193.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-07-24T16:24:37.586 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:37.586 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-07-24T16:24:37.586 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-07-24T16:24:37.586 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-07-24T16:24:37.586 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-07-24T16:24:37.674 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:37.697 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:37.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:37.703 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-07-24T16:24:37.727 INFO:teuthology.orchestra.run.smithi193.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-24T16:24:37.727 INFO:teuthology.orchestra.run.smithi193.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-24T16:24:37.727 INFO:teuthology.orchestra.run.smithi193.stdout: inet 127.0.0.1/8 scope host lo 2024-07-24T16:24:37.727 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.727 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 ::1/128 scope host 2024-07-24T16:24:37.727 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.728 INFO:teuthology.orchestra.run.smithi193.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-24T16:24:37.728 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 9e:7d:20:bb:43:8b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-07-24T16:24:37.728 INFO:teuthology.orchestra.run.smithi193.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-07-24T16:24:37.728 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.728 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 fe80::9c7d:20ff:febb:438b/64 scope link tentative 2024-07-24T16:24:37.728 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:37.729 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-07-24T16:24:37.793 INFO:teuthology.orchestra.run.smithi193.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-24T16:24:37.793 INFO:teuthology.orchestra.run.smithi193.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-24T16:24:37.794 INFO:teuthology.orchestra.run.smithi193.stdout: inet 127.0.0.1/8 scope host lo 2024-07-24T16:24:37.794 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.794 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 ::1/128 scope host 2024-07-24T16:24:37.794 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.794 INFO:teuthology.orchestra.run.smithi193.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-24T16:24:37.794 INFO:teuthology.orchestra.run.smithi193.stdout: link/ether 9e:7d:20:bb:43:8b brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-07-24T16:24:37.794 INFO:teuthology.orchestra.run.smithi193.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-07-24T16:24:37.794 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.794 INFO:teuthology.orchestra.run.smithi193.stdout: inet6 fe80::9c7d:20ff:febb:438b/64 scope link tentative 2024-07-24T16:24:37.794 INFO:teuthology.orchestra.run.smithi193.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:24:37.795 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-07-24T16:24:37.795 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:37.796 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-07-24T16:24:37.796 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-07-24T16:24:37.796 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-07-24T16:24:37.796 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-07-24T16:24:37.796 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-07-24T16:24:37.796 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-07-24T16:24:37.796 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-07-24T16:24:37.884 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:37.942 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:37.948 DEBUG:teuthology.orchestra.run.smithi193:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:24:37.949 DEBUG:teuthology.orchestra.run.smithi193:> set -e 2024-07-24T16:24:37.949 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link set brx.1 up 2024-07-24T16:24:37.949 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link set dev brx.1 master ceph-brx 2024-07-24T16:24:37.949 DEBUG:teuthology.orchestra.run.smithi193:> ') 2024-07-24T16:24:37.997 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:38.019 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:38.026 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:24:38.026 DEBUG:teuthology.orchestra.run.smithi193:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-07-24T16:24:38.059 INFO:teuthology.orchestra.run.smithi193.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-07-24T16:24:38.059 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:24:38.059 DEBUG:teuthology.orchestra.run.smithi193:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-07-24T16:24:38.114 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-07-24T16:24:38.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:38.115 DEBUG:teuthology.orchestra.run.smithi193:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-07-24T16:24:38.197 INFO:teuthology.orchestra.run.smithi193.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-07-24T16:24:38.198 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-07-24T16:24:38.198 INFO:teuthology.orchestra.run.smithi193.stdout:invalid new device string format 2024-07-24T16:24:38.206 INFO:teuthology.orchestra.run.smithi193.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-07-24T16:24:38.206 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-07-24T16:24:38.206 INFO:teuthology.orchestra.run.smithi193.stdout:invalid new device string format 2024-07-24T16:24:38.206 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: resolved to: "172.21.15.159:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-07-24T16:24:38.206 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: switching to using v1 address with old syntax 2024-07-24T16:24:38.211 INFO:teuthology.orchestra.run.smithi193.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-07-24T16:24:38.211 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-07-24T16:24:38.211 INFO:teuthology.orchestra.run.smithi193.stdout:invalid new device string format 2024-07-24T16:24:38.212 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: resolved to: "172.21.15.159:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-07-24T16:24:38.212 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: switching to using v1 address with old syntax 2024-07-24T16:24:38.212 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: resolved to: "172.21.15.159:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-07-24T16:24:38.212 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.159:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-07-24T16:24:38.212 INFO:teuthology.orchestra.run.smithi193.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=15e9c2b9-79b9-45cf-833e-5ce98c29c7f6" will pass to kernel 2024-07-24T16:24:38.212 INFO:teuthology.orchestra.run.smithi193.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-07-24T16:24:38.212 INFO:teuthology.orchestra.run.smithi193.stdout: You just mounted a file system that supports labels which does not 2024-07-24T16:24:38.212 INFO:teuthology.orchestra.run.smithi193.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-24T16:24:38.213 INFO:teuthology.orchestra.run.smithi193.stdout: applications will generate AVC messages and not be allowed access to 2024-07-24T16:24:38.213 INFO:teuthology.orchestra.run.smithi193.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-24T16:24:38.214 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-24T16:24:38.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:38.214 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-07-24T16:24:38.279 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:24:38.368 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:24:38.370 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:38.376 INFO:teuthology.orchestra.run.smithi193.stdout:client4836 2024-07-24T16:24:38.376 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:24:38.376 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:38.392 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:24:38.480 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:24:38.482 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:38.487 INFO:teuthology.orchestra.run.smithi193.stdout:client4836 2024-07-24T16:24:38.488 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:24:38.536 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:38 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:24:38.538 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:38.544 INFO:teuthology.orchestra.run.smithi193.stdout:client4836 2024-07-24T16:24:38.545 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/15e9c2b9-79b9-45cf-833e-5ce98c29c7f6.client4836/status') 2024-07-24T16:24:38.593 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:24:38.603 INFO:teuthology.orchestra.run.smithi193.stdout:instance: client.4836 (3)172.21.15.193:0/1460279177 2024-07-24T16:24:38.603 INFO:teuthology.orchestra.run.smithi193.stdout:blocklisted: false 2024-07-24T16:24:38.603 INFO:teuthology.orchestra.run.smithi193.stderr:0+1 records in 2024-07-24T16:24:38.603 INFO:teuthology.orchestra.run.smithi193.stderr:0+1 records out 2024-07-24T16:24:38.603 INFO:teuthology.orchestra.run.smithi193.stderr:71 bytes copied, 2.5196e-05 s, 2.8 MB/s 2024-07-24T16:24:38.604 INFO:teuthology.orchestra.run.smithi193.stderr:2024-07-24T16:24:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:24:38.610 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-07-24T16:24:38.643 INFO:tasks.cephfs_test_runner:Starting test: test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test concurrent snap creates in same file-system without db issues 2024-07-24T16:24:38.643 INFO:tasks.cephfs_test_runner:test_concurrent_snap_creates (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-07-24T16:24:38.643 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:38.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.757+0000 7f80f3acb640 1 -- 172.21.15.159:0/1954463638 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80ec157130 msgr2=0x7f80ec0cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:38.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.757+0000 7f80f3acb640 1 --2- 172.21.15.159:0/1954463638 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80ec157130 0x7f80ec0cf500 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f80e800a970 tx=0x7f80e802b7d0 comp rx=0 tx=0).stop 2024-07-24T16:24:38.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.757+0000 7f80f3acb640 1 -- 172.21.15.159:0/1954463638 shutdown_connections 2024-07-24T16:24:38.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.757+0000 7f80f3acb640 1 --2- 172.21.15.159:0/1954463638 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80ec157130 0x7f80ec0cf500 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:38.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.757+0000 7f80f3acb640 1 -- 172.21.15.159:0/1954463638 >> 172.21.15.159:0/1954463638 conn(0x7f80ec06c560 msgr2=0x7f80ec06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:38.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.757+0000 7f80f3acb640 1 -- 172.21.15.159:0/1954463638 shutdown_connections 2024-07-24T16:24:38.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.757+0000 7f80f3acb640 1 -- 172.21.15.159:0/1954463638 wait complete. 2024-07-24T16:24:38.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.758+0000 7f80f3acb640 1 Processor -- start 2024-07-24T16:24:38.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.758+0000 7f80f3acb640 1 -- start start 2024-07-24T16:24:38.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.759+0000 7f80f3acb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80ec06e360 0x7f80ec1f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:38.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.759+0000 7f80f3acb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80ec157130 0x7f80ec134640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:38.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.759+0000 7f80f3acb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80ec157510 0x7f80ec071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:38.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.759+0000 7f80f3acb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec0cfbc0 con 0x7f80ec157130 2024-07-24T16:24:38.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.759+0000 7f80f3acb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f80ec0cfa40 con 0x7f80ec06e360 2024-07-24T16:24:38.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.759+0000 7f80f3acb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f80ec0cfd40 con 0x7f80ec157510 2024-07-24T16:24:38.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.759+0000 7f80f1066640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80ec157130 0x7f80ec134640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:38.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.759+0000 7f80f1066640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80ec157130 0x7f80ec134640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43472/0 (socket says 172.21.15.159:43472) 2024-07-24T16:24:38.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.759+0000 7f80f1066640 1 -- 172.21.15.159:0/2954582856 learned_addr learned my addr 172.21.15.159:0/2954582856 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:38.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.759+0000 7f80f1867640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80ec06e360 0x7f80ec1f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:38.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.759+0000 7f80f2068640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80ec157510 0x7f80ec071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:38.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.760+0000 7f80f1066640 1 -- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80ec157510 msgr2=0x7f80ec071e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:38.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.760+0000 7f80f1066640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80ec157510 0x7f80ec071e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:38.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.760+0000 7f80f1066640 1 -- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80ec06e360 msgr2=0x7f80ec1f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:38.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.760+0000 7f80f1066640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80ec06e360 0x7f80ec1f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:38.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.760+0000 7f80f1066640 1 -- 172.21.15.159:0/2954582856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80ec1f2330 con 0x7f80ec157130 2024-07-24T16:24:38.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.760+0000 7f80f1867640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80ec06e360 0x7f80ec1f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:38.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.760+0000 7f80f1066640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80ec157130 0x7f80ec134640 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0013c0 tx=0x7f80dc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:38.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.760+0000 7f80e27fc640 1 -- 172.21.15.159:0/2954582856 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc016020 con 0x7f80ec157130 2024-07-24T16:24:38.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.760+0000 7f80e27fc640 1 -- 172.21.15.159:0/2954582856 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80dc012920 con 0x7f80ec157130 2024-07-24T16:24:38.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.760+0000 7f80f3acb640 1 -- 172.21.15.159:0/2954582856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80ec1f2610 con 0x7f80ec157130 2024-07-24T16:24:38.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.760+0000 7f80e27fc640 1 -- 172.21.15.159:0/2954582856 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80dc012cf0 con 0x7f80ec157130 2024-07-24T16:24:38.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.760+0000 7f80f3acb640 1 -- 172.21.15.159:0/2954582856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80ec1f2bd0 con 0x7f80ec157130 2024-07-24T16:24:38.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.761+0000 7f80f3acb640 1 -- 172.21.15.159:0/2954582856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80ec0cf500 con 0x7f80ec157130 2024-07-24T16:24:38.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.762+0000 7f80e27fc640 1 -- 172.21.15.159:0/2954582856 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f80dc019020 con 0x7f80ec157130 2024-07-24T16:24:38.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.762+0000 7f80e27fc640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f80d0077010 0x7f80d00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:38.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.762+0000 7f80e27fc640 1 -- 172.21.15.159:0/2954582856 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f80dc098a10 con 0x7f80ec157130 2024-07-24T16:24:38.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.762+0000 7f80f1867640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f80d0077010 0x7f80d00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:38.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.763+0000 7f80f1867640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f80d0077010 0x7f80d00794d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80e8035000 tx=0x7f80e8004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:38.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.766+0000 7f80e27fc640 1 -- 172.21.15.159:0/2954582856 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f80dc020030 con 0x7f80ec157130 2024-07-24T16:24:38.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.950+0000 7f80f3acb640 1 -- 172.21.15.159:0/2954582856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80ec142950 con 0x7f80ec157130 2024-07-24T16:24:38.953 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.951+0000 7f80e27fc640 1 -- 172.21.15.159:0/2954582856 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f80dc0619f0 con 0x7f80ec157130 2024-07-24T16:24:38.953 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:38.954 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:07.801757+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:00.757174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:01.708421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-24T16:24:05.423097+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:38.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.953+0000 7f80f3acb640 1 -- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f80d0077010 msgr2=0x7f80d00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.953+0000 7f80f3acb640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f80d0077010 0x7f80d00794d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f80e8035000 tx=0x7f80e8004730 comp rx=0 tx=0).stop 2024-07-24T16:24:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.953+0000 7f80f3acb640 1 -- 172.21.15.159:0/2954582856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80ec157130 msgr2=0x7f80ec134640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.953+0000 7f80f3acb640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80ec157130 0x7f80ec134640 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0013c0 tx=0x7f80dc00c940 comp rx=0 tx=0).stop 2024-07-24T16:24:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.953+0000 7f80f3acb640 1 -- 172.21.15.159:0/2954582856 shutdown_connections 2024-07-24T16:24:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.953+0000 7f80f3acb640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f80d0077010 0x7f80d00794d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.953+0000 7f80f3acb640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80ec157510 0x7f80ec071e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.953+0000 7f80f3acb640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80ec157130 0x7f80ec134640 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.953+0000 7f80f3acb640 1 --2- 172.21.15.159:0/2954582856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80ec06e360 0x7f80ec1f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.953+0000 7f80f3acb640 1 -- 172.21.15.159:0/2954582856 >> 172.21.15.159:0/2954582856 conn(0x7f80ec06c560 msgr2=0x7f80ec06c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.953+0000 7f80f3acb640 1 -- 172.21.15.159:0/2954582856 shutdown_connections 2024-07-24T16:24:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:38.953+0000 7f80f3acb640 1 -- 172.21.15.159:0/2954582856 wait complete. 2024-07-24T16:24:38.967 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-24T16:23:58.377345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-07-24T16:24:00.757174+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-07-24T16:24:01.708421+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-07-24T16:24:05.423097+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-07-24T16:24:38.967 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-07-24T16:24:39.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.071+0000 7f08fa768640 1 -- 172.21.15.159:0/3728438292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08f41524f0 msgr2=0x7f08f40af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.071+0000 7f08fa768640 1 --2- 172.21.15.159:0/3728438292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08f41524f0 0x7f08f40af020 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f08f4068cc0 tx=0x7f08e402a560 comp rx=0 tx=0).stop 2024-07-24T16:24:39.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.071+0000 7f08fa768640 1 -- 172.21.15.159:0/3728438292 shutdown_connections 2024-07-24T16:24:39.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.071+0000 7f08fa768640 1 --2- 172.21.15.159:0/3728438292 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08f40ccf60 0x7f08f415efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.071+0000 7f08fa768640 1 --2- 172.21.15.159:0/3728438292 >> v2:172.21.15.193:3300/0 conn(0x7f08f40cf840 0x7f08f40cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.071+0000 7f08fa768640 1 --2- 172.21.15.159:0/3728438292 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08f41524f0 0x7f08f40af020 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.071+0000 7f08fa768640 1 -- 172.21.15.159:0/3728438292 >> 172.21.15.159:0/3728438292 conn(0x7f08f406d450 msgr2=0x7f08f406d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:39.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.071+0000 7f08fa768640 1 -- 172.21.15.159:0/3728438292 shutdown_connections 2024-07-24T16:24:39.075 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.071+0000 7f08fa768640 1 -- 172.21.15.159:0/3728438292 wait complete. 2024-07-24T16:24:39.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.072+0000 7f08fa768640 1 Processor -- start 2024-07-24T16:24:39.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.072+0000 7f08fa768640 1 -- start start 2024-07-24T16:24:39.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08fa768640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08f40ccf60 0x7f08f41489a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:39.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08fa768640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08f40cf840 0x7f08f40ad990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:39.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08fa768640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08f41524f0 0x7f08f40aded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:39.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08fa768640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f08f415cc60 con 0x7f08f40cf840 2024-07-24T16:24:39.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08fa768640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f08f415cae0 con 0x7f08f40ccf60 2024-07-24T16:24:39.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08fa768640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f08f415f500 con 0x7f08f41524f0 2024-07-24T16:24:39.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08f37fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08f40cf840 0x7f08f40ad990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:39.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08f37fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08f40cf840 0x7f08f40ad990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43494/0 (socket says 172.21.15.159:43494) 2024-07-24T16:24:39.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08f37fe640 1 -- 172.21.15.159:0/3959305962 learned_addr learned my addr 172.21.15.159:0/3959305962 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:39.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08f8d05640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08f41524f0 0x7f08f40aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:39.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08f3fff640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08f40ccf60 0x7f08f41489a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:39.078 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08f37fe640 1 -- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08f41524f0 msgr2=0x7f08f40aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08f37fe640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08f41524f0 0x7f08f40aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08f37fe640 1 -- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08f40ccf60 msgr2=0x7f08f41489a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08f37fe640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08f40ccf60 0x7f08f41489a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.073+0000 7f08f37fe640 1 -- 172.21.15.159:0/3959305962 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08f4152a60 con 0x7f08f40cf840 2024-07-24T16:24:39.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.074+0000 7f08f37fe640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08f40cf840 0x7f08f40ad990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f08e800e9f0 tx=0x7f08e800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:39.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.074+0000 7f08f0ff9640 1 -- 172.21.15.159:0/3959305962 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e800ccc0 con 0x7f08f40cf840 2024-07-24T16:24:39.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.074+0000 7f08f0ff9640 1 -- 172.21.15.159:0/3959305962 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f08e8010430 con 0x7f08f40cf840 2024-07-24T16:24:39.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.074+0000 7f08fa768640 1 -- 172.21.15.159:0/3959305962 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08f4152d40 con 0x7f08f40cf840 2024-07-24T16:24:39.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.074+0000 7f08f0ff9640 1 -- 172.21.15.159:0/3959305962 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e8010860 con 0x7f08f40cf840 2024-07-24T16:24:39.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.074+0000 7f08fa768640 1 -- 172.21.15.159:0/3959305962 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08f4153300 con 0x7f08f40cf840 2024-07-24T16:24:39.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.075+0000 7f08fa768640 1 -- 172.21.15.159:0/3959305962 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08f40cca20 con 0x7f08f40cf840 2024-07-24T16:24:39.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.075+0000 7f08f0ff9640 1 -- 172.21.15.159:0/3959305962 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f08e8010a00 con 0x7f08f40cf840 2024-07-24T16:24:39.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.076+0000 7f08f0ff9640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f08e0077010 0x7f08e00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:39.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.076+0000 7f08f0ff9640 1 -- 172.21.15.159:0/3959305962 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f08e80995f0 con 0x7f08f40cf840 2024-07-24T16:24:39.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.076+0000 7f08f3fff640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f08e0077010 0x7f08e00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:39.081 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.077+0000 7f08f3fff640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f08e0077010 0x7f08e00794d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08e4033000 tx=0x7f08e4004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:39.082 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.080+0000 7f08f0ff9640 1 -- 172.21.15.159:0/3959305962 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f08e8061ef0 con 0x7f08f40cf840 2024-07-24T16:24:39.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.261+0000 7f08fa768640 1 -- 172.21.15.159:0/3959305962 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f08f415b510 con 0x7f08f40cf840 2024-07-24T16:24:39.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.261+0000 7f08f0ff9640 1 -- 172.21.15.159:0/3959305962 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f08e8066440 con 0x7f08f40cf840 2024-07-24T16:24:39.264 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 1 2024-07-24T16:24:39.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.263+0000 7f08fa768640 1 -- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f08e0077010 msgr2=0x7f08e00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.266 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.263+0000 7f08fa768640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f08e0077010 0x7f08e00794d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f08e4033000 tx=0x7f08e4004730 comp rx=0 tx=0).stop 2024-07-24T16:24:39.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.263+0000 7f08fa768640 1 -- 172.21.15.159:0/3959305962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08f40cf840 msgr2=0x7f08f40ad990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.263+0000 7f08fa768640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08f40cf840 0x7f08f40ad990 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f08e800e9f0 tx=0x7f08e800edf0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.263+0000 7f08fa768640 1 -- 172.21.15.159:0/3959305962 shutdown_connections 2024-07-24T16:24:39.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.263+0000 7f08fa768640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f08e0077010 0x7f08e00794d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.263+0000 7f08fa768640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f08f41524f0 0x7f08f40aded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.263+0000 7f08fa768640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f08f40cf840 0x7f08f40ad990 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.263+0000 7f08fa768640 1 --2- 172.21.15.159:0/3959305962 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f08f40ccf60 0x7f08f41489a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.264+0000 7f08fa768640 1 -- 172.21.15.159:0/3959305962 >> 172.21.15.159:0/3959305962 conn(0x7f08f406d450 msgr2=0x7f08f414b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:39.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.264+0000 7f08fa768640 1 -- 172.21.15.159:0/3959305962 shutdown_connections 2024-07-24T16:24:39.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.264+0000 7f08fa768640 1 -- 172.21.15.159:0/3959305962 wait complete. 2024-07-24T16:24:39.277 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-07-24T16:24:39.383 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.380+0000 7f790711e640 1 -- 172.21.15.159:0/1864711072 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f790015d950 msgr2=0x7f7900161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.380+0000 7f790711e640 1 --2- 172.21.15.159:0/1864711072 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f790015d950 0x7f7900161f20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f78f0005fd0 tx=0x7f78f002ab20 comp rx=0 tx=0).stop 2024-07-24T16:24:39.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.380+0000 7f790711e640 1 -- 172.21.15.159:0/1864711072 shutdown_connections 2024-07-24T16:24:39.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.380+0000 7f790711e640 1 --2- 172.21.15.159:0/1864711072 >> v2:172.21.15.193:3300/0 conn(0x7f79000b2ae0 0x7f79000b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.380+0000 7f790711e640 1 --2- 172.21.15.159:0/1864711072 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f790015d950 0x7f7900161f20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.380+0000 7f790711e640 1 -- 172.21.15.159:0/1864711072 >> 172.21.15.159:0/1864711072 conn(0x7f790009cd30 msgr2=0x7f79000d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:39.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.381+0000 7f790711e640 1 -- 172.21.15.159:0/1864711072 shutdown_connections 2024-07-24T16:24:39.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.381+0000 7f790711e640 1 -- 172.21.15.159:0/1864711072 wait complete. 2024-07-24T16:24:39.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.382+0000 7f790711e640 1 Processor -- start 2024-07-24T16:24:39.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.382+0000 7f790711e640 1 -- start start 2024-07-24T16:24:39.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f790711e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79000b0b60 0x7f79000cd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:39.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f790711e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79000b2ae0 0x7f79000ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:39.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f790711e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f790015d950 0x7f79001f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:39.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f790711e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f79000d02e0 con 0x7f790015d950 2024-07-24T16:24:39.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f790711e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79000d0090 con 0x7f79000b2ae0 2024-07-24T16:24:39.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f790711e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f79000d0460 con 0x7f79000b0b60 2024-07-24T16:24:39.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f79056bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f790015d950 0x7f79001f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:39.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f7904eba640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79000b0b60 0x7f79000cd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:39.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f79056bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f790015d950 0x7f79001f53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43508/0 (socket says 172.21.15.159:43508) 2024-07-24T16:24:39.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f7904eba640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79000b0b60 0x7f79000cd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3301/0 says I am v2:172.21.15.159:42314/0 (socket says 172.21.15.159:42314) 2024-07-24T16:24:39.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f79056bb640 1 -- 172.21.15.159:0/2345889316 learned_addr learned my addr 172.21.15.159:0/2345889316 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:39.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f78fffff640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79000b2ae0 0x7f79000ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:39.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f79056bb640 1 -- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79000b0b60 msgr2=0x7f79000cd7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f79056bb640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79000b0b60 0x7f79000cd7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f79056bb640 1 -- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79000b2ae0 msgr2=0x7f79000ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f79056bb640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79000b2ae0 0x7f79000ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f79056bb640 1 -- 172.21.15.159:0/2345889316 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79001f5090 con 0x7f790015d950 2024-07-24T16:24:39.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f7904eba640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79000b0b60 0x7f79000cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:24:39.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f78fffff640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79000b2ae0 0x7f79000ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:24:39.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f79056bb640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f790015d950 0x7f79001f53f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f78f800c3c0 tx=0x7f78f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:39.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f78fd7fa640 1 -- 172.21.15.159:0/2345889316 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8017070 con 0x7f790015d950 2024-07-24T16:24:39.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f78fd7fa640 1 -- 172.21.15.159:0/2345889316 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78f80053c0 con 0x7f790015d950 2024-07-24T16:24:39.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.383+0000 7f790711e640 1 -- 172.21.15.159:0/2345889316 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79000cab60 con 0x7f790015d950 2024-07-24T16:24:39.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.384+0000 7f78fd7fa640 1 -- 172.21.15.159:0/2345889316 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f8003850 con 0x7f790015d950 2024-07-24T16:24:39.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.384+0000 7f790711e640 1 -- 172.21.15.159:0/2345889316 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79000cb120 con 0x7f790015d950 2024-07-24T16:24:39.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.384+0000 7f790711e640 1 -- 172.21.15.159:0/2345889316 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79000d0980 con 0x7f790015d950 2024-07-24T16:24:39.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.385+0000 7f78fd7fa640 1 -- 172.21.15.159:0/2345889316 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f78f801a070 con 0x7f790015d950 2024-07-24T16:24:39.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.386+0000 7f78fd7fa640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f78e0077010 0x7f78e00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:39.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.386+0000 7f78fd7fa640 1 -- 172.21.15.159:0/2345889316 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f78f8097f50 con 0x7f790015d950 2024-07-24T16:24:39.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.386+0000 7f7904eba640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f78e0077010 0x7f78e00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:39.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.386+0000 7f7904eba640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f78e0077010 0x7f78e00794d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f78f0035000 tx=0x7f78f0038040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:39.392 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.390+0000 7f78fd7fa640 1 -- 172.21.15.159:0/2345889316 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f78f80607d0 con 0x7f790015d950 2024-07-24T16:24:39.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.578+0000 7f790711e640 1 -- 172.21.15.159:0/2345889316 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f79001f5930 con 0x7f790015d950 2024-07-24T16:24:39.582 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.578+0000 7f78fd7fa640 1 -- 172.21.15.159:0/2345889316 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f78f8064d20 con 0x7f790015d950 2024-07-24T16:24:39.582 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 32 2024-07-24T16:24:39.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.581+0000 7f790711e640 1 -- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f78e0077010 msgr2=0x7f78e00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.581+0000 7f790711e640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f78e0077010 0x7f78e00794d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f78f0035000 tx=0x7f78f0038040 comp rx=0 tx=0).stop 2024-07-24T16:24:39.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.581+0000 7f790711e640 1 -- 172.21.15.159:0/2345889316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f790015d950 msgr2=0x7f79001f53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.581+0000 7f790711e640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f790015d950 0x7f79001f53f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f78f800c3c0 tx=0x7f78f800c880 comp rx=0 tx=0).stop 2024-07-24T16:24:39.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.581+0000 7f790711e640 1 -- 172.21.15.159:0/2345889316 shutdown_connections 2024-07-24T16:24:39.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.581+0000 7f790711e640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f78e0077010 0x7f78e00794d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.581+0000 7f790711e640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f790015d950 0x7f79001f53f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.581+0000 7f790711e640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79000b2ae0 0x7f79000ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.581+0000 7f790711e640 1 --2- 172.21.15.159:0/2345889316 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79000b0b60 0x7f79000cd7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.581+0000 7f790711e640 1 -- 172.21.15.159:0/2345889316 >> 172.21.15.159:0/2345889316 conn(0x7f790009cd30 msgr2=0x7f79000b69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:39.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.581+0000 7f790711e640 1 -- 172.21.15.159:0/2345889316 shutdown_connections 2024-07-24T16:24:39.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.581+0000 7f790711e640 1 -- 172.21.15.159:0/2345889316 wait complete. 2024-07-24T16:24:39.594 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-07-24T16:24:39.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.699+0000 7f4c52076640 1 -- 172.21.15.159:0/2726396180 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c4c0b2ae0 msgr2=0x7f4c4c161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.699+0000 7f4c52076640 1 --2- 172.21.15.159:0/2726396180 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c4c0b2ae0 0x7f4c4c161f20 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009830 tx=0x7f4c3402a5a0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.699+0000 7f4c52076640 1 -- 172.21.15.159:0/2726396180 shutdown_connections 2024-07-24T16:24:39.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.699+0000 7f4c52076640 1 --2- 172.21.15.159:0/2726396180 >> v2:172.21.15.193:3300/0 conn(0x7f4c4c0cf770 0x7f4c4c0cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.699+0000 7f4c52076640 1 --2- 172.21.15.159:0/2726396180 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c4c0b2ae0 0x7f4c4c161f20 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.699+0000 7f4c52076640 1 -- 172.21.15.159:0/2726396180 >> 172.21.15.159:0/2726396180 conn(0x7f4c4c09cd30 msgr2=0x7f4c4c0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:39.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.699+0000 7f4c52076640 1 -- 172.21.15.159:0/2726396180 shutdown_connections 2024-07-24T16:24:39.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.699+0000 7f4c52076640 1 -- 172.21.15.159:0/2726396180 wait complete. 2024-07-24T16:24:39.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.700+0000 7f4c52076640 1 Processor -- start 2024-07-24T16:24:39.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.700+0000 7f4c52076640 1 -- start start 2024-07-24T16:24:39.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c52076640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c4c0b2ae0 0x7f4c4c143870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:39.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c52076640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c4c0cf770 0x7f4c4c1570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:39.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c52076640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c4c15d950 0x7f4c4c1f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:39.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c52076640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c0d0460 con 0x7f4c4c15d950 2024-07-24T16:24:39.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c52076640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c0d02e0 con 0x7f4c4c0b2ae0 2024-07-24T16:24:39.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c52076640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4c4c0d05e0 con 0x7f4c4c0cf770 2024-07-24T16:24:39.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c4bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c4c15d950 0x7f4c4c1f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:39.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c4bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c4c15d950 0x7f4c4c1f35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43524/0 (socket says 172.21.15.159:43524) 2024-07-24T16:24:39.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c4bfff640 1 -- 172.21.15.159:0/4242064532 learned_addr learned my addr 172.21.15.159:0/4242064532 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:39.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c43fff640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c4c0cf770 0x7f4c4c1570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:39.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c4b7fe640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c4c0b2ae0 0x7f4c4c143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:39.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c4bfff640 1 -- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c4c0cf770 msgr2=0x7f4c4c1570e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c4bfff640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c4c0cf770 0x7f4c4c1570e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c4bfff640 1 -- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c4c0b2ae0 msgr2=0x7f4c4c143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c4bfff640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c4c0b2ae0 0x7f4c4c143870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c4bfff640 1 -- 172.21.15.159:0/4242064532 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4c143db0 con 0x7f4c4c15d950 2024-07-24T16:24:39.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c4b7fe640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c4c0b2ae0 0x7f4c4c143870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:39.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c43fff640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c4c0cf770 0x7f4c4c1570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:39.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c4bfff640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c4c15d950 0x7f4c4c1f35e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400efd0 tx=0x7f4c4400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:39.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c48ff9640 1 -- 172.21.15.159:0/4242064532 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44003b70 con 0x7f4c4c15d950 2024-07-24T16:24:39.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c48ff9640 1 -- 172.21.15.159:0/4242064532 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c44003e00 con 0x7f4c4c15d950 2024-07-24T16:24:39.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c52076640 1 -- 172.21.15.159:0/4242064532 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c4c159de0 con 0x7f4c4c15d950 2024-07-24T16:24:39.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c48ff9640 1 -- 172.21.15.159:0/4242064532 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44004280 con 0x7f4c4c15d950 2024-07-24T16:24:39.706 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.701+0000 7f4c52076640 1 -- 172.21.15.159:0/4242064532 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c4c0c8890 con 0x7f4c4c15d950 2024-07-24T16:24:39.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.702+0000 7f4c52076640 1 -- 172.21.15.159:0/4242064532 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c4c075740 con 0x7f4c4c15d950 2024-07-24T16:24:39.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.703+0000 7f4c48ff9640 1 -- 172.21.15.159:0/4242064532 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f4c44004420 con 0x7f4c4c15d950 2024-07-24T16:24:39.707 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.703+0000 7f4c48ff9640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4c2c077010 0x7f4c2c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:39.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.704+0000 7f4c48ff9640 1 -- 172.21.15.159:0/4242064532 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4c44099aa0 con 0x7f4c4c15d950 2024-07-24T16:24:39.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.704+0000 7f4c4b7fe640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4c2c077010 0x7f4c2c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:39.708 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.704+0000 7f4c4b7fe640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4c2c077010 0x7f4c2c0794d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c007a50 tx=0x7f4c3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:39.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.708+0000 7f4c48ff9640 1 -- 172.21.15.159:0/4242064532 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f4c4c075740 con 0x7f4c4c15d950 2024-07-24T16:24:39.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.893+0000 7f4c52076640 1 -- 172.21.15.159:0/4242064532 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4c4c0d0a90 con 0x7f4c4c15d950 2024-07-24T16:24:39.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.893+0000 7f4c48ff9640 1 -- 172.21.15.159:0/4242064532 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f4c44062a00 con 0x7f4c4c15d950 2024-07-24T16:24:39.896 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 64 2024-07-24T16:24:39.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.895+0000 7f4c52076640 1 -- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4c2c077010 msgr2=0x7f4c2c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.895+0000 7f4c52076640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4c2c077010 0x7f4c2c0794d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c007a50 tx=0x7f4c3c009040 comp rx=0 tx=0).stop 2024-07-24T16:24:39.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.895+0000 7f4c52076640 1 -- 172.21.15.159:0/4242064532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c4c15d950 msgr2=0x7f4c4c1f35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:39.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.895+0000 7f4c52076640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c4c15d950 0x7f4c4c1f35e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400efd0 tx=0x7f4c4400c6a0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.895+0000 7f4c52076640 1 -- 172.21.15.159:0/4242064532 shutdown_connections 2024-07-24T16:24:39.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.895+0000 7f4c52076640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4c2c077010 0x7f4c2c0794d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.895+0000 7f4c52076640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c4c15d950 0x7f4c4c1f35e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.895+0000 7f4c52076640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c4c0cf770 0x7f4c4c1570e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.895+0000 7f4c52076640 1 --2- 172.21.15.159:0/4242064532 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c4c0b2ae0 0x7f4c4c143870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:39.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.895+0000 7f4c52076640 1 -- 172.21.15.159:0/4242064532 >> 172.21.15.159:0/4242064532 conn(0x7f4c4c09cd30 msgr2=0x7f4c4c0d43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:39.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.895+0000 7f4c52076640 1 -- 172.21.15.159:0/4242064532 shutdown_connections 2024-07-24T16:24:39.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:39.895+0000 7f4c52076640 1 -- 172.21.15.159:0/4242064532 wait complete. 2024-07-24T16:24:39.909 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-07-24T16:24:40.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.013+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3268606515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e0003fd0 msgr2=0x7f69e0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:40.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.013+0000 7f69fdbe8640 1 --2- 172.21.15.159:0/3268606515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e0003fd0 0x7f69e0004800 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f69ec009b50 tx=0x7f69e0005830 comp rx=0 tx=0).stop 2024-07-24T16:24:40.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.013+0000 7f69f7fff640 1 -- 172.21.15.159:0/3268606515 reap_dead start 2024-07-24T16:24:40.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.013+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3268606515 shutdown_connections 2024-07-24T16:24:40.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.013+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3268606515 >> 172.21.15.159:0/3268606515 conn(0x7f69f80b36f0 msgr2=0x7f69f80b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:40.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.013+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3268606515 shutdown_connections 2024-07-24T16:24:40.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.013+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3268606515 wait complete. 2024-07-24T16:24:40.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.014+0000 7f69fdbe8640 1 Processor -- start 2024-07-24T16:24:40.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.014+0000 7f69fdbe8640 1 -- start start 2024-07-24T16:24:40.018 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69fdbe8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e0003fd0 0x7f69f8150360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:40.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69fdbe8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69f814d540 0x7f69f81544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:40.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69fdbe8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69f8154a10 0x7f69f8148a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:40.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69fdbe8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f69f80b5450 con 0x7f69e0003fd0 2024-07-24T16:24:40.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69fdbe8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f69f8071910 con 0x7f69f814d540 2024-07-24T16:24:40.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69fdbe8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f69f80b55d0 con 0x7f69f8154a10 2024-07-24T16:24:40.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69f77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e0003fd0 0x7f69f8150360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:40.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69f77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e0003fd0 0x7f69f8150360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43532/0 (socket says 172.21.15.159:43532) 2024-07-24T16:24:40.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69f77fe640 1 -- 172.21.15.159:0/3449121711 learned_addr learned my addr 172.21.15.159:0/3449121711 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:40.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69f77fe640 1 -- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69f8154a10 msgr2=0x7f69f8148a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:40.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69f6ffd640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69f814d540 0x7f69f81544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:40.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69f7fff640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69f8154a10 0x7f69f8148a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:40.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69f77fe640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69f8154a10 0x7f69f8148a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:40.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69f77fe640 1 -- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69f814d540 msgr2=0x7f69f81544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:40.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69f77fe640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69f814d540 0x7f69f81544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:40.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69f77fe640 1 -- 172.21.15.159:0/3449121711 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69f814d9a0 con 0x7f69e0003fd0 2024-07-24T16:24:40.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69f77fe640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e0003fd0 0x7f69f8150360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f69e80063d0 tx=0x7f69e8006890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:40.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69dffff640 1 -- 172.21.15.159:0/3449121711 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8015070 con 0x7f69e0003fd0 2024-07-24T16:24:40.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69dffff640 1 -- 172.21.15.159:0/3449121711 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69e800fcc0 con 0x7f69e0003fd0 2024-07-24T16:24:40.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69dffff640 1 -- 172.21.15.159:0/3449121711 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e8011670 con 0x7f69e0003fd0 2024-07-24T16:24:40.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.015+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3449121711 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69f81f1f00 con 0x7f69e0003fd0 2024-07-24T16:24:40.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.016+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3449121711 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69f81f24c0 con 0x7f69e0003fd0 2024-07-24T16:24:40.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.017+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3449121711 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f8152bf0 con 0x7f69e0003fd0 2024-07-24T16:24:40.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.017+0000 7f69dffff640 1 -- 172.21.15.159:0/3449121711 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f69e8011810 con 0x7f69e0003fd0 2024-07-24T16:24:40.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.017+0000 7f69dffff640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69e4077010 0x7f69e40794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:40.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.018+0000 7f69dffff640 1 -- 172.21.15.159:0/3449121711 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f69e8099c10 con 0x7f69e0003fd0 2024-07-24T16:24:40.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.018+0000 7f69f6ffd640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69e4077010 0x7f69e40794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:40.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.018+0000 7f69f6ffd640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69e4077010 0x7f69e40794d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f69ec035000 tx=0x7f69ec0046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:40.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.021+0000 7f69dffff640 1 -- 172.21.15.159:0/3449121711 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f69e8062b70 con 0x7f69e0003fd0 2024-07-24T16:24:40.074 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:24:40.077 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:24:40.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.208+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3449121711 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f69f8071ac0 con 0x7f69e0003fd0 2024-07-24T16:24:40.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.209+0000 7f69dffff640 1 -- 172.21.15.159:0/3449121711 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f69f8071ac0 con 0x7f69e0003fd0 2024-07-24T16:24:40.211 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 32 2024-07-24T16:24:40.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.211+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69e4077010 msgr2=0x7f69e40794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:40.213 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.211+0000 7f69fdbe8640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69e4077010 0x7f69e40794d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f69ec035000 tx=0x7f69ec0046c0 comp rx=0 tx=0).stop 2024-07-24T16:24:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.211+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3449121711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e0003fd0 msgr2=0x7f69f8150360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.211+0000 7f69fdbe8640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e0003fd0 0x7f69f8150360 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f69e80063d0 tx=0x7f69e8006890 comp rx=0 tx=0).stop 2024-07-24T16:24:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.211+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3449121711 shutdown_connections 2024-07-24T16:24:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.211+0000 7f69fdbe8640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69e4077010 0x7f69e40794d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.211+0000 7f69fdbe8640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69f8154a10 0x7f69f8148a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.211+0000 7f69fdbe8640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69f814d540 0x7f69f81544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.211+0000 7f69fdbe8640 1 --2- 172.21.15.159:0/3449121711 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69e0003fd0 0x7f69f8150360 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.211+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3449121711 >> 172.21.15.159:0/3449121711 conn(0x7f69f80b36f0 msgr2=0x7f69f815d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.211+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3449121711 shutdown_connections 2024-07-24T16:24:40.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.211+0000 7f69fdbe8640 1 -- 172.21.15.159:0/3449121711 wait complete. 2024-07-24T16:24:40.225 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2024-07-24T16:24:40.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.325+0000 7f478f465640 1 -- 172.21.15.159:0/454957161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47880d0350 msgr2=0x7f47880cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:40.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.325+0000 7f478f465640 1 --2- 172.21.15.159:0/454957161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47880d0350 0x7f47880cd760 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f477c005fd0 tx=0x7f477c02a670 comp rx=0 tx=0).stop 2024-07-24T16:24:40.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.325+0000 7f478f465640 1 -- 172.21.15.159:0/454957161 shutdown_connections 2024-07-24T16:24:40.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.325+0000 7f478f465640 1 --2- 172.21.15.159:0/454957161 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47880d0350 0x7f47880cd760 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:40.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.325+0000 7f478f465640 1 -- 172.21.15.159:0/454957161 >> 172.21.15.159:0/454957161 conn(0x7f47880cf860 msgr2=0x7f47880cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:40.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.325+0000 7f478f465640 1 -- 172.21.15.159:0/454957161 shutdown_connections 2024-07-24T16:24:40.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.325+0000 7f478f465640 1 -- 172.21.15.159:0/454957161 wait complete. 2024-07-24T16:24:40.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.327+0000 7f478f465640 1 Processor -- start 2024-07-24T16:24:40.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.327+0000 7f478f465640 1 -- start start 2024-07-24T16:24:40.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.327+0000 7f478f465640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47880b2910 0x7f4788158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:40.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.327+0000 7f478f465640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f478815d8b0 0x7f47881580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:40.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.327+0000 7f478f465640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47880b0740 0x7f47881f6de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:40.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.327+0000 7f478f465640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f47880ce3b0 con 0x7f47880b2910 2024-07-24T16:24:40.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.327+0000 7f478f465640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f47880b4980 con 0x7f47880b0740 2024-07-24T16:24:40.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.327+0000 7f478f465640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f47880ce530 con 0x7f478815d8b0 2024-07-24T16:24:40.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.327+0000 7f478d201640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47880b2910 0x7f4788158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:40.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f478d201640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47880b2910 0x7f4788158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43550/0 (socket says 172.21.15.159:43550) 2024-07-24T16:24:40.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f478d201640 1 -- 172.21.15.159:0/2895048846 learned_addr learned my addr 172.21.15.159:0/2895048846 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:40.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f478da02640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47880b0740 0x7f47881f6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:40.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f478ca00640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f478815d8b0 0x7f47881580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:40.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f478d201640 1 -- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f478815d8b0 msgr2=0x7f47881580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:40.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f478d201640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f478815d8b0 0x7f47881580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:40.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f478d201640 1 -- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47880b0740 msgr2=0x7f47881f6de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:40.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f478d201640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47880b0740 0x7f47881f6de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:40.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f478d201640 1 -- 172.21.15.159:0/2895048846 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4788159210 con 0x7f47880b2910 2024-07-24T16:24:40.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f478d201640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47880b2910 0x7f4788158c30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f477800c3a0 tx=0x7f477800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:40.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f4785ffb640 1 -- 172.21.15.159:0/2895048846 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778017070 con 0x7f47880b2910 2024-07-24T16:24:40.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f4785ffb640 1 -- 172.21.15.159:0/2895048846 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f47780053c0 con 0x7f47880b2910 2024-07-24T16:24:40.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f478f465640 1 -- 172.21.15.159:0/2895048846 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47881594f0 con 0x7f47880b2910 2024-07-24T16:24:40.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f4785ffb640 1 -- 172.21.15.159:0/2895048846 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4778003850 con 0x7f47880b2910 2024-07-24T16:24:40.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.328+0000 7f478f465640 1 -- 172.21.15.159:0/2895048846 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47881597d0 con 0x7f47880b2910 2024-07-24T16:24:40.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.330+0000 7f478f465640 1 -- 172.21.15.159:0/2895048846 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47880ce980 con 0x7f47880b2910 2024-07-24T16:24:40.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.330+0000 7f4785ffb640 1 -- 172.21.15.159:0/2895048846 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f477801a070 con 0x7f47880b2910 2024-07-24T16:24:40.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.330+0000 7f4785ffb640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4774077010 0x7f47740794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:40.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.331+0000 7f4785ffb640 1 -- 172.21.15.159:0/2895048846 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f4778097ef0 con 0x7f47880b2910 2024-07-24T16:24:40.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.331+0000 7f478ca00640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4774077010 0x7f47740794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:40.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.331+0000 7f478ca00640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4774077010 0x7f47740794d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f477c033000 tx=0x7f477c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:40.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.335+0000 7f4785ffb640 1 -- 172.21.15.159:0/2895048846 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f4778060800 con 0x7f47880b2910 2024-07-24T16:24:40.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:40.591+0000 7f478f465640 1 -- 172.21.15.159:0/2895048846 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) -- 0x7f478806f240 con 0x7f47880b2910 2024-07-24T16:24:41.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.538+0000 7f4785ffb640 1 -- 172.21.15.159:0/2895048846 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v50) ==== 161+0+0 (secure 0 0 0) 0x7f4778069090 con 0x7f47880b2910 2024-07-24T16:24:41.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.541+0000 7f478f465640 1 -- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4774077010 msgr2=0x7f47740794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:41.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.541+0000 7f478f465640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4774077010 0x7f47740794d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f477c033000 tx=0x7f477c004730 comp rx=0 tx=0).stop 2024-07-24T16:24:41.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.541+0000 7f478f465640 1 -- 172.21.15.159:0/2895048846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47880b2910 msgr2=0x7f4788158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:41.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.541+0000 7f478f465640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47880b2910 0x7f4788158c30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f477800c3a0 tx=0x7f477800c860 comp rx=0 tx=0).stop 2024-07-24T16:24:41.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.541+0000 7f478f465640 1 -- 172.21.15.159:0/2895048846 shutdown_connections 2024-07-24T16:24:41.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.541+0000 7f478f465640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4774077010 0x7f47740794d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.541+0000 7f478f465640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f47880b0740 0x7f47881f6de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.541+0000 7f478f465640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f478815d8b0 0x7f47881580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.541+0000 7f478f465640 1 --2- 172.21.15.159:0/2895048846 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f47880b2910 0x7f4788158c30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.541+0000 7f478f465640 1 -- 172.21.15.159:0/2895048846 >> 172.21.15.159:0/2895048846 conn(0x7f47880cf860 msgr2=0x7f478806de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:41.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.541+0000 7f478f465640 1 -- 172.21.15.159:0/2895048846 shutdown_connections 2024-07-24T16:24:41.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.541+0000 7f478f465640 1 -- 172.21.15.159:0/2895048846 wait complete. 2024-07-24T16:24:41.558 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-07-24T16:24:41.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.664+0000 7f7de4d79640 1 -- 172.21.15.159:0/544913180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de0157d50 msgr2=0x7f7de00cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:41.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.664+0000 7f7de4d79640 1 --2- 172.21.15.159:0/544913180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de0157d50 0x7f7de00cf410 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0005fd0 tx=0x7f7dd002aa80 comp rx=0 tx=0).stop 2024-07-24T16:24:41.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.664+0000 7f7de4d79640 1 -- 172.21.15.159:0/544913180 shutdown_connections 2024-07-24T16:24:41.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.664+0000 7f7de4d79640 1 --2- 172.21.15.159:0/544913180 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7de006f1c0 0x7f7de015b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.664+0000 7f7de4d79640 1 --2- 172.21.15.159:0/544913180 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de0157d50 0x7f7de00cf410 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.664+0000 7f7de4d79640 1 -- 172.21.15.159:0/544913180 >> 172.21.15.159:0/544913180 conn(0x7f7de006d450 msgr2=0x7f7de006d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:41.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.664+0000 7f7de4d79640 1 -- 172.21.15.159:0/544913180 shutdown_connections 2024-07-24T16:24:41.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.664+0000 7f7de4d79640 1 -- 172.21.15.159:0/544913180 wait complete. 2024-07-24T16:24:41.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.665+0000 7f7de4d79640 1 Processor -- start 2024-07-24T16:24:41.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.665+0000 7f7de4d79640 1 -- start start 2024-07-24T16:24:41.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.666+0000 7f7de4d79640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7de006f1c0 0x7f7de0150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:41.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.666+0000 7f7de4d79640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7de006fdf0 0x7f7de00b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:41.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.666+0000 7f7de4d79640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de0157d50 0x7f7de00b4410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:41.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.666+0000 7f7de4d79640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7de00705d0 con 0x7f7de0157d50 2024-07-24T16:24:41.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.666+0000 7f7de4d79640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7de0070450 con 0x7f7de006fdf0 2024-07-24T16:24:41.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.666+0000 7f7de4d79640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7de0070750 con 0x7f7de006f1c0 2024-07-24T16:24:41.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.666+0000 7f7dded9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de0157d50 0x7f7de00b4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:41.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.666+0000 7f7dded9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de0157d50 0x7f7de00b4410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55072/0 (socket says 172.21.15.159:55072) 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.666+0000 7f7dded9d640 1 -- 172.21.15.159:0/2928621444 learned_addr learned my addr 172.21.15.159:0/2928621444 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.666+0000 7f7dddd9b640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7de006fdf0 0x7f7de00b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.666+0000 7f7dde59c640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7de006f1c0 0x7f7de0150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.667+0000 7f7dded9d640 1 -- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7de006f1c0 msgr2=0x7f7de0150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.667+0000 7f7dded9d640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7de006f1c0 0x7f7de0150910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.667+0000 7f7dded9d640 1 -- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7de006fdf0 msgr2=0x7f7de00b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.667+0000 7f7dded9d640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7de006fdf0 0x7f7de00b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.667+0000 7f7dded9d640 1 -- 172.21.15.159:0/2928621444 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de0151d20 con 0x7f7de0157d50 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.667+0000 7f7dded9d640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de0157d50 0x7f7de00b4410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800c400 tx=0x7f7dd800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.667+0000 7f7dceffd640 1 -- 172.21.15.159:0/2928621444 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8017070 con 0x7f7de0157d50 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.667+0000 7f7dceffd640 1 -- 172.21.15.159:0/2928621444 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7dd80053c0 con 0x7f7de0157d50 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.667+0000 7f7de4d79640 1 -- 172.21.15.159:0/2928621444 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de0151fc0 con 0x7f7de0157d50 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.667+0000 7f7dceffd640 1 -- 172.21.15.159:0/2928621444 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd8003850 con 0x7f7de0157d50 2024-07-24T16:24:41.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.667+0000 7f7de4d79640 1 -- 172.21.15.159:0/2928621444 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de0153560 con 0x7f7de0157d50 2024-07-24T16:24:41.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.668+0000 7f7de4d79640 1 -- 172.21.15.159:0/2928621444 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de015b3c0 con 0x7f7de0157d50 2024-07-24T16:24:41.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.669+0000 7f7dceffd640 1 -- 172.21.15.159:0/2928621444 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f7dd801a070 con 0x7f7de0157d50 2024-07-24T16:24:41.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.669+0000 7f7dceffd640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7dc0077040 0x7f7dc0079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:41.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.669+0000 7f7dceffd640 1 -- 172.21.15.159:0/2928621444 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7dd8098020 con 0x7f7de0157d50 2024-07-24T16:24:41.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.669+0000 7f7dde59c640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7dc0077040 0x7f7dc0079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:41.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.670+0000 7f7dde59c640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7dc0077040 0x7f7dc0079500 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0035000 tx=0x7f7dd0038040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:41.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.673+0000 7f7dceffd640 1 -- 172.21.15.159:0/2928621444 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f7dd80608a0 con 0x7f7de0157d50 2024-07-24T16:24:41.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.856+0000 7f7de4d79640 1 -- 172.21.15.159:0/2928621444 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f7de01586e0 con 0x7f7de0157d50 2024-07-24T16:24:41.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.857+0000 7f7dceffd640 1 -- 172.21.15.159:0/2928621444 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7f7dd8069130 con 0x7f7de0157d50 2024-07-24T16:24:41.859 INFO:teuthology.orchestra.run.smithi159.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-07-24T16:24:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:mon advanced mon_op_complaint_time 120 2024-07-24T16:24:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:mon dev mon_warn_on_pool_no_app false 2024-07-24T16:24:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:osd advanced osd_op_complaint_time 180.000000 2024-07-24T16:24:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4982.532139 2024-07-24T16:24:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4864.100659 2024-07-24T16:24:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4804.732208 2024-07-24T16:24:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4907.470759 2024-07-24T16:24:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5216.011683 2024-07-24T16:24:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5107.248647 2024-07-24T16:24:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5234.144198 2024-07-24T16:24:41.860 INFO:teuthology.orchestra.run.smithi159.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5443.221614 2024-07-24T16:24:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced debug_mds 20/20 2024-07-24T16:24:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced debug_mds_balancer 20/20 2024-07-24T16:24:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced debug_ms 1/1 2024-07-24T16:24:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:mds dev mds_debug_frag true 2024-07-24T16:24:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:mds dev mds_debug_scatterstat true 2024-07-24T16:24:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced mds_op_complaint_time 180.000000 2024-07-24T16:24:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:mds dev mds_verify_scatter true 2024-07-24T16:24:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced osd_op_complaint_time 180.000000 2024-07-24T16:24:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced rados_mon_op_timeout 900 2024-07-24T16:24:41.861 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced rados_osd_op_timeout 900 2024-07-24T16:24:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:client advanced client_mount_timeout 600 2024-07-24T16:24:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:client advanced debug_client 20/20 2024-07-24T16:24:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:client advanced debug_ms 1/1 2024-07-24T16:24:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:client advanced rados_mon_op_timeout 900 2024-07-24T16:24:41.862 INFO:teuthology.orchestra.run.smithi159.stdout:client advanced rados_osd_op_timeout 900 2024-07-24T16:24:41.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.859+0000 7f7de4d79640 1 -- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7dc0077040 msgr2=0x7f7dc0079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:41.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.859+0000 7f7de4d79640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7dc0077040 0x7f7dc0079500 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0035000 tx=0x7f7dd0038040 comp rx=0 tx=0).stop 2024-07-24T16:24:41.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.859+0000 7f7de4d79640 1 -- 172.21.15.159:0/2928621444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de0157d50 msgr2=0x7f7de00b4410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:41.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.859+0000 7f7de4d79640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de0157d50 0x7f7de00b4410 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f7dd800c400 tx=0x7f7dd800c8c0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.859+0000 7f7de4d79640 1 -- 172.21.15.159:0/2928621444 shutdown_connections 2024-07-24T16:24:41.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.859+0000 7f7de4d79640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7dc0077040 0x7f7dc0079500 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.859+0000 7f7de4d79640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7de0157d50 0x7f7de00b4410 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.859+0000 7f7de4d79640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7de006fdf0 0x7f7de00b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.859+0000 7f7de4d79640 1 --2- 172.21.15.159:0/2928621444 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7de006f1c0 0x7f7de0150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.859+0000 7f7de4d79640 1 -- 172.21.15.159:0/2928621444 >> 172.21.15.159:0/2928621444 conn(0x7f7de006d450 msgr2=0x7f7de00682a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:41.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.859+0000 7f7de4d79640 1 -- 172.21.15.159:0/2928621444 shutdown_connections 2024-07-24T16:24:41.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.859+0000 7f7de4d79640 1 -- 172.21.15.159:0/2928621444 wait complete. 2024-07-24T16:24:41.872 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-07-24T16:24:41.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.977+0000 7f9636e65640 1 -- 172.21.15.159:0/2592577885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f963006dba0 msgr2=0x7f96300cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:41.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.977+0000 7f9636e65640 1 --2- 172.21.15.159:0/2592577885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f963006dba0 0x7f96300cbc10 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f963006fe40 tx=0x7f962402a530 comp rx=0 tx=0).stop 2024-07-24T16:24:41.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.977+0000 7f9636e65640 1 -- 172.21.15.159:0/2592577885 shutdown_connections 2024-07-24T16:24:41.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.977+0000 7f9636e65640 1 --2- 172.21.15.159:0/2592577885 >> v2:172.21.15.193:3300/0 conn(0x7f96300cfb50 0x7f963015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.977+0000 7f9636e65640 1 --2- 172.21.15.159:0/2592577885 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f963006dba0 0x7f96300cbc10 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.977+0000 7f9636e65640 1 -- 172.21.15.159:0/2592577885 >> 172.21.15.159:0/2592577885 conn(0x7f963006c560 msgr2=0x7f963006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:41.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.977+0000 7f9636e65640 1 -- 172.21.15.159:0/2592577885 shutdown_connections 2024-07-24T16:24:41.980 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.977+0000 7f9636e65640 1 -- 172.21.15.159:0/2592577885 wait complete. 2024-07-24T16:24:41.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.979+0000 7f9636e65640 1 Processor -- start 2024-07-24T16:24:41.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.979+0000 7f9636e65640 1 -- start start 2024-07-24T16:24:41.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9636e65640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f963006dba0 0x7f963014f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:41.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9636e65640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96300cf770 0x7f96301f2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:41.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9636e65640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f96300cfb50 0x7f963013fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:41.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9636e65640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f96300aea60 con 0x7f963006dba0 2024-07-24T16:24:41.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9636e65640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f96300ae8e0 con 0x7f96300cf770 2024-07-24T16:24:41.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9636e65640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f96300aebe0 con 0x7f96300cfb50 2024-07-24T16:24:41.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9634c01640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f963006dba0 0x7f963014f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:41.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9634c01640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f963006dba0 0x7f963014f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55092/0 (socket says 172.21.15.159:55092) 2024-07-24T16:24:41.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9634c01640 1 -- 172.21.15.159:0/3912512379 learned_addr learned my addr 172.21.15.159:0/3912512379 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:41.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f962ffff640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96300cf770 0x7f96301f2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:41.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9635402640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f96300cfb50 0x7f963013fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:41.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9634c01640 1 -- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f96300cfb50 msgr2=0x7f963013fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:41.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9634c01640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f96300cfb50 0x7f963013fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9634c01640 1 -- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96300cf770 msgr2=0x7f96301f2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:41.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9634c01640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96300cf770 0x7f96301f2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:41.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9634c01640 1 -- 172.21.15.159:0/3912512379 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96301403e0 con 0x7f963006dba0 2024-07-24T16:24:41.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f962ffff640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96300cf770 0x7f96301f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:41.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9634c01640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f963006dba0 0x7f963014f5c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f962000c430 tx=0x7f962000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:41.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f962d7fa640 1 -- 172.21.15.159:0/3912512379 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620011790 con 0x7f963006dba0 2024-07-24T16:24:41.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f962d7fa640 1 -- 172.21.15.159:0/3912512379 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9620017070 con 0x7f963006dba0 2024-07-24T16:24:41.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9636e65640 1 -- 172.21.15.159:0/3912512379 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96301406c0 con 0x7f963006dba0 2024-07-24T16:24:41.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f962d7fa640 1 -- 172.21.15.159:0/3912512379 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620011d00 con 0x7f963006dba0 2024-07-24T16:24:41.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.980+0000 7f9636e65640 1 -- 172.21.15.159:0/3912512379 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96301f2310 con 0x7f963006dba0 2024-07-24T16:24:41.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.981+0000 7f9636e65640 1 -- 172.21.15.159:0/3912512379 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96301f1e60 con 0x7f963006dba0 2024-07-24T16:24:41.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.982+0000 7f962d7fa640 1 -- 172.21.15.159:0/3912512379 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f962001c460 con 0x7f963006dba0 2024-07-24T16:24:41.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.982+0000 7f962d7fa640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f961c077040 0x7f961c079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:41.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.983+0000 7f962d7fa640 1 -- 172.21.15.159:0/3912512379 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9620098b00 con 0x7f963006dba0 2024-07-24T16:24:41.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.983+0000 7f962ffff640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f961c077040 0x7f961c079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:41.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.983+0000 7f962ffff640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f961c077040 0x7f961c079500 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9624033000 tx=0x7f9624004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:41.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:41.987+0000 7f962d7fa640 1 -- 172.21.15.159:0/3912512379 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f9620061a50 con 0x7f963006dba0 2024-07-24T16:24:42.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.170+0000 7f9636e65640 1 -- 172.21.15.159:0/3912512379 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f963015b4b0 con 0x7f963006dba0 2024-07-24T16:24:42.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.173+0000 7f962d7fa640 1 -- 172.21.15.159:0/3912512379 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f9620061350 con 0x7f963006dba0 2024-07-24T16:24:42.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.175+0000 7f9636e65640 1 -- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f961c077040 msgr2=0x7f961c079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:42.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.175+0000 7f9636e65640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f961c077040 0x7f961c079500 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f9624033000 tx=0x7f9624004730 comp rx=0 tx=0).stop 2024-07-24T16:24:42.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.175+0000 7f9636e65640 1 -- 172.21.15.159:0/3912512379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f963006dba0 msgr2=0x7f963014f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:42.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.175+0000 7f9636e65640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f963006dba0 0x7f963014f5c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f962000c430 tx=0x7f962000c8f0 comp rx=0 tx=0).stop 2024-07-24T16:24:42.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.175+0000 7f9636e65640 1 -- 172.21.15.159:0/3912512379 shutdown_connections 2024-07-24T16:24:42.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.175+0000 7f9636e65640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f961c077040 0x7f961c079500 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:42.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.175+0000 7f9636e65640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f96300cfb50 0x7f963013fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:42.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.175+0000 7f9636e65640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96300cf770 0x7f96301f2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:42.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.175+0000 7f9636e65640 1 --2- 172.21.15.159:0/3912512379 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f963006dba0 0x7f963014f5c0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:42.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.175+0000 7f9636e65640 1 -- 172.21.15.159:0/3912512379 >> 172.21.15.159:0/3912512379 conn(0x7f963006c560 msgr2=0x7f96300ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:42.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.175+0000 7f9636e65640 1 -- 172.21.15.159:0/3912512379 shutdown_connections 2024-07-24T16:24:42.179 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.175+0000 7f9636e65640 1 -- 172.21.15.159:0/3912512379 wait complete. 2024-07-24T16:24:42.189 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-07-24T16:24:42.189 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-24T16:24:42.227 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-24T16:24:42.275 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-07-24T16:24:42.275 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:24:42.276 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:42.291 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:24:42.292 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:42.347 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:24:42.347 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:42.403 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-24T16:24:42.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.544+0000 7f5f9afae640 1 -- 172.21.15.159:0/3051620762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f9415a220 msgr2=0x7f5f940b58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:42.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.544+0000 7f5f9afae640 1 --2- 172.21.15.159:0/3051620762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f9415a220 0x7f5f940b58a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c005fd0 tx=0x7f5f8c02a540 comp rx=0 tx=0).stop 2024-07-24T16:24:42.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.544+0000 7f5f9afae640 1 -- 172.21.15.159:0/3051620762 shutdown_connections 2024-07-24T16:24:42.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.544+0000 7f5f9afae640 1 --2- 172.21.15.159:0/3051620762 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f940ceb10 0x7f5f9406ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:42.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.544+0000 7f5f9afae640 1 --2- 172.21.15.159:0/3051620762 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f9415a220 0x7f5f940b58a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:42.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.544+0000 7f5f9afae640 1 -- 172.21.15.159:0/3051620762 >> 172.21.15.159:0/3051620762 conn(0x7f5f94071140 msgr2=0x7f5f9406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:42.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.544+0000 7f5f9afae640 1 -- 172.21.15.159:0/3051620762 shutdown_connections 2024-07-24T16:24:42.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.544+0000 7f5f9afae640 1 -- 172.21.15.159:0/3051620762 wait complete. 2024-07-24T16:24:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.545+0000 7f5f9afae640 1 Processor -- start 2024-07-24T16:24:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.545+0000 7f5f9afae640 1 -- start start 2024-07-24T16:24:42.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.546+0000 7f5f9afae640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f940b5de0 0x7f5f941f3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:42.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.546+0000 7f5f9afae640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f940ceb10 0x7f5f94072bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:42.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.546+0000 7f5f9afae640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f9415a220 0x7f5f940cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:42.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.546+0000 7f5f9afae640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9406f280 con 0x7f5f9415a220 2024-07-24T16:24:42.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.546+0000 7f5f9afae640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9406f100 con 0x7f5f940ceb10 2024-07-24T16:24:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.546+0000 7f5f9afae640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5f9406f400 con 0x7f5f940b5de0 2024-07-24T16:24:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.546+0000 7f5f9954b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f9415a220 0x7f5f940cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.546+0000 7f5f9954b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f9415a220 0x7f5f940cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55102/0 (socket says 172.21.15.159:55102) 2024-07-24T16:24:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.546+0000 7f5f9954b640 1 -- 172.21.15.159:0/1715464821 learned_addr learned my addr 172.21.15.159:0/1715464821 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.546+0000 7f5f98d4a640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f940b5de0 0x7f5f941f3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.546+0000 7f5f93fff640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f940ceb10 0x7f5f94072bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.547+0000 7f5f9954b640 1 -- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f940b5de0 msgr2=0x7f5f941f3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.547+0000 7f5f9954b640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f940b5de0 0x7f5f941f3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.547+0000 7f5f9954b640 1 -- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f940ceb10 msgr2=0x7f5f94072bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.547+0000 7f5f9954b640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f940ceb10 0x7f5f94072bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.547+0000 7f5f9954b640 1 -- 172.21.15.159:0/1715464821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f94157170 con 0x7f5f9415a220 2024-07-24T16:24:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.547+0000 7f5f9954b640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f9415a220 0x7f5f940cd560 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00d780 tx=0x7f5f7c00dc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.547+0000 7f5f917fa640 1 -- 172.21.15.159:0/1715464821 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c017070 con 0x7f5f9415a220 2024-07-24T16:24:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.547+0000 7f5f917fa640 1 -- 172.21.15.159:0/1715464821 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f7c00de90 con 0x7f5f9415a220 2024-07-24T16:24:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.547+0000 7f5f9afae640 1 -- 172.21.15.159:0/1715464821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f94157450 con 0x7f5f9415a220 2024-07-24T16:24:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.547+0000 7f5f917fa640 1 -- 172.21.15.159:0/1715464821 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7c005020 con 0x7f5f9415a220 2024-07-24T16:24:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.547+0000 7f5f9afae640 1 -- 172.21.15.159:0/1715464821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f94157a10 con 0x7f5f9415a220 2024-07-24T16:24:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.548+0000 7f5f9afae640 1 -- 172.21.15.159:0/1715464821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9406ebc0 con 0x7f5f9415a220 2024-07-24T16:24:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.549+0000 7f5f917fa640 1 -- 172.21.15.159:0/1715464821 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5f7c0051c0 con 0x7f5f9415a220 2024-07-24T16:24:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.549+0000 7f5f917fa640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5f74077040 0x7f5f74079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.549+0000 7f5f917fa640 1 -- 172.21.15.159:0/1715464821 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5f7c098ab0 con 0x7f5f9415a220 2024-07-24T16:24:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.549+0000 7f5f98d4a640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5f74077040 0x7f5f74079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.550+0000 7f5f98d4a640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5f74077040 0x7f5f74079500 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c033000 tx=0x7f5f8c004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:42.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.553+0000 7f5f917fa640 1 -- 172.21.15.159:0/1715464821 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f5f7c061440 con 0x7f5f9415a220 2024-07-24T16:24:42.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.750+0000 7f5f9afae640 1 -- 172.21.15.159:0/1715464821 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5f9415dc00 con 0x7f5f9415a220 2024-07-24T16:24:42.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.751+0000 7f5f917fa640 1 -- 172.21.15.159:0/1715464821 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f5f7c065990 con 0x7f5f9415a220 2024-07-24T16:24:42.753 INFO:teuthology.orchestra.run.smithi159.stderr:listed 0 entries 2024-07-24T16:24:42.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.753+0000 7f5f9afae640 1 -- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5f74077040 msgr2=0x7f5f74079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:42.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.753+0000 7f5f9afae640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5f74077040 0x7f5f74079500 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c033000 tx=0x7f5f8c004730 comp rx=0 tx=0).stop 2024-07-24T16:24:42.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.753+0000 7f5f9afae640 1 -- 172.21.15.159:0/1715464821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f9415a220 msgr2=0x7f5f940cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:42.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.753+0000 7f5f9afae640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f9415a220 0x7f5f940cd560 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c00d780 tx=0x7f5f7c00dc40 comp rx=0 tx=0).stop 2024-07-24T16:24:42.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.753+0000 7f5f9afae640 1 -- 172.21.15.159:0/1715464821 shutdown_connections 2024-07-24T16:24:42.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.753+0000 7f5f9afae640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5f74077040 0x7f5f74079500 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:42.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.753+0000 7f5f9afae640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5f9415a220 0x7f5f940cd560 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:42.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.753+0000 7f5f9afae640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5f940ceb10 0x7f5f94072bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:42.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.753+0000 7f5f9afae640 1 --2- 172.21.15.159:0/1715464821 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5f940b5de0 0x7f5f941f3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:42.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.753+0000 7f5f9afae640 1 -- 172.21.15.159:0/1715464821 >> 172.21.15.159:0/1715464821 conn(0x7f5f94071140 msgr2=0x7f5f9415b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:42.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.753+0000 7f5f9afae640 1 -- 172.21.15.159:0/1715464821 shutdown_connections 2024-07-24T16:24:42.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:42.753+0000 7f5f9afae640 1 -- 172.21.15.159:0/1715464821 wait complete. 2024-07-24T16:24:42.766 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-07-24T16:24:42.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:42.767 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-07-24T16:24:42.792 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:24:42.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:42.792 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-07-24T16:24:42.848 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:24:42.848 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:42.868 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:24:42.868 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:42.926 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:24:42.927 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:42.985 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-24T16:24:43.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.088+0000 7fcb011cb640 1 -- 172.21.15.159:0/3446967139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcafc072b50 msgr2=0x7fcafc072f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:43.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.088+0000 7fcb011cb640 1 --2- 172.21.15.159:0/3446967139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcafc072b50 0x7fcafc072f90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcafc074310 tx=0x7fcaf402a560 comp rx=0 tx=0).stop 2024-07-24T16:24:43.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.088+0000 7fcb011cb640 1 -- 172.21.15.159:0/3446967139 shutdown_connections 2024-07-24T16:24:43.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.088+0000 7fcb011cb640 1 --2- 172.21.15.159:0/3446967139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcafc072b50 0x7fcafc072f90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.088+0000 7fcb011cb640 1 --2- 172.21.15.159:0/3446967139 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcafc0b4e70 0x7fcafc070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.088+0000 7fcb011cb640 1 --2- 172.21.15.159:0/3446967139 >> v2:172.21.15.193:3300/0 conn(0x7fcafc15a330 0x7fcafc0cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.088+0000 7fcb011cb640 1 -- 172.21.15.159:0/3446967139 >> 172.21.15.159:0/3446967139 conn(0x7fcafc0b2230 msgr2=0x7fcafc0b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:43.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.088+0000 7fcb011cb640 1 -- 172.21.15.159:0/3446967139 shutdown_connections 2024-07-24T16:24:43.091 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.088+0000 7fcb011cb640 1 -- 172.21.15.159:0/3446967139 wait complete. 2024-07-24T16:24:43.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.089+0000 7fcb011cb640 1 Processor -- start 2024-07-24T16:24:43.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.089+0000 7fcb011cb640 1 -- start start 2024-07-24T16:24:43.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcb011cb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcafc072b50 0x7fcafc154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:43.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcb011cb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcafc0b4e70 0x7fcafc14e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:43.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcb011cb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcafc15a330 0x7fcafc1591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:43.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcb011cb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc0cd5b0 con 0x7fcafc0b4e70 2024-07-24T16:24:43.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcb011cb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcafc0cd430 con 0x7fcafc072b50 2024-07-24T16:24:43.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcb011cb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcafc0cd730 con 0x7fcafc15a330 2024-07-24T16:24:43.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcafa59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcafc0b4e70 0x7fcafc14e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:43.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcafa59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcafc0b4e70 0x7fcafc14e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55124/0 (socket says 172.21.15.159:55124) 2024-07-24T16:24:43.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcafa59c640 1 -- 172.21.15.159:0/2846934214 learned_addr learned my addr 172.21.15.159:0/2846934214 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:43.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcafad9d640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcafc072b50 0x7fcafc154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:43.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcafb59e640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcafc15a330 0x7fcafc1591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:43.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcafa59c640 1 -- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcafc15a330 msgr2=0x7fcafc1591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:43.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcafa59c640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcafc15a330 0x7fcafc1591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcafa59c640 1 -- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcafc072b50 msgr2=0x7fcafc154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:43.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcafa59c640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcafc072b50 0x7fcafc154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.090+0000 7fcafa59c640 1 -- 172.21.15.159:0/2846934214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcafc1f5f90 con 0x7fcafc0b4e70 2024-07-24T16:24:43.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.091+0000 7fcafad9d640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcafc072b50 0x7fcafc154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:43.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.091+0000 7fcafa59c640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcafc0b4e70 0x7fcafc14e150 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcae400d750 tx=0x7fcae400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:43.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.091+0000 7fcaf37fe640 1 -- 172.21.15.159:0/2846934214 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae4017070 con 0x7fcafc0b4e70 2024-07-24T16:24:43.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.091+0000 7fcb011cb640 1 -- 172.21.15.159:0/2846934214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcafc1537b0 con 0x7fcafc0b4e70 2024-07-24T16:24:43.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.091+0000 7fcaf37fe640 1 -- 172.21.15.159:0/2846934214 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcae4009cc0 con 0x7fcafc0b4e70 2024-07-24T16:24:43.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.091+0000 7fcaf37fe640 1 -- 172.21.15.159:0/2846934214 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae400de60 con 0x7fcafc0b4e70 2024-07-24T16:24:43.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.091+0000 7fcb011cb640 1 -- 172.21.15.159:0/2846934214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcafc153d70 con 0x7fcafc0b4e70 2024-07-24T16:24:43.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.092+0000 7fcb011cb640 1 -- 172.21.15.159:0/2846934214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcafc070070 con 0x7fcafc0b4e70 2024-07-24T16:24:43.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.092+0000 7fcaf37fe640 1 -- 172.21.15.159:0/2846934214 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fcae4005280 con 0x7fcafc0b4e70 2024-07-24T16:24:43.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.093+0000 7fcaf37fe640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcadc077010 0x7fcadc0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:43.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.093+0000 7fcaf37fe640 1 -- 172.21.15.159:0/2846934214 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcae4098de0 con 0x7fcafc0b4e70 2024-07-24T16:24:43.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.093+0000 7fcafad9d640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcadc077010 0x7fcadc0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:43.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.094+0000 7fcafad9d640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcadc077010 0x7fcadc0794d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcaec005fd0 tx=0x7fcaec0093f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:43.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.097+0000 7fcaf37fe640 1 -- 172.21.15.159:0/2846934214 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fcae4061cb0 con 0x7fcafc0b4e70 2024-07-24T16:24:43.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.294+0000 7fcb011cb640 1 -- 172.21.15.159:0/2846934214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcafc156660 con 0x7fcafc0b4e70 2024-07-24T16:24:43.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.294+0000 7fcaf37fe640 1 -- 172.21.15.159:0/2846934214 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fcae40615b0 con 0x7fcafc0b4e70 2024-07-24T16:24:43.297 INFO:teuthology.orchestra.run.smithi159.stderr:listed 0 entries 2024-07-24T16:24:43.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.296+0000 7fcb011cb640 1 -- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcadc077010 msgr2=0x7fcadc0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:43.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.297+0000 7fcb011cb640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcadc077010 0x7fcadc0794d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcaec005fd0 tx=0x7fcaec0093f0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.299 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.297+0000 7fcb011cb640 1 -- 172.21.15.159:0/2846934214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcafc0b4e70 msgr2=0x7fcafc14e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:43.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.297+0000 7fcb011cb640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcafc0b4e70 0x7fcafc14e150 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcae400d750 tx=0x7fcae400dc10 comp rx=0 tx=0).stop 2024-07-24T16:24:43.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.297+0000 7fcb011cb640 1 -- 172.21.15.159:0/2846934214 shutdown_connections 2024-07-24T16:24:43.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.297+0000 7fcb011cb640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fcadc077010 0x7fcadc0794d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.297+0000 7fcb011cb640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcafc15a330 0x7fcafc1591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.297+0000 7fcb011cb640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcafc0b4e70 0x7fcafc14e150 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.297+0000 7fcb011cb640 1 --2- 172.21.15.159:0/2846934214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcafc072b50 0x7fcafc154570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.297+0000 7fcb011cb640 1 -- 172.21.15.159:0/2846934214 >> 172.21.15.159:0/2846934214 conn(0x7fcafc0b2230 msgr2=0x7fcafc0b09c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:43.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.297+0000 7fcb011cb640 1 -- 172.21.15.159:0/2846934214 shutdown_connections 2024-07-24T16:24:43.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.297+0000 7fcb011cb640 1 -- 172.21.15.159:0/2846934214 wait complete. 2024-07-24T16:24:43.310 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-07-24T16:24:43.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:43.310 DEBUG:teuthology.orchestra.run.smithi193:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-07-24T16:24:43.341 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi193.front.sepia.ceph.com 2024-07-24T16:24:43.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:43.342 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-07-24T16:24:43.421 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:24:43.421 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:43.437 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:24:43.437 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:43.493 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:24:43.493 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:43.549 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-24T16:24:43.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.690+0000 7fea488d3640 1 -- 172.21.15.159:0/3779587114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea4406d670 msgr2=0x7fea4406db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:43.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.690+0000 7fea488d3640 1 --2- 172.21.15.159:0/3779587114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea4406d670 0x7fea4406db00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fea440d0430 tx=0x7fea3c02b760 comp rx=0 tx=0).stop 2024-07-24T16:24:43.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.690+0000 7fea488d3640 1 -- 172.21.15.159:0/3779587114 shutdown_connections 2024-07-24T16:24:43.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.690+0000 7fea488d3640 1 --2- 172.21.15.159:0/3779587114 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea4406d670 0x7fea4406db00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.690+0000 7fea488d3640 1 --2- 172.21.15.159:0/3779587114 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fea440b41d0 0x7fea440b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.690+0000 7fea488d3640 1 --2- 172.21.15.159:0/3779587114 >> v2:172.21.15.193:3300/0 conn(0x7fea44150cc0 0x7fea4415ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.690+0000 7fea488d3640 1 -- 172.21.15.159:0/3779587114 >> 172.21.15.159:0/3779587114 conn(0x7fea4406c560 msgr2=0x7fea4406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:43.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.690+0000 7fea488d3640 1 -- 172.21.15.159:0/3779587114 shutdown_connections 2024-07-24T16:24:43.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.690+0000 7fea488d3640 1 -- 172.21.15.159:0/3779587114 wait complete. 2024-07-24T16:24:43.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.691+0000 7fea488d3640 1 Processor -- start 2024-07-24T16:24:43.694 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.691+0000 7fea488d3640 1 -- start start 2024-07-24T16:24:43.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea488d3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea4406d670 0x7fea440ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:43.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea488d3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fea440b41d0 0x7fea441f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:43.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea488d3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea44150cc0 0x7fea44072a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:43.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea488d3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fea440cf630 con 0x7fea44150cc0 2024-07-24T16:24:43.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea488d3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fea440cf4b0 con 0x7fea4406d670 2024-07-24T16:24:43.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea488d3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fea440cf7b0 con 0x7fea440b41d0 2024-07-24T16:24:43.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea42d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea44150cc0 0x7fea44072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:43.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea42d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea44150cc0 0x7fea44072a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55148/0 (socket says 172.21.15.159:55148) 2024-07-24T16:24:43.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea42d9d640 1 -- 172.21.15.159:0/1560162420 learned_addr learned my addr 172.21.15.159:0/1560162420 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:43.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea42d9d640 1 -- 172.21.15.159:0/1560162420 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fea440b41d0 msgr2=0x7fea441f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:43.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea42d9d640 1 --2- 172.21.15.159:0/1560162420 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fea440b41d0 0x7fea441f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea42d9d640 1 -- 172.21.15.159:0/1560162420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea4406d670 msgr2=0x7fea440ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:43.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea42d9d640 1 --2- 172.21.15.159:0/1560162420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea4406d670 0x7fea440ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea42d9d640 1 -- 172.21.15.159:0/1560162420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea440ac5e0 con 0x7fea44150cc0 2024-07-24T16:24:43.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.692+0000 7fea42d9d640 1 --2- 172.21.15.159:0/1560162420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea44150cc0 0x7fea44072a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00aad0 tx=0x7fea3c0038f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:43.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.693+0000 7fea32ffd640 1 -- 172.21.15.159:0/1560162420 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c03f070 con 0x7fea44150cc0 2024-07-24T16:24:43.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.693+0000 7fea32ffd640 1 -- 172.21.15.159:0/1560162420 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea3c0047a0 con 0x7fea44150cc0 2024-07-24T16:24:43.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.693+0000 7fea32ffd640 1 -- 172.21.15.159:0/1560162420 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea3c036040 con 0x7fea44150cc0 2024-07-24T16:24:43.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.693+0000 7fea488d3640 1 -- 172.21.15.159:0/1560162420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea440ad570 con 0x7fea44150cc0 2024-07-24T16:24:43.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.693+0000 7fea488d3640 1 -- 172.21.15.159:0/1560162420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea440adb30 con 0x7fea44150cc0 2024-07-24T16:24:43.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.694+0000 7fea488d3640 1 -- 172.21.15.159:0/1560162420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea440b3850 con 0x7fea44150cc0 2024-07-24T16:24:43.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.694+0000 7fea32ffd640 1 -- 172.21.15.159:0/1560162420 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fea3c042070 con 0x7fea44150cc0 2024-07-24T16:24:43.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.695+0000 7fea32ffd640 1 --2- 172.21.15.159:0/1560162420 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fea24077010 0x7fea240794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:43.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.695+0000 7fea32ffd640 1 -- 172.21.15.159:0/1560162420 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fea3c0b9a10 con 0x7fea44150cc0 2024-07-24T16:24:43.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.695+0000 7fea4259c640 1 --2- 172.21.15.159:0/1560162420 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fea24077010 0x7fea240794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:43.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.695+0000 7fea4259c640 1 --2- 172.21.15.159:0/1560162420 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fea24077010 0x7fea240794d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea3400a860 tx=0x7fea34005b50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:43.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.699+0000 7fea32ffd640 1 -- 172.21.15.159:0/1560162420 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fea3c082960 con 0x7fea44150cc0 2024-07-24T16:24:43.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.891+0000 7fea488d3640 1 -- 172.21.15.159:0/1560162420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fea440b1750 con 0x7fea44150cc0 2024-07-24T16:24:43.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.892+0000 7fea32ffd640 1 -- 172.21.15.159:0/1560162420 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fea3c082260 con 0x7fea44150cc0 2024-07-24T16:24:43.895 INFO:teuthology.orchestra.run.smithi159.stderr:listed 0 entries 2024-07-24T16:24:43.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.894+0000 7fea488d3640 1 -- 172.21.15.159:0/1560162420 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fea24077010 msgr2=0x7fea240794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:43.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.894+0000 7fea488d3640 1 --2- 172.21.15.159:0/1560162420 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fea24077010 0x7fea240794d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fea3400a860 tx=0x7fea34005b50 comp rx=0 tx=0).stop 2024-07-24T16:24:43.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.894+0000 7fea488d3640 1 -- 172.21.15.159:0/1560162420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea44150cc0 msgr2=0x7fea44072a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:43.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.894+0000 7fea488d3640 1 --2- 172.21.15.159:0/1560162420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea44150cc0 0x7fea44072a50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fea3c00aad0 tx=0x7fea3c0038f0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.894+0000 7fea488d3640 1 -- 172.21.15.159:0/1560162420 shutdown_connections 2024-07-24T16:24:43.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.894+0000 7fea488d3640 1 --2- 172.21.15.159:0/1560162420 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fea24077010 0x7fea240794d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.894+0000 7fea488d3640 1 --2- 172.21.15.159:0/1560162420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fea44150cc0 0x7fea44072a50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.894+0000 7fea488d3640 1 --2- 172.21.15.159:0/1560162420 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fea440b41d0 0x7fea441f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.894+0000 7fea488d3640 1 --2- 172.21.15.159:0/1560162420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fea4406d670 0x7fea440ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:43.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.894+0000 7fea488d3640 1 -- 172.21.15.159:0/1560162420 >> 172.21.15.159:0/1560162420 conn(0x7fea4406c560 msgr2=0x7fea4414fef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:43.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.894+0000 7fea488d3640 1 -- 172.21.15.159:0/1560162420 shutdown_connections 2024-07-24T16:24:43.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:43.894+0000 7fea488d3640 1 -- 172.21.15.159:0/1560162420 wait complete. 2024-07-24T16:24:43.907 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-07-24T16:24:43.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:43.908 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-07-24T16:24:43.934 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:24:43.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:43.934 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-07-24T16:24:43.990 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:24:43.990 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:44.009 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:24:44.009 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:44.067 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:24:44.067 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:24:44.124 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-24T16:24:44.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.226+0000 7f8c6c039640 1 -- 172.21.15.159:0/492214250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c6406d670 msgr2=0x7f8c640cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:44.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.226+0000 7f8c6c039640 1 --2- 172.21.15.159:0/492214250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c6406d670 0x7f8c640cf320 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8c640730a0 tx=0x7f8c5802a560 comp rx=0 tx=0).stop 2024-07-24T16:24:44.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.226+0000 7f8c6c039640 1 -- 172.21.15.159:0/492214250 shutdown_connections 2024-07-24T16:24:44.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.226+0000 7f8c6c039640 1 --2- 172.21.15.159:0/492214250 >> v2:172.21.15.193:3300/0 conn(0x7f8c640cf860 0x7f8c6415bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.226+0000 7f8c6c039640 1 --2- 172.21.15.159:0/492214250 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c6406d670 0x7f8c640cf320 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.226+0000 7f8c6c039640 1 --2- 172.21.15.159:0/492214250 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c64158fe0 0x7f8c6406f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.226+0000 7f8c6c039640 1 -- 172.21.15.159:0/492214250 >> 172.21.15.159:0/492214250 conn(0x7f8c6406c560 msgr2=0x7f8c6406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:44.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.226+0000 7f8c6c039640 1 -- 172.21.15.159:0/492214250 shutdown_connections 2024-07-24T16:24:44.230 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.226+0000 7f8c6c039640 1 -- 172.21.15.159:0/492214250 wait complete. 2024-07-24T16:24:44.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.227+0000 7f8c6c039640 1 Processor -- start 2024-07-24T16:24:44.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.227+0000 7f8c6c039640 1 -- start start 2024-07-24T16:24:44.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c6c039640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c6406d670 0x7f8c640af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:44.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c6c039640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c640cf860 0x7f8c640adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:44.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c6c039640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c64158fe0 0x7f8c640b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:44.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c6c039640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8c641593c0 con 0x7f8c640cf860 2024-07-24T16:24:44.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c6c039640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6406dc20 con 0x7f8c6406d670 2024-07-24T16:24:44.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c6c039640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8c64159540 con 0x7f8c64158fe0 2024-07-24T16:24:44.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c695d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c640cf860 0x7f8c640adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:44.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c695d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c640cf860 0x7f8c640adb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55166/0 (socket says 172.21.15.159:55166) 2024-07-24T16:24:44.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c695d4640 1 -- 172.21.15.159:0/391293050 learned_addr learned my addr 172.21.15.159:0/391293050 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:44.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c69dd5640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c6406d670 0x7f8c640af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:44.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c6a5d6640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c64158fe0 0x7f8c640b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:44.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c695d4640 1 -- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c64158fe0 msgr2=0x7f8c640b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:44.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c695d4640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c64158fe0 0x7f8c640b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c695d4640 1 -- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c6406d670 msgr2=0x7f8c640af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:44.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.228+0000 7f8c695d4640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c6406d670 0x7f8c640af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.229+0000 7f8c695d4640 1 -- 172.21.15.159:0/391293050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c641f7940 con 0x7f8c640cf860 2024-07-24T16:24:44.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.229+0000 7f8c6a5d6640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c64158fe0 0x7f8c640b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:44.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.229+0000 7f8c695d4640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c640cf860 0x7f8c640adb00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009850 tx=0x7f8c580039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:44.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.229+0000 7f8c627fc640 1 -- 172.21.15.159:0/391293050 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5803f070 con 0x7f8c640cf860 2024-07-24T16:24:44.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.229+0000 7f8c627fc640 1 -- 172.21.15.159:0/391293050 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c58004890 con 0x7f8c640cf860 2024-07-24T16:24:44.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.229+0000 7f8c627fc640 1 -- 172.21.15.159:0/391293050 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c58035030 con 0x7f8c640cf860 2024-07-24T16:24:44.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.229+0000 7f8c6c039640 1 -- 172.21.15.159:0/391293050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c641f7c20 con 0x7f8c640cf860 2024-07-24T16:24:44.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.229+0000 7f8c6c039640 1 -- 172.21.15.159:0/391293050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c641f81e0 con 0x7f8c640cf860 2024-07-24T16:24:44.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.230+0000 7f8c6c039640 1 -- 172.21.15.159:0/391293050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c6415bf90 con 0x7f8c640cf860 2024-07-24T16:24:44.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.231+0000 7f8c627fc640 1 -- 172.21.15.159:0/391293050 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f8c58042070 con 0x7f8c640cf860 2024-07-24T16:24:44.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.231+0000 7f8c627fc640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c50077010 0x7f8c500794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:44.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.231+0000 7f8c627fc640 1 -- 172.21.15.159:0/391293050 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8c580b99c0 con 0x7f8c640cf860 2024-07-24T16:24:44.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.232+0000 7f8c69dd5640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c50077010 0x7f8c500794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:44.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.232+0000 7f8c69dd5640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c50077010 0x7f8c500794d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8c54005c40 tx=0x7f8c5400a530 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:44.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.236+0000 7f8c627fc640 1 -- 172.21.15.159:0/391293050 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f8c580bbe20 con 0x7f8c640cf860 2024-07-24T16:24:44.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.434+0000 7f8c6c039640 1 -- 172.21.15.159:0/391293050 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8c64073b60 con 0x7f8c640cf860 2024-07-24T16:24:44.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.434+0000 7f8c627fc640 1 -- 172.21.15.159:0/391293050 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f8c580822d0 con 0x7f8c640cf860 2024-07-24T16:24:44.437 INFO:teuthology.orchestra.run.smithi159.stderr:listed 0 entries 2024-07-24T16:24:44.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.436+0000 7f8c6c039640 1 -- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c50077010 msgr2=0x7f8c500794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:44.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.436+0000 7f8c6c039640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c50077010 0x7f8c500794d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8c54005c40 tx=0x7f8c5400a530 comp rx=0 tx=0).stop 2024-07-24T16:24:44.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.436+0000 7f8c6c039640 1 -- 172.21.15.159:0/391293050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c640cf860 msgr2=0x7f8c640adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:44.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.436+0000 7f8c6c039640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c640cf860 0x7f8c640adb00 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f8c58009850 tx=0x7f8c580039e0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.436+0000 7f8c6c039640 1 -- 172.21.15.159:0/391293050 shutdown_connections 2024-07-24T16:24:44.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.436+0000 7f8c6c039640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c50077010 0x7f8c500794d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.436+0000 7f8c6c039640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c64158fe0 0x7f8c640b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.436+0000 7f8c6c039640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c640cf860 0x7f8c640adb00 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.436+0000 7f8c6c039640 1 --2- 172.21.15.159:0/391293050 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c6406d670 0x7f8c640af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.436+0000 7f8c6c039640 1 -- 172.21.15.159:0/391293050 >> 172.21.15.159:0/391293050 conn(0x7f8c6406c560 msgr2=0x7f8c6406f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:44.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.437+0000 7f8c6c039640 1 -- 172.21.15.159:0/391293050 shutdown_connections 2024-07-24T16:24:44.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.437+0000 7f8c6c039640 1 -- 172.21.15.159:0/391293050 wait complete. 2024-07-24T16:24:44.450 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-07-24T16:24:44.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:44.450 DEBUG:teuthology.orchestra.run.smithi193:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-07-24T16:24:44.482 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi193.front.sepia.ceph.com 2024-07-24T16:24:44.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:24:44.482 DEBUG:teuthology.orchestra.run.smithi193:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-07-24T16:24:44.541 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-07-24T16:24:44.541 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:24:44.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.641+0000 7f8c8c039640 1 -- 172.21.15.159:0/55781880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c840cf860 msgr2=0x7f8c8415bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:44.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.641+0000 7f8c8c039640 1 --2- 172.21.15.159:0/55781880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c840cf860 0x7f8c8415bf90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009830 tx=0x7f8c7c02a510 comp rx=0 tx=0).stop 2024-07-24T16:24:44.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.641+0000 7f8c8c039640 1 -- 172.21.15.159:0/55781880 shutdown_connections 2024-07-24T16:24:44.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.641+0000 7f8c8c039640 1 --2- 172.21.15.159:0/55781880 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c8406f890 0x7f8c840cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.641+0000 7f8c8c039640 1 --2- 172.21.15.159:0/55781880 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c840cf860 0x7f8c8415bf90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.641+0000 7f8c8c039640 1 -- 172.21.15.159:0/55781880 >> 172.21.15.159:0/55781880 conn(0x7f8c8406c560 msgr2=0x7f8c8406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:44.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.641+0000 7f8c8c039640 1 -- 172.21.15.159:0/55781880 shutdown_connections 2024-07-24T16:24:44.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.641+0000 7f8c8c039640 1 -- 172.21.15.159:0/55781880 wait complete. 2024-07-24T16:24:44.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.642+0000 7f8c8c039640 1 Processor -- start 2024-07-24T16:24:44.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.642+0000 7f8c8c039640 1 -- start start 2024-07-24T16:24:44.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c8c039640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c8406f890 0x7f8c840b2c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:44.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c8c039640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c840cf860 0x7f8c84145eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:44.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c8c039640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c84158fe0 0x7f8c840af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:44.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c8c039640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8c84159540 con 0x7f8c8406f890 2024-07-24T16:24:44.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c8c039640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c841593c0 con 0x7f8c840cf860 2024-07-24T16:24:44.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c8c039640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8c8415c4d0 con 0x7f8c84158fe0 2024-07-24T16:24:44.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c89dd5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c8406f890 0x7f8c840b2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:44.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c89dd5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c8406f890 0x7f8c840b2c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55174/0 (socket says 172.21.15.159:55174) 2024-07-24T16:24:44.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c89dd5640 1 -- 172.21.15.159:0/3456582771 learned_addr learned my addr 172.21.15.159:0/3456582771 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:44.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c8a5d6640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c84158fe0 0x7f8c840af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:44.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c895d4640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c840cf860 0x7f8c84145eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:44.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c89dd5640 1 -- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c84158fe0 msgr2=0x7f8c840af2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:44.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c89dd5640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c84158fe0 0x7f8c840af2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c89dd5640 1 -- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c840cf860 msgr2=0x7f8c84145eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:44.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c89dd5640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c840cf860 0x7f8c84145eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c89dd5640 1 -- 172.21.15.159:0/3456582771 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c841f8230 con 0x7f8c8406f890 2024-07-24T16:24:44.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c895d4640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c840cf860 0x7f8c84145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:44.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.643+0000 7f8c89dd5640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c8406f890 0x7f8c840b2c60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400cbc0 tx=0x7f8c7400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:44.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.644+0000 7f8c827fc640 1 -- 172.21.15.159:0/3456582771 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74016020 con 0x7f8c8406f890 2024-07-24T16:24:44.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.644+0000 7f8c827fc640 1 -- 172.21.15.159:0/3456582771 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c7400ad90 con 0x7f8c8406f890 2024-07-24T16:24:44.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.644+0000 7f8c827fc640 1 -- 172.21.15.159:0/3456582771 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74012680 con 0x7f8c8406f890 2024-07-24T16:24:44.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.644+0000 7f8c8c039640 1 -- 172.21.15.159:0/3456582771 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c841f8510 con 0x7f8c8406f890 2024-07-24T16:24:44.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.644+0000 7f8c8c039640 1 -- 172.21.15.159:0/3456582771 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c841f8ad0 con 0x7f8c8406f890 2024-07-24T16:24:44.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.645+0000 7f8c8c039640 1 -- 172.21.15.159:0/3456582771 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c840cb690 con 0x7f8c8406f890 2024-07-24T16:24:44.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.645+0000 7f8c827fc640 1 -- 172.21.15.159:0/3456582771 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f8c74019020 con 0x7f8c8406f890 2024-07-24T16:24:44.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.646+0000 7f8c827fc640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c70077010 0x7f8c700794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:44.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.646+0000 7f8c827fc640 1 -- 172.21.15.159:0/3456582771 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8c74099270 con 0x7f8c8406f890 2024-07-24T16:24:44.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.646+0000 7f8c895d4640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c70077010 0x7f8c700794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:44.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.646+0000 7f8c895d4640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c70077010 0x7f8c700794d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8c84158220 tx=0x7f8c78005d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:44.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.650+0000 7f8c827fc640 1 -- 172.21.15.159:0/3456582771 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f8c840cb690 con 0x7f8c8406f890 2024-07-24T16:24:44.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.871+0000 7f8c8c039640 1 -- 172.21.15.159:0/3456582771 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8c8415c9b0 con 0x7f8c8406f890 2024-07-24T16:24:44.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.871+0000 7f8c827fc640 1 -- 172.21.15.159:0/3456582771 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f8c74020020 con 0x7f8c8406f890 2024-07-24T16:24:44.874 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:44.874 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":9,"btime":"2024-07-24T16:24:22:479106+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1307622320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1307622320},{"type":"v1","addr":"172.21.15.193:6837","nonce":1307622320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3191234203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3191234203},{"type":"v1","addr":"172.21.15.159:6833","nonce":3191234203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4336,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4102467909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":4102467909},{"type":"v1","addr":"172.21.15.159:6835","nonce":4102467909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:02.762268+0000","modified":"2024-07-24T16:24:21.842971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4348":{"gid":4348,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1274628948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1274628948},{"type":"v1","addr":"172.21.15.193:6836","nonce":1274628948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4348,"qdb_cluster":[4348]},"id":1}]} 2024-07-24T16:24:44.874 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 9 2024-07-24T16:24:44.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.873+0000 7f8c8c039640 1 -- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c70077010 msgr2=0x7f8c700794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:44.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.873+0000 7f8c8c039640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c70077010 0x7f8c700794d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8c84158220 tx=0x7f8c78005d30 comp rx=0 tx=0).stop 2024-07-24T16:24:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.873+0000 7f8c8c039640 1 -- 172.21.15.159:0/3456582771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c8406f890 msgr2=0x7f8c840b2c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.873+0000 7f8c8c039640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c8406f890 0x7f8c840b2c60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400cbc0 tx=0x7f8c7400a060 comp rx=0 tx=0).stop 2024-07-24T16:24:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.874+0000 7f8c8c039640 1 -- 172.21.15.159:0/3456582771 shutdown_connections 2024-07-24T16:24:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.874+0000 7f8c8c039640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8c70077010 0x7f8c700794d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.874+0000 7f8c8c039640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c84158fe0 0x7f8c840af2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.874+0000 7f8c8c039640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c840cf860 0x7f8c84145eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.874+0000 7f8c8c039640 1 --2- 172.21.15.159:0/3456582771 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c8406f890 0x7f8c840b2c60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.874+0000 7f8c8c039640 1 -- 172.21.15.159:0/3456582771 >> 172.21.15.159:0/3456582771 conn(0x7f8c8406c560 msgr2=0x7f8c841596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.874+0000 7f8c8c039640 1 -- 172.21.15.159:0/3456582771 shutdown_connections 2024-07-24T16:24:44.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.874+0000 7f8c8c039640 1 -- 172.21.15.159:0/3456582771 wait complete. 2024-07-24T16:24:44.887 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:24:44.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.988+0000 7fdd08f4b640 1 -- 172.21.15.159:0/3170123036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcf0004800 msgr2=0x7fdcf0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:44.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.988+0000 7fdd08f4b640 1 --2- 172.21.15.159:0/3170123036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdcf0004800 0x7fdcf0004c80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fdd0415e510 tx=0x7fdcf0005830 comp rx=0 tx=0).stop 2024-07-24T16:24:44.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.988+0000 7fdd02d9d640 1 -- 172.21.15.159:0/3170123036 reap_dead start 2024-07-24T16:24:44.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.988+0000 7fdd08f4b640 1 -- 172.21.15.159:0/3170123036 shutdown_connections 2024-07-24T16:24:44.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.988+0000 7fdd08f4b640 1 -- 172.21.15.159:0/3170123036 >> 172.21.15.159:0/3170123036 conn(0x7fdd0406c560 msgr2=0x7fdd0406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:44.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.988+0000 7fdd08f4b640 1 -- 172.21.15.159:0/3170123036 shutdown_connections 2024-07-24T16:24:44.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.988+0000 7fdd08f4b640 1 -- 172.21.15.159:0/3170123036 wait complete. 2024-07-24T16:24:44.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.989+0000 7fdd08f4b640 1 Processor -- start 2024-07-24T16:24:44.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.989+0000 7fdd08f4b640 1 -- start start 2024-07-24T16:24:44.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd08f4b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcf0004800 0x7fdd041550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:44.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd08f4b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd0414ed80 0x7fdd040af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:44.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd08f4b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd0414f290 0x7fdd04072a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:44.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd08f4b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdd040cbfa0 con 0x7fdd0414f290 2024-07-24T16:24:44.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd08f4b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdd040cbe20 con 0x7fdcf0004800 2024-07-24T16:24:44.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd08f4b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdd040aebe0 con 0x7fdd0414ed80 2024-07-24T16:24:44.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd02d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd0414f290 0x7fdd04072a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:44.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd02d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd0414f290 0x7fdd04072a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55198/0 (socket says 172.21.15.159:55198) 2024-07-24T16:24:44.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd02d9d640 1 -- 172.21.15.159:0/1606019178 learned_addr learned my addr 172.21.15.159:0/1606019178 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:44.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdcfbfff640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd0414ed80 0x7fdd040af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:44.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd0259c640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcf0004800 0x7fdd041550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:44.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd02d9d640 1 -- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd0414ed80 msgr2=0x7fdd040af0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:44.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd02d9d640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd0414ed80 0x7fdd040af0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd02d9d640 1 -- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcf0004800 msgr2=0x7fdd041550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:44.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd02d9d640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcf0004800 0x7fdd041550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:44.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd02d9d640 1 -- 172.21.15.159:0/1606019178 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd040b1ae0 con 0x7fdd0414f290 2024-07-24T16:24:44.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.990+0000 7fdd0259c640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcf0004800 0x7fdd041550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:44.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.991+0000 7fdd02d9d640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd0414f290 0x7fdd04072a50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdd040b42d0 tx=0x7fdcfc010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:44.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.991+0000 7fdcfaffd640 1 -- 172.21.15.159:0/1606019178 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00ee50 con 0x7fdd0414f290 2024-07-24T16:24:44.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.991+0000 7fdcfaffd640 1 -- 172.21.15.159:0/1606019178 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdcfc015070 con 0x7fdd0414f290 2024-07-24T16:24:44.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.991+0000 7fdcfaffd640 1 -- 172.21.15.159:0/1606019178 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc003ce0 con 0x7fdd0414f290 2024-07-24T16:24:44.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.991+0000 7fdd08f4b640 1 -- 172.21.15.159:0/1606019178 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd040b1dc0 con 0x7fdd0414f290 2024-07-24T16:24:44.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.991+0000 7fdd08f4b640 1 -- 172.21.15.159:0/1606019178 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd041f63c0 con 0x7fdd0414f290 2024-07-24T16:24:44.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.992+0000 7fdd08f4b640 1 -- 172.21.15.159:0/1606019178 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd040b4570 con 0x7fdd0414f290 2024-07-24T16:24:44.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.992+0000 7fdcfaffd640 1 -- 172.21.15.159:0/1606019178 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fdcfc004030 con 0x7fdd0414f290 2024-07-24T16:24:44.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.993+0000 7fdcfaffd640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fdce4077040 0x7fdce4079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:44.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.993+0000 7fdcfaffd640 1 -- 172.21.15.159:0/1606019178 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdcfc099930 con 0x7fdd0414f290 2024-07-24T16:24:44.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.993+0000 7fdd0259c640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fdce4077040 0x7fdce4079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:44.997 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.993+0000 7fdd0259c640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fdce4077040 0x7fdce4079500 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4000c00 tx=0x7fdcf4006c00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:44.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:44.997+0000 7fdcfaffd640 1 -- 172.21.15.159:0/1606019178 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fdd040b4570 con 0x7fdd0414f290 2024-07-24T16:24:45.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.219+0000 7fdd08f4b640 1 -- 172.21.15.159:0/1606019178 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdd0415b4b0 con 0x7fdd0414f290 2024-07-24T16:24:45.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.220+0000 7fdcfaffd640 1 -- 172.21.15.159:0/1606019178 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7fdcfc0622c0 con 0x7fdd0414f290 2024-07-24T16:24:45.222 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:45.223 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":9,"btime":"2024-07-24T16:24:22:479106+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1307622320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1307622320},{"type":"v1","addr":"172.21.15.193:6837","nonce":1307622320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3191234203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3191234203},{"type":"v1","addr":"172.21.15.159:6833","nonce":3191234203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4336,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4102467909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":4102467909},{"type":"v1","addr":"172.21.15.159:6835","nonce":4102467909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:02.762268+0000","modified":"2024-07-24T16:24:21.842971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4348":{"gid":4348,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1274628948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1274628948},{"type":"v1","addr":"172.21.15.193:6836","nonce":1274628948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4348,"qdb_cluster":[4348]},"id":1}]} 2024-07-24T16:24:45.223 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 9 2024-07-24T16:24:45.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.222+0000 7fdd08f4b640 1 -- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fdce4077040 msgr2=0x7fdce4079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:45.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.222+0000 7fdd08f4b640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fdce4077040 0x7fdce4079500 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fdcf4000c00 tx=0x7fdcf4006c00 comp rx=0 tx=0).stop 2024-07-24T16:24:45.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.222+0000 7fdd08f4b640 1 -- 172.21.15.159:0/1606019178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd0414f290 msgr2=0x7fdd04072a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:45.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.222+0000 7fdd08f4b640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd0414f290 0x7fdd04072a50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdd040b42d0 tx=0x7fdcfc010f40 comp rx=0 tx=0).stop 2024-07-24T16:24:45.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.222+0000 7fdd08f4b640 1 -- 172.21.15.159:0/1606019178 shutdown_connections 2024-07-24T16:24:45.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.222+0000 7fdd08f4b640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fdce4077040 0x7fdce4079500 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.222+0000 7fdd08f4b640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdd0414f290 0x7fdd04072a50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.222+0000 7fdd08f4b640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdd0414ed80 0x7fdd040af0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.222+0000 7fdd08f4b640 1 --2- 172.21.15.159:0/1606019178 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdcf0004800 0x7fdd041550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.222+0000 7fdd08f4b640 1 -- 172.21.15.159:0/1606019178 >> 172.21.15.159:0/1606019178 conn(0x7fdd0406c560 msgr2=0x7fdd0415c7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:45.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.222+0000 7fdd08f4b640 1 -- 172.21.15.159:0/1606019178 shutdown_connections 2024-07-24T16:24:45.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.222+0000 7fdd08f4b640 1 -- 172.21.15.159:0/1606019178 wait complete. 2024-07-24T16:24:45.236 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:45.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.334+0000 7fedab6fd640 1 -- 172.21.15.159:0/1656911253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda40cf770 msgr2=0x7feda415b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:45.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.334+0000 7fedab6fd640 1 --2- 172.21.15.159:0/1656911253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda40cf770 0x7feda415b4b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7feda0005fd0 tx=0x7feda002a620 comp rx=0 tx=0).stop 2024-07-24T16:24:45.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.334+0000 7fedab6fd640 1 -- 172.21.15.159:0/1656911253 shutdown_connections 2024-07-24T16:24:45.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.334+0000 7fedab6fd640 1 --2- 172.21.15.159:0/1656911253 >> v2:172.21.15.193:3300/0 conn(0x7feda406dba0 0x7feda40cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.334+0000 7fedab6fd640 1 --2- 172.21.15.159:0/1656911253 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda40cf770 0x7feda415b4b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.334+0000 7fedab6fd640 1 -- 172.21.15.159:0/1656911253 >> 172.21.15.159:0/1656911253 conn(0x7feda406c560 msgr2=0x7feda406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:45.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.334+0000 7fedab6fd640 1 -- 172.21.15.159:0/1656911253 shutdown_connections 2024-07-24T16:24:45.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.334+0000 7fedab6fd640 1 -- 172.21.15.159:0/1656911253 wait complete. 2024-07-24T16:24:45.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.335+0000 7fedab6fd640 1 Processor -- start 2024-07-24T16:24:45.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.336+0000 7fedab6fd640 1 -- start start 2024-07-24T16:24:45.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.336+0000 7fedab6fd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda406dba0 0x7feda414add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:45.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.336+0000 7fedab6fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feda40cf770 0x7feda40ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:45.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.336+0000 7fedab6fd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feda40cfb50 0x7feda40addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:45.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.336+0000 7fedab6fd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7feda40aea00 con 0x7feda406dba0 2024-07-24T16:24:45.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.336+0000 7fedab6fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feda40ae880 con 0x7feda40cf770 2024-07-24T16:24:45.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.336+0000 7fedab6fd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7feda40aeb80 con 0x7feda40cfb50 2024-07-24T16:24:45.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.336+0000 7feda9499640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda406dba0 0x7feda414add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:45.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.336+0000 7feda9499640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda406dba0 0x7feda414add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55216/0 (socket says 172.21.15.159:55216) 2024-07-24T16:24:45.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.336+0000 7feda9499640 1 -- 172.21.15.159:0/1321965155 learned_addr learned my addr 172.21.15.159:0/1321965155 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:45.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.337+0000 7feda8c98640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feda40cf770 0x7feda40ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:45.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.337+0000 7feda9c9a640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feda40cfb50 0x7feda40addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:45.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.337+0000 7feda9499640 1 -- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feda40cfb50 msgr2=0x7feda40addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:45.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.337+0000 7feda9499640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feda40cfb50 0x7feda40addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.337+0000 7feda9499640 1 -- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feda40cf770 msgr2=0x7feda40ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:45.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.337+0000 7feda9499640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feda40cf770 0x7feda40ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.337+0000 7feda9499640 1 -- 172.21.15.159:0/1321965155 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda41f7c00 con 0x7feda406dba0 2024-07-24T16:24:45.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.337+0000 7feda9499640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda406dba0 0x7feda414add0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feda0009850 tx=0x7feda0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:45.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.337+0000 7fed95ffb640 1 -- 172.21.15.159:0/1321965155 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda003f070 con 0x7feda406dba0 2024-07-24T16:24:45.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.337+0000 7fed95ffb640 1 -- 172.21.15.159:0/1321965155 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feda0004ca0 con 0x7feda406dba0 2024-07-24T16:24:45.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.337+0000 7fedab6fd640 1 -- 172.21.15.159:0/1321965155 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda41f7ee0 con 0x7feda406dba0 2024-07-24T16:24:45.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.337+0000 7fed95ffb640 1 -- 172.21.15.159:0/1321965155 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda0035030 con 0x7feda406dba0 2024-07-24T16:24:45.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.337+0000 7fedab6fd640 1 -- 172.21.15.159:0/1321965155 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda41f84a0 con 0x7feda406dba0 2024-07-24T16:24:45.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.338+0000 7fedab6fd640 1 -- 172.21.15.159:0/1321965155 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda415a6e0 con 0x7feda406dba0 2024-07-24T16:24:45.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.339+0000 7fed95ffb640 1 -- 172.21.15.159:0/1321965155 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7feda0042070 con 0x7feda406dba0 2024-07-24T16:24:45.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.339+0000 7fed95ffb640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fed88077010 0x7fed880794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:45.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.339+0000 7fed95ffb640 1 -- 172.21.15.159:0/1321965155 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feda00b9740 con 0x7feda406dba0 2024-07-24T16:24:45.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.339+0000 7feda8c98640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fed88077010 0x7fed880794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:45.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.340+0000 7feda8c98640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fed88077010 0x7fed880794d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feda40cc9d0 tx=0x7fed98005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:45.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.343+0000 7fed95ffb640 1 -- 172.21.15.159:0/1321965155 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7feda415a6e0 con 0x7feda406dba0 2024-07-24T16:24:45.529 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.527+0000 7fedab6fd640 1 -- 172.21.15.159:0/1321965155 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feda415b4b0 con 0x7feda406dba0 2024-07-24T16:24:45.530 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.528+0000 7fed95ffb640 1 -- 172.21.15.159:0/1321965155 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7feda0082720 con 0x7feda406dba0 2024-07-24T16:24:45.531 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:45.531 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:07.801757+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:00.757174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:01.708421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-24T16:24:05.423097+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:45.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.530+0000 7fedab6fd640 1 -- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fed88077010 msgr2=0x7fed880794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:45.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.530+0000 7fedab6fd640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fed88077010 0x7fed880794d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feda40cc9d0 tx=0x7fed98005f90 comp rx=0 tx=0).stop 2024-07-24T16:24:45.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.530+0000 7fedab6fd640 1 -- 172.21.15.159:0/1321965155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda406dba0 msgr2=0x7feda414add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:45.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.530+0000 7fedab6fd640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda406dba0 0x7feda414add0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7feda0009850 tx=0x7feda0004430 comp rx=0 tx=0).stop 2024-07-24T16:24:45.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.530+0000 7fedab6fd640 1 -- 172.21.15.159:0/1321965155 shutdown_connections 2024-07-24T16:24:45.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.530+0000 7fedab6fd640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fed88077010 0x7fed880794d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.530+0000 7fedab6fd640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feda40cfb50 0x7feda40addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.530+0000 7fedab6fd640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feda40cf770 0x7feda40ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.530+0000 7fedab6fd640 1 --2- 172.21.15.159:0/1321965155 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feda406dba0 0x7feda414add0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.530+0000 7fedab6fd640 1 -- 172.21.15.159:0/1321965155 >> 172.21.15.159:0/1321965155 conn(0x7feda406c560 msgr2=0x7feda40ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:45.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.530+0000 7fedab6fd640 1 -- 172.21.15.159:0/1321965155 shutdown_connections 2024-07-24T16:24:45.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.530+0000 7fedab6fd640 1 -- 172.21.15.159:0/1321965155 wait complete. 2024-07-24T16:24:45.543 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-07-24T16:24:45.544 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:24:45.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.645+0000 7f7709ecb640 1 -- 172.21.15.159:0/4285043422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77040cf770 msgr2=0x7f770415b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:45.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.645+0000 7f7709ecb640 1 --2- 172.21.15.159:0/4285043422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77040cf770 0x7f770415b4b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f770406fb90 tx=0x7f76f402a580 comp rx=0 tx=0).stop 2024-07-24T16:24:45.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.645+0000 7f7709ecb640 1 -- 172.21.15.159:0/4285043422 shutdown_connections 2024-07-24T16:24:45.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.645+0000 7f7709ecb640 1 --2- 172.21.15.159:0/4285043422 >> v2:172.21.15.193:3300/0 conn(0x7f77040cfb50 0x7f77040cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.645+0000 7f7709ecb640 1 --2- 172.21.15.159:0/4285043422 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77040cf770 0x7f770415b4b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.645+0000 7f7709ecb640 1 -- 172.21.15.159:0/4285043422 >> 172.21.15.159:0/4285043422 conn(0x7f770406c560 msgr2=0x7f770406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:45.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.645+0000 7f7709ecb640 1 -- 172.21.15.159:0/4285043422 shutdown_connections 2024-07-24T16:24:45.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.645+0000 7f7709ecb640 1 -- 172.21.15.159:0/4285043422 wait complete. 2024-07-24T16:24:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.646+0000 7f7709ecb640 1 Processor -- start 2024-07-24T16:24:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.646+0000 7f7709ecb640 1 -- start start 2024-07-24T16:24:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7709ecb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f770406dba0 0x7f7704143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7709ecb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77040cf770 0x7f7704149e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:45.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7709ecb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77040cfb50 0x7f770414a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7709ecb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f77040aea50 con 0x7f77040cfb50 2024-07-24T16:24:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7709ecb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f77040ae8d0 con 0x7f77040cf770 2024-07-24T16:24:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7709ecb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f77040aebd0 con 0x7f770406dba0 2024-07-24T16:24:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7703fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77040cfb50 0x7f770414a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7703fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77040cfb50 0x7f770414a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55234/0 (socket says 172.21.15.159:55234) 2024-07-24T16:24:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7703fff640 1 -- 172.21.15.159:0/860619889 learned_addr learned my addr 172.21.15.159:0/860619889 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f77037fe640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f770406dba0 0x7f7704143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7702ffd640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77040cf770 0x7f7704149e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7703fff640 1 -- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f770406dba0 msgr2=0x7f7704143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7703fff640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f770406dba0 0x7f7704143880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.652 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7703fff640 1 -- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77040cf770 msgr2=0x7f7704149e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7703fff640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77040cf770 0x7f7704149e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7703fff640 1 -- 172.21.15.159:0/860619889 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77041f5d80 con 0x7f77040cfb50 2024-07-24T16:24:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7702ffd640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77040cf770 0x7f7704149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.647+0000 7f7703fff640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77040cfb50 0x7f770414a380 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00b9e0 tx=0x7f76fc00bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.648+0000 7f76ebfff640 1 -- 172.21.15.159:0/860619889 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc019070 con 0x7f77040cfb50 2024-07-24T16:24:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.648+0000 7f76ebfff640 1 -- 172.21.15.159:0/860619889 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76fc00cc10 con 0x7f77040cfb50 2024-07-24T16:24:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.648+0000 7f7709ecb640 1 -- 172.21.15.159:0/860619889 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77041f6060 con 0x7f77040cfb50 2024-07-24T16:24:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.648+0000 7f76ebfff640 1 -- 172.21.15.159:0/860619889 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76fc0146a0 con 0x7f77040cfb50 2024-07-24T16:24:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.648+0000 7f7709ecb640 1 -- 172.21.15.159:0/860619889 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7704148360 con 0x7f77040cfb50 2024-07-24T16:24:45.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.649+0000 7f7709ecb640 1 -- 172.21.15.159:0/860619889 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7704147e70 con 0x7f77040cfb50 2024-07-24T16:24:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.649+0000 7f76ebfff640 1 -- 172.21.15.159:0/860619889 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f76fc01c070 con 0x7f77040cfb50 2024-07-24T16:24:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.650+0000 7f76ebfff640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f76f0077010 0x7f76f00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:45.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.650+0000 7f76ebfff640 1 -- 172.21.15.159:0/860619889 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f76fc0988a0 con 0x7f77040cfb50 2024-07-24T16:24:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.650+0000 7f77037fe640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f76f0077010 0x7f76f00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:45.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.650+0000 7f77037fe640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f76f0077010 0x7f76f00794d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f76f4033000 tx=0x7f76f4004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:45.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.654+0000 7f76ebfff640 1 -- 172.21.15.159:0/860619889 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f76fc0611a0 con 0x7f77040cfb50 2024-07-24T16:24:45.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.877+0000 7f7709ecb640 1 -- 172.21.15.159:0/860619889 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f770415b4b0 con 0x7f77040cfb50 2024-07-24T16:24:45.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.877+0000 7f76ebfff640 1 -- 172.21.15.159:0/860619889 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f76fc0656f0 con 0x7f77040cfb50 2024-07-24T16:24:45.880 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:45.880 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":9,"btime":"2024-07-24T16:24:22:479106+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1307622320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1307622320},{"type":"v1","addr":"172.21.15.193:6837","nonce":1307622320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3191234203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3191234203},{"type":"v1","addr":"172.21.15.159:6833","nonce":3191234203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4336,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4102467909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":4102467909},{"type":"v1","addr":"172.21.15.159:6835","nonce":4102467909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:02.762268+0000","modified":"2024-07-24T16:24:21.842971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4348":{"gid":4348,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1274628948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1274628948},{"type":"v1","addr":"172.21.15.193:6836","nonce":1274628948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4348,"qdb_cluster":[4348]},"id":1}]} 2024-07-24T16:24:45.880 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 9 2024-07-24T16:24:45.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.879+0000 7f7709ecb640 1 -- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f76f0077010 msgr2=0x7f76f00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:45.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.879+0000 7f7709ecb640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f76f0077010 0x7f76f00794d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f76f4033000 tx=0x7f76f4004730 comp rx=0 tx=0).stop 2024-07-24T16:24:45.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.879+0000 7f7709ecb640 1 -- 172.21.15.159:0/860619889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77040cfb50 msgr2=0x7f770414a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:45.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.879+0000 7f7709ecb640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77040cfb50 0x7f770414a380 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f76fc00b9e0 tx=0x7f76fc00bea0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.880+0000 7f7709ecb640 1 -- 172.21.15.159:0/860619889 shutdown_connections 2024-07-24T16:24:45.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.880+0000 7f7709ecb640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f76f0077010 0x7f76f00794d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.880+0000 7f7709ecb640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77040cfb50 0x7f770414a380 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.880+0000 7f7709ecb640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77040cf770 0x7f7704149e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.880+0000 7f7709ecb640 1 --2- 172.21.15.159:0/860619889 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f770406dba0 0x7f7704143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:45.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.880+0000 7f7709ecb640 1 -- 172.21.15.159:0/860619889 >> 172.21.15.159:0/860619889 conn(0x7f770406c560 msgr2=0x7f770415bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:45.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.880+0000 7f7709ecb640 1 -- 172.21.15.159:0/860619889 shutdown_connections 2024-07-24T16:24:45.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.880+0000 7f7709ecb640 1 -- 172.21.15.159:0/860619889 wait complete. 2024-07-24T16:24:45.893 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:24:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.995+0000 7f06fd2fd640 1 -- 172.21.15.159:0/1015439916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06e4004d40 msgr2=0x7f06e40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.995+0000 7f06fd2fd640 1 --2- 172.21.15.159:0/1015439916 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06e4004d40 0x7f06e40051c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009ed0 tx=0x7f06e4005830 comp rx=0 tx=0).stop 2024-07-24T16:24:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.995+0000 7f06f77fe640 1 -- 172.21.15.159:0/1015439916 reap_dead start 2024-07-24T16:24:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.995+0000 7f06fd2fd640 1 -- 172.21.15.159:0/1015439916 shutdown_connections 2024-07-24T16:24:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.995+0000 7f06fd2fd640 1 -- 172.21.15.159:0/1015439916 >> 172.21.15.159:0/1015439916 conn(0x7f06f809cd30 msgr2=0x7f06f80d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.995+0000 7f06fd2fd640 1 -- 172.21.15.159:0/1015439916 shutdown_connections 2024-07-24T16:24:45.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.995+0000 7f06fd2fd640 1 -- 172.21.15.159:0/1015439916 wait complete. 2024-07-24T16:24:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.996+0000 7f06fd2fd640 1 Processor -- start 2024-07-24T16:24:45.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.996+0000 7f06fd2fd640 1 -- start start 2024-07-24T16:24:46.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06fd2fd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06e4004d40 0x7f06f815f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:46.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06fd2fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f815e010 0x7f06f81e9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:46.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06fd2fd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06f815bc80 0x7f06f81604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:46.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06fd2fd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f06f80cfc00 con 0x7f06f815bc80 2024-07-24T16:24:46.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06fd2fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f06f815de90 con 0x7f06f815e010 2024-07-24T16:24:46.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06fd2fd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f06f80cfd80 con 0x7f06e4004d40 2024-07-24T16:24:46.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06f77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06f815bc80 0x7f06f81604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:46.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06f77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06f815bc80 0x7f06f81604d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55250/0 (socket says 172.21.15.159:55250) 2024-07-24T16:24:46.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06f77fe640 1 -- 172.21.15.159:0/2239827162 learned_addr learned my addr 172.21.15.159:0/2239827162 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:46.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06f77fe640 1 -- 172.21.15.159:0/2239827162 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06e4004d40 msgr2=0x7f06f815f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06f77fe640 1 --2- 172.21.15.159:0/2239827162 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06e4004d40 0x7f06f815f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06f77fe640 1 -- 172.21.15.159:0/2239827162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f815e010 msgr2=0x7f06f81e9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06f77fe640 1 --2- 172.21.15.159:0/2239827162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f815e010 0x7f06f81e9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.997+0000 7f06f77fe640 1 -- 172.21.15.159:0/2239827162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06f81e89e0 con 0x7f06f815bc80 2024-07-24T16:24:46.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.998+0000 7f06f77fe640 1 --2- 172.21.15.159:0/2239827162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06f815bc80 0x7f06f81604d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009ed0 tx=0x7f06f0033c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:46.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.998+0000 7f06effff640 1 -- 172.21.15.159:0/2239827162 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0042070 con 0x7f06f815bc80 2024-07-24T16:24:46.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.998+0000 7f06effff640 1 -- 172.21.15.159:0/2239827162 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06f0003970 con 0x7f06f815bc80 2024-07-24T16:24:46.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.998+0000 7f06fd2fd640 1 -- 172.21.15.159:0/2239827162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06f815e4f0 con 0x7f06f815bc80 2024-07-24T16:24:46.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.998+0000 7f06effff640 1 -- 172.21.15.159:0/2239827162 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0038040 con 0x7f06f815bc80 2024-07-24T16:24:46.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.998+0000 7f06fd2fd640 1 -- 172.21.15.159:0/2239827162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06f815eab0 con 0x7f06f815bc80 2024-07-24T16:24:46.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.999+0000 7f06fd2fd640 1 -- 172.21.15.159:0/2239827162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06f8161f20 con 0x7f06f815bc80 2024-07-24T16:24:46.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:45.999+0000 7f06effff640 1 -- 172.21.15.159:0/2239827162 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f06f0004030 con 0x7f06f815bc80 2024-07-24T16:24:46.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.000+0000 7f06effff640 1 --2- 172.21.15.159:0/2239827162 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f06d8077040 0x7f06d8079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:46.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.000+0000 7f06effff640 1 -- 172.21.15.159:0/2239827162 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f06f00b8ed0 con 0x7f06f815bc80 2024-07-24T16:24:46.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.000+0000 7f06f6ffd640 1 --2- 172.21.15.159:0/2239827162 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f06d8077040 0x7f06d8079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:46.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.001+0000 7f06f6ffd640 1 --2- 172.21.15.159:0/2239827162 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f06d8077040 0x7f06d8079500 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f06e80058c0 tx=0x7f06e8005850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:46.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.004+0000 7f06effff640 1 -- 172.21.15.159:0/2239827162 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f06f0081740 con 0x7f06f815bc80 2024-07-24T16:24:46.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.225+0000 7f06fd2fd640 1 -- 172.21.15.159:0/2239827162 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06f806e750 con 0x7f06f815bc80 2024-07-24T16:24:46.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.226+0000 7f06effff640 1 -- 172.21.15.159:0/2239827162 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+5231 (secure 0 0 0) 0x7f06f008a060 con 0x7f06f815bc80 2024-07-24T16:24:46.228 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:46.229 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":9,"btime":"2024-07-24T16:24:22:479106+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4280,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/1307622320","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":1307622320},{"type":"v1","addr":"172.21.15.193:6837","nonce":1307622320}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4326,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6833/3191234203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":3191234203},{"type":"v1","addr":"172.21.15.159:6833","nonce":3191234203}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4336,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/4102467909","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6834","nonce":4102467909},{"type":"v1","addr":"172.21.15.159:6835","nonce":4102467909}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:02.762268+0000","modified":"2024-07-24T16:24:21.842971+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4348},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4348":{"gid":4348,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.193:6836/1274628948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1274628948},{"type":"v1","addr":"172.21.15.193:6836","nonce":1274628948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4348,"qdb_cluster":[4348]},"id":1}]} 2024-07-24T16:24:46.229 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 9 2024-07-24T16:24:46.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.228+0000 7f06fd2fd640 1 -- 172.21.15.159:0/2239827162 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f06d8077040 msgr2=0x7f06d8079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.228+0000 7f06fd2fd640 1 --2- 172.21.15.159:0/2239827162 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f06d8077040 0x7f06d8079500 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f06e80058c0 tx=0x7f06e8005850 comp rx=0 tx=0).stop 2024-07-24T16:24:46.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.228+0000 7f06fd2fd640 1 -- 172.21.15.159:0/2239827162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06f815bc80 msgr2=0x7f06f81604d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.228+0000 7f06fd2fd640 1 --2- 172.21.15.159:0/2239827162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06f815bc80 0x7f06f81604d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009ed0 tx=0x7f06f0033c30 comp rx=0 tx=0).stop 2024-07-24T16:24:46.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.228+0000 7f06fd2fd640 1 -- 172.21.15.159:0/2239827162 shutdown_connections 2024-07-24T16:24:46.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.228+0000 7f06fd2fd640 1 --2- 172.21.15.159:0/2239827162 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f06d8077040 0x7f06d8079500 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.228+0000 7f06fd2fd640 1 --2- 172.21.15.159:0/2239827162 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f06f815bc80 0x7f06f81604d0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.228+0000 7f06fd2fd640 1 --2- 172.21.15.159:0/2239827162 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f06f815e010 0x7f06f81e9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.228+0000 7f06fd2fd640 1 --2- 172.21.15.159:0/2239827162 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f06e4004d40 0x7f06f815f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.228+0000 7f06fd2fd640 1 -- 172.21.15.159:0/2239827162 >> 172.21.15.159:0/2239827162 conn(0x7f06f809cd30 msgr2=0x7f06f80b8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:46.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.228+0000 7f06fd2fd640 1 -- 172.21.15.159:0/2239827162 shutdown_connections 2024-07-24T16:24:46.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.228+0000 7f06fd2fd640 1 -- 172.21.15.159:0/2239827162 wait complete. 2024-07-24T16:24:46.242 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:46.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.342+0000 7f2fc734b640 1 -- 172.21.15.159:0/3792093139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fc00cf770 msgr2=0x7f2fc015b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.342+0000 7f2fc734b640 1 --2- 172.21.15.159:0/3792093139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fc00cf770 0x7f2fc015b4b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc009830 tx=0x7f2fbc02a530 comp rx=0 tx=0).stop 2024-07-24T16:24:46.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.342+0000 7f2fc734b640 1 -- 172.21.15.159:0/3792093139 shutdown_connections 2024-07-24T16:24:46.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.342+0000 7f2fc734b640 1 --2- 172.21.15.159:0/3792093139 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fc006dba0 0x7f2fc00cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.342+0000 7f2fc734b640 1 --2- 172.21.15.159:0/3792093139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fc00cf770 0x7f2fc015b4b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.342+0000 7f2fc734b640 1 -- 172.21.15.159:0/3792093139 >> 172.21.15.159:0/3792093139 conn(0x7f2fc006c560 msgr2=0x7f2fc006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:46.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.342+0000 7f2fc734b640 1 -- 172.21.15.159:0/3792093139 shutdown_connections 2024-07-24T16:24:46.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.342+0000 7f2fc734b640 1 -- 172.21.15.159:0/3792093139 wait complete. 2024-07-24T16:24:46.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.343+0000 7f2fc734b640 1 Processor -- start 2024-07-24T16:24:46.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.343+0000 7f2fc734b640 1 -- start start 2024-07-24T16:24:46.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc734b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fc006dba0 0x7f2fc014d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:46.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc734b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fc00cf770 0x7f2fc00b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:46.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc734b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fc00cfb50 0x7f2fc00b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:46.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc734b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc00aeab0 con 0x7f2fc00cfb50 2024-07-24T16:24:46.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc734b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc00ae930 con 0x7f2fc00cf770 2024-07-24T16:24:46.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc734b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc00aec30 con 0x7f2fc006dba0 2024-07-24T16:24:46.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc58e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fc00cfb50 0x7f2fc00b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:46.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc58e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fc00cfb50 0x7f2fc00b09f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55262/0 (socket says 172.21.15.159:55262) 2024-07-24T16:24:46.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc58e8640 1 -- 172.21.15.159:0/91971025 learned_addr learned my addr 172.21.15.159:0/91971025 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:46.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc50e7640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fc006dba0 0x7f2fc014d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:46.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc48e6640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fc00cf770 0x7f2fc00b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:46.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc58e8640 1 -- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fc006dba0 msgr2=0x7f2fc014d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc58e8640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fc006dba0 0x7f2fc014d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc58e8640 1 -- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fc00cf770 msgr2=0x7f2fc00b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc58e8640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fc00cf770 0x7f2fc00b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc58e8640 1 -- 172.21.15.159:0/91971025 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc00ae2a0 con 0x7f2fc00cfb50 2024-07-24T16:24:46.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.344+0000 7f2fc48e6640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fc00cf770 0x7f2fc00b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:46.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.345+0000 7f2fc58e8640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fc00cfb50 0x7f2fc00b09f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800ca20 tx=0x7f2fb800cee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:46.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.345+0000 7f2fb5ffb640 1 -- 172.21.15.159:0/91971025 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8016020 con 0x7f2fc00cfb50 2024-07-24T16:24:46.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.345+0000 7f2fb5ffb640 1 -- 172.21.15.159:0/91971025 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2fb800ace0 con 0x7f2fc00cfb50 2024-07-24T16:24:46.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.345+0000 7f2fc734b640 1 -- 172.21.15.159:0/91971025 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fc01f4d70 con 0x7f2fc00cfb50 2024-07-24T16:24:46.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.345+0000 7f2fb5ffb640 1 -- 172.21.15.159:0/91971025 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fb8012680 con 0x7f2fc00cfb50 2024-07-24T16:24:46.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.345+0000 7f2fc734b640 1 -- 172.21.15.159:0/91971025 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fc01f5330 con 0x7f2fc00cfb50 2024-07-24T16:24:46.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.346+0000 7f2fc734b640 1 -- 172.21.15.159:0/91971025 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fc015b4b0 con 0x7f2fc00cfb50 2024-07-24T16:24:46.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.346+0000 7f2fb5ffb640 1 -- 172.21.15.159:0/91971025 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f2fb8019020 con 0x7f2fc00cfb50 2024-07-24T16:24:46.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.347+0000 7f2fb5ffb640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2fa4077010 0x7f2fa40794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:46.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.347+0000 7f2fb5ffb640 1 -- 172.21.15.159:0/91971025 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2fb8099060 con 0x7f2fc00cfb50 2024-07-24T16:24:46.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.347+0000 7f2fc50e7640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2fa4077010 0x7f2fa40794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:46.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.348+0000 7f2fc50e7640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2fa4077010 0x7f2fa40794d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc034000 tx=0x7f2fbc004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:46.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.351+0000 7f2fb5ffb640 1 -- 172.21.15.159:0/91971025 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f2fb8020020 con 0x7f2fc00cfb50 2024-07-24T16:24:46.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.534+0000 7f2fc734b640 1 -- 172.21.15.159:0/91971025 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2fc01f56d0 con 0x7f2fc00cfb50 2024-07-24T16:24:46.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.535+0000 7f2fb5ffb640 1 -- 172.21.15.159:0/91971025 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18550 (secure 0 0 0) 0x7f2fb8062040 con 0x7f2fc00cfb50 2024-07-24T16:24:46.538 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:46.538 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:07.801757+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:00.757174+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:01.708421+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-07-24T16:24:05.423097+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:46.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.537+0000 7f2fc734b640 1 -- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2fa4077010 msgr2=0x7f2fa40794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.537+0000 7f2fc734b640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2fa4077010 0x7f2fa40794d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc034000 tx=0x7f2fbc004730 comp rx=0 tx=0).stop 2024-07-24T16:24:46.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.537+0000 7f2fc734b640 1 -- 172.21.15.159:0/91971025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fc00cfb50 msgr2=0x7f2fc00b09f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.537+0000 7f2fc734b640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fc00cfb50 0x7f2fc00b09f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f2fb800ca20 tx=0x7f2fb800cee0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.537+0000 7f2fc734b640 1 -- 172.21.15.159:0/91971025 shutdown_connections 2024-07-24T16:24:46.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.537+0000 7f2fc734b640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2fa4077010 0x7f2fa40794d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.537+0000 7f2fc734b640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2fc00cfb50 0x7f2fc00b09f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.537+0000 7f2fc734b640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2fc00cf770 0x7f2fc00b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.537+0000 7f2fc734b640 1 --2- 172.21.15.159:0/91971025 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2fc006dba0 0x7f2fc014d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.537+0000 7f2fc734b640 1 -- 172.21.15.159:0/91971025 >> 172.21.15.159:0/91971025 conn(0x7f2fc006c560 msgr2=0x7f2fc00cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:46.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.538+0000 7f2fc734b640 1 -- 172.21.15.159:0/91971025 shutdown_connections 2024-07-24T16:24:46.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.538+0000 7f2fc734b640 1 -- 172.21.15.159:0/91971025 wait complete. 2024-07-24T16:24:46.552 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-07-24T16:24:46.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.653+0000 7f5026a8d640 1 -- 172.21.15.159:0/4220501199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5020070500 msgr2=0x7f502015b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.653+0000 7f5026a8d640 1 --2- 172.21.15.159:0/4220501199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5020070500 0x7f502015b3c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f5020069320 tx=0x7f501802a9e0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.653+0000 7f5026a8d640 1 -- 172.21.15.159:0/4220501199 shutdown_connections 2024-07-24T16:24:46.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.653+0000 7f5026a8d640 1 --2- 172.21.15.159:0/4220501199 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5020070500 0x7f502015b3c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.653+0000 7f5026a8d640 1 --2- 172.21.15.159:0/4220501199 >> v2:172.21.15.193:3300/0 conn(0x7f5020157d50 0x7f50200cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.653+0000 7f5026a8d640 1 -- 172.21.15.159:0/4220501199 >> 172.21.15.159:0/4220501199 conn(0x7f502006d450 msgr2=0x7f502006d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:46.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.653+0000 7f5026a8d640 1 -- 172.21.15.159:0/4220501199 shutdown_connections 2024-07-24T16:24:46.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.653+0000 7f5026a8d640 1 -- 172.21.15.159:0/4220501199 wait complete. 2024-07-24T16:24:46.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.654+0000 7f5026a8d640 1 Processor -- start 2024-07-24T16:24:46.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.654+0000 7f5026a8d640 1 -- start start 2024-07-24T16:24:46.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.655+0000 7f5026a8d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f502006f1c0 0x7f502014d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:46.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.655+0000 7f5026a8d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5020070500 0x7f50200c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:46.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.655+0000 7f5026a8d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5020157d50 0x7f50200731d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:46.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.655+0000 7f5026a8d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f50200cdea0 con 0x7f5020157d50 2024-07-24T16:24:46.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.655+0000 7f5026a8d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f50200cdd20 con 0x7f5020070500 2024-07-24T16:24:46.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.655+0000 7f5026a8d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f50200ce020 con 0x7f502006f1c0 2024-07-24T16:24:46.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.655+0000 7f502502a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5020157d50 0x7f50200731d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:46.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.655+0000 7f502502a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5020157d50 0x7f50200731d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55292/0 (socket says 172.21.15.159:55292) 2024-07-24T16:24:46.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.655+0000 7f502502a640 1 -- 172.21.15.159:0/4259019514 learned_addr learned my addr 172.21.15.159:0/4259019514 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:46.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f501ffff640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5020070500 0x7f50200c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:46.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f5024829640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f502006f1c0 0x7f502014d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:46.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f502502a640 1 -- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f502006f1c0 msgr2=0x7f502014d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f502502a640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f502006f1c0 0x7f502014d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f502502a640 1 -- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5020070500 msgr2=0x7f50200c9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f502502a640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5020070500 0x7f50200c9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f502502a640 1 -- 172.21.15.159:0/4259019514 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50200c9b90 con 0x7f5020157d50 2024-07-24T16:24:46.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f501ffff640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5020070500 0x7f50200c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:46.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f5024829640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f502006f1c0 0x7f502014d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:46.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f502502a640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5020157d50 0x7f50200731d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f501802afd0 tx=0x7f5018003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:46.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f501d7fa640 1 -- 172.21.15.159:0/4259019514 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5018046070 con 0x7f5020157d50 2024-07-24T16:24:46.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f501d7fa640 1 -- 172.21.15.159:0/4259019514 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5018004250 con 0x7f5020157d50 2024-07-24T16:24:46.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f5026a8d640 1 -- 172.21.15.159:0/4259019514 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50200c9e70 con 0x7f5020157d50 2024-07-24T16:24:46.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f501d7fa640 1 -- 172.21.15.159:0/4259019514 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5018033050 con 0x7f5020157d50 2024-07-24T16:24:46.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.656+0000 7f5026a8d640 1 -- 172.21.15.159:0/4259019514 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50200cabc0 con 0x7f5020157d50 2024-07-24T16:24:46.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.657+0000 7f5026a8d640 1 -- 172.21.15.159:0/4259019514 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5020069350 con 0x7f5020157d50 2024-07-24T16:24:46.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.658+0000 7f501d7fa640 1 -- 172.21.15.159:0/4259019514 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5018049070 con 0x7f5020157d50 2024-07-24T16:24:46.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.658+0000 7f501d7fa640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f500c077010 0x7f500c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:46.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.658+0000 7f501d7fa640 1 -- 172.21.15.159:0/4259019514 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f50180b9a30 con 0x7f5020157d50 2024-07-24T16:24:46.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.658+0000 7f5024829640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f500c077010 0x7f500c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:46.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.659+0000 7f5024829640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f500c077010 0x7f500c0794d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f501000ba60 tx=0x7f5010005cf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:46.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.662+0000 7f501d7fa640 1 -- 172.21.15.159:0/4259019514 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f5020069350 con 0x7f5020157d50 2024-07-24T16:24:46.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.880+0000 7f5026a8d640 1 -- 172.21.15.159:0/4259019514 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f502015b3c0 con 0x7f5020157d50 2024-07-24T16:24:46.883 INFO:tasks.ceph.mon.a.smithi159.stderr:2024-07-24T16:24:46.881+0000 7f7a58ad5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-24T16:24:46.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.882+0000 7f501d7fa640 1 -- 172.21.15.159:0/4259019514 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7f5018082980 con 0x7f5020157d50 2024-07-24T16:24:46.885 INFO:teuthology.orchestra.run.smithi159.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-07-24T16:24:46.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.885+0000 7f5026a8d640 1 -- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f500c077010 msgr2=0x7f500c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.885+0000 7f5026a8d640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f500c077010 0x7f500c0794d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f501000ba60 tx=0x7f5010005cf0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.885+0000 7f5026a8d640 1 -- 172.21.15.159:0/4259019514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5020157d50 msgr2=0x7f50200731d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:46.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.885+0000 7f5026a8d640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5020157d50 0x7f50200731d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f501802afd0 tx=0x7f5018003f10 comp rx=0 tx=0).stop 2024-07-24T16:24:46.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.885+0000 7f5026a8d640 1 -- 172.21.15.159:0/4259019514 shutdown_connections 2024-07-24T16:24:46.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.885+0000 7f5026a8d640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f500c077010 0x7f500c0794d0 secure :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f501000ba60 tx=0x7f5010005cf0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.885+0000 7f5026a8d640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5020157d50 0x7f50200731d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.885+0000 7f5026a8d640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5020070500 0x7f50200c9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.885+0000 7f5026a8d640 1 --2- 172.21.15.159:0/4259019514 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f502006f1c0 0x7f502014d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:46.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.885+0000 7f5026a8d640 1 -- 172.21.15.159:0/4259019514 >> 172.21.15.159:0/4259019514 conn(0x7f502006d450 msgr2=0x7f502015a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:46.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.885+0000 7f5026a8d640 1 -- 172.21.15.159:0/4259019514 shutdown_connections 2024-07-24T16:24:46.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:46.885+0000 7f5026a8d640 1 -- 172.21.15.159:0/4259019514 wait complete. 2024-07-24T16:24:46.894 INFO:tasks.ceph.mds.b.smithi193.stderr: -4193> 2024-07-24T16:24:08.511+0000 7f3e05a55640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-24T16:24:46.899 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-07-24T16:24:46.928 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-07-24T16:24:47.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.004+0000 7f358c876640 1 -- 172.21.15.159:0/2674264652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358815a330 msgr2=0x7f35880cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:47.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.004+0000 7f358c876640 1 --2- 172.21.15.159:0/2674264652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358815a330 0x7f35880cfed0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f35880cd170 tx=0x7f357802a8b0 comp rx=0 tx=0).stop 2024-07-24T16:24:47.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.004+0000 7f358c876640 1 -- 172.21.15.159:0/2674264652 shutdown_connections 2024-07-24T16:24:47.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.004+0000 7f358c876640 1 --2- 172.21.15.159:0/2674264652 >> v2:172.21.15.193:3300/0 conn(0x7f35880b4e70 0x7f3588070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:47.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.004+0000 7f358c876640 1 --2- 172.21.15.159:0/2674264652 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358815a330 0x7f35880cfed0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:47.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.004+0000 7f358c876640 1 -- 172.21.15.159:0/2674264652 >> 172.21.15.159:0/2674264652 conn(0x7f35880b2230 msgr2=0x7f35880b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:47.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.004+0000 7f358c876640 1 -- 172.21.15.159:0/2674264652 shutdown_connections 2024-07-24T16:24:47.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.004+0000 7f358c876640 1 -- 172.21.15.159:0/2674264652 wait complete. 2024-07-24T16:24:47.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.005+0000 7f358c876640 1 Processor -- start 2024-07-24T16:24:47.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.005+0000 7f358c876640 1 -- start start 2024-07-24T16:24:47.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f358c876640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3588072b50 0x7f35881534c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:47.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f358c876640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35880b4e70 0x7f35881f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:47.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f358c876640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358815a330 0x7f358806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:47.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f358c876640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3588073400 con 0x7f358815a330 2024-07-24T16:24:47.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f358c876640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3588073280 con 0x7f35880b4e70 2024-07-24T16:24:47.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f358c876640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f35880cd930 con 0x7f3588072b50 2024-07-24T16:24:47.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f3586d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358815a330 0x7f358806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f3586d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358815a330 0x7f358806ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55302/0 (socket says 172.21.15.159:55302) 2024-07-24T16:24:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f3586d9d640 1 -- 172.21.15.159:0/3741845192 learned_addr learned my addr 172.21.15.159:0/3741845192 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f3586d9d640 1 -- 172.21.15.159:0/3741845192 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3588072b50 msgr2=0x7f35881534c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f3586d9d640 1 --2- 172.21.15.159:0/3741845192 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3588072b50 0x7f35881534c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f3586d9d640 1 -- 172.21.15.159:0/3741845192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35880b4e70 msgr2=0x7f35881f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f3586d9d640 1 --2- 172.21.15.159:0/3741845192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35880b4e70 0x7f35881f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f3586d9d640 1 -- 172.21.15.159:0/3741845192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358806cf40 con 0x7f358815a330 2024-07-24T16:24:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.006+0000 7f3586d9d640 1 --2- 172.21.15.159:0/3741845192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358815a330 0x7f358806ca00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f358000c3a0 tx=0x7f358000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.007+0000 7f3576ffd640 1 -- 172.21.15.159:0/3741845192 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580017070 con 0x7f358815a330 2024-07-24T16:24:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.007+0000 7f3576ffd640 1 -- 172.21.15.159:0/3741845192 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35800035f0 con 0x7f358815a330 2024-07-24T16:24:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.007+0000 7f358c876640 1 -- 172.21.15.159:0/3741845192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f358815c5e0 con 0x7f358815a330 2024-07-24T16:24:47.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.007+0000 7f3576ffd640 1 -- 172.21.15.159:0/3741845192 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580003a40 con 0x7f358815a330 2024-07-24T16:24:47.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.007+0000 7f358c876640 1 -- 172.21.15.159:0/3741845192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3588153e60 con 0x7f358815a330 2024-07-24T16:24:47.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.008+0000 7f358c876640 1 -- 172.21.15.159:0/3741845192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3588154030 con 0x7f358815a330 2024-07-24T16:24:47.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.008+0000 7f3576ffd640 1 -- 172.21.15.159:0/3741845192 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f358001a070 con 0x7f358815a330 2024-07-24T16:24:47.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.009+0000 7f3576ffd640 1 --2- 172.21.15.159:0/3741845192 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3568077040 0x7f3568079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:47.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.009+0000 7f3576ffd640 1 -- 172.21.15.159:0/3741845192 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6618+0+0 (secure 0 0 0) 0x7f3580097ef0 con 0x7f358815a330 2024-07-24T16:24:47.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.009+0000 7f358659c640 1 --2- 172.21.15.159:0/3741845192 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3568077040 0x7f3568079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:47.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.009+0000 7f358659c640 1 --2- 172.21.15.159:0/3741845192 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3568077040 0x7f3568079500 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3578034000 tx=0x7f3578004a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:47.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.013+0000 7f3576ffd640 1 -- 172.21.15.159:0/3741845192 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f3580060e80 con 0x7f358815a330 2024-07-24T16:24:47.235 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.232+0000 7f358c876640 1 -- 172.21.15.159:0/3741845192 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f35880b2740 con 0x7f358815a330 2024-07-24T16:24:47.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.884+0000 7f3576ffd640 1 -- 172.21.15.159:0/3741845192 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f3580060780 con 0x7f358815a330 2024-07-24T16:24:47.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.887+0000 7f358c876640 1 -- 172.21.15.159:0/3741845192 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3568077040 msgr2=0x7f3568079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:47.889 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.887+0000 7f358c876640 1 --2- 172.21.15.159:0/3741845192 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3568077040 0x7f3568079500 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f3578034000 tx=0x7f3578004a40 comp rx=0 tx=0).stop 2024-07-24T16:24:47.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.887+0000 7f358c876640 1 -- 172.21.15.159:0/3741845192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358815a330 msgr2=0x7f358806ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:47.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.887+0000 7f358c876640 1 --2- 172.21.15.159:0/3741845192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358815a330 0x7f358806ca00 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f358000c3a0 tx=0x7f358000c860 comp rx=0 tx=0).stop 2024-07-24T16:24:47.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.887+0000 7f358c876640 1 -- 172.21.15.159:0/3741845192 shutdown_connections 2024-07-24T16:24:47.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.887+0000 7f358c876640 1 --2- 172.21.15.159:0/3741845192 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3568077040 0x7f3568079500 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:47.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.887+0000 7f358c876640 1 --2- 172.21.15.159:0/3741845192 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358815a330 0x7f358806ca00 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:47.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.887+0000 7f358c876640 1 --2- 172.21.15.159:0/3741845192 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f35880b4e70 0x7f35881f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:47.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.887+0000 7f358c876640 1 --2- 172.21.15.159:0/3741845192 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3588072b50 0x7f35881534c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:47.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.887+0000 7f358c876640 1 -- 172.21.15.159:0/3741845192 >> 172.21.15.159:0/3741845192 conn(0x7f35880b2230 msgr2=0x7f35880b01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:47.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.887+0000 7f358c876640 1 -- 172.21.15.159:0/3741845192 shutdown_connections 2024-07-24T16:24:47.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:47.887+0000 7f358c876640 1 -- 172.21.15.159:0/3741845192 wait complete. 2024-07-24T16:24:47.901 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-07-24T16:24:48.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.008+0000 7fa7859ae640 1 -- 172.21.15.159:0/2285841320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa768004d90 msgr2=0x7fa768005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:48.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.008+0000 7fa7859ae640 1 --2- 172.21.15.159:0/2285841320 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa768004d90 0x7fa768005210 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fa77800baf0 tx=0x7fa768005830 comp rx=0 tx=0).stop 2024-07-24T16:24:48.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.008+0000 7fa77f7fe640 1 -- 172.21.15.159:0/2285841320 reap_dead start 2024-07-24T16:24:48.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.008+0000 7fa7859ae640 1 -- 172.21.15.159:0/2285841320 shutdown_connections 2024-07-24T16:24:48.011 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.008+0000 7fa7859ae640 1 -- 172.21.15.159:0/2285841320 >> 172.21.15.159:0/2285841320 conn(0x7fa7800d3a90 msgr2=0x7fa7800d3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:48.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.008+0000 7fa7859ae640 1 -- 172.21.15.159:0/2285841320 shutdown_connections 2024-07-24T16:24:48.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.008+0000 7fa7859ae640 1 -- 172.21.15.159:0/2285841320 wait complete. 2024-07-24T16:24:48.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.009+0000 7fa7859ae640 1 Processor -- start 2024-07-24T16:24:48.012 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.010+0000 7fa7859ae640 1 -- start start 2024-07-24T16:24:48.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.010+0000 7fa7859ae640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa768004d90 0x7fa78014f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:48.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.010+0000 7fa7859ae640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa7800a0fa0 0x7fa78006dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:48.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.010+0000 7fa7859ae640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa78006e2a0 0x7fa7800ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:48.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.010+0000 7fa7859ae640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa7800b7190 con 0x7fa78006e2a0 2024-07-24T16:24:48.014 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.010+0000 7fa7859ae640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa7800b7010 con 0x7fa768004d90 2024-07-24T16:24:48.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.010+0000 7fa7859ae640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa7800d1990 con 0x7fa7800a0fa0 2024-07-24T16:24:48.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa77f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa78006e2a0 0x7fa7800ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:48.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa77f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa78006e2a0 0x7fa7800ccd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55330/0 (socket says 172.21.15.159:55330) 2024-07-24T16:24:48.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa77f7fe640 1 -- 172.21.15.159:0/3332224866 learned_addr learned my addr 172.21.15.159:0/3332224866 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:48.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa77effd640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa768004d90 0x7fa78014f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:48.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa77e7fc640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa7800a0fa0 0x7fa78006dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:48.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa77f7fe640 1 -- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa7800a0fa0 msgr2=0x7fa78006dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:48.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa77f7fe640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa7800a0fa0 0x7fa78006dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:48.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa77f7fe640 1 -- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa768004d90 msgr2=0x7fa78014f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:48.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa77f7fe640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa768004d90 0x7fa78014f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:48.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa77f7fe640 1 -- 172.21.15.159:0/3332224866 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7801f7bd0 con 0x7fa78006e2a0 2024-07-24T16:24:48.015 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa77effd640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa768004d90 0x7fa78014f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:48.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa77f7fe640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa78006e2a0 0x7fa7800ccd30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa77802afa0 tx=0x7fa778005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:48.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa767fff640 1 -- 172.21.15.159:0/3332224866 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778041070 con 0x7fa78006e2a0 2024-07-24T16:24:48.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa767fff640 1 -- 172.21.15.159:0/3332224866 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa778032bb0 con 0x7fa78006e2a0 2024-07-24T16:24:48.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa7859ae640 1 -- 172.21.15.159:0/3332224866 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7801f7eb0 con 0x7fa78006e2a0 2024-07-24T16:24:48.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa767fff640 1 -- 172.21.15.159:0/3332224866 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77800b6f0 con 0x7fa78006e2a0 2024-07-24T16:24:48.016 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.011+0000 7fa7859ae640 1 -- 172.21.15.159:0/3332224866 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7801f8470 con 0x7fa78006e2a0 2024-07-24T16:24:48.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.012+0000 7fa7859ae640 1 -- 172.21.15.159:0/3332224866 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa78006e720 con 0x7fa78006e2a0 2024-07-24T16:24:48.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.013+0000 7fa767fff640 1 -- 172.21.15.159:0/3332224866 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fa77804e430 con 0x7fa78006e2a0 2024-07-24T16:24:48.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.013+0000 7fa767fff640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa76c077010 0x7fa76c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:48.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.013+0000 7fa767fff640 1 -- 172.21.15.159:0/3332224866 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6618+0+0 (secure 0 0 0) 0x7fa7780b9440 con 0x7fa78006e2a0 2024-07-24T16:24:48.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.014+0000 7fa77effd640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa76c077010 0x7fa76c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:48.017 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.014+0000 7fa77effd640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa76c077010 0x7fa76c0794d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa770001330 tx=0x7fa7700021d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:48.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.017+0000 7fa767fff640 1 -- 172.21.15.159:0/3332224866 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa7780823d0 con 0x7fa78006e2a0 2024-07-24T16:24:48.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.199+0000 7fa7859ae640 1 -- 172.21.15.159:0/3332224866 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa7800b68c0 con 0x7fa78006e2a0 2024-07-24T16:24:48.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.889+0000 7fa767fff640 1 -- 172.21.15.159:0/3332224866 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) ==== 181+0+0 (secure 0 0 0) 0x7fa778081cd0 con 0x7fa78006e2a0 2024-07-24T16:24:48.891 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_metadata' removed 2024-07-24T16:24:48.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.892+0000 7fa7859ae640 1 -- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa76c077010 msgr2=0x7fa76c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:48.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.892+0000 7fa7859ae640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa76c077010 0x7fa76c0794d0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa770001330 tx=0x7fa7700021d0 comp rx=0 tx=0).stop 2024-07-24T16:24:48.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.892+0000 7fa7859ae640 1 -- 172.21.15.159:0/3332224866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa78006e2a0 msgr2=0x7fa7800ccd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:48.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.892+0000 7fa7859ae640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa78006e2a0 0x7fa7800ccd30 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fa77802afa0 tx=0x7fa778005900 comp rx=0 tx=0).stop 2024-07-24T16:24:48.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.893+0000 7fa7859ae640 1 -- 172.21.15.159:0/3332224866 shutdown_connections 2024-07-24T16:24:48.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.893+0000 7fa7859ae640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa76c077010 0x7fa76c0794d0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:48.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.893+0000 7fa7859ae640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa78006e2a0 0x7fa7800ccd30 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:48.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.893+0000 7fa7859ae640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa7800a0fa0 0x7fa78006dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:48.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.893+0000 7fa7859ae640 1 --2- 172.21.15.159:0/3332224866 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa768004d90 0x7fa78014f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:48.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.893+0000 7fa7859ae640 1 -- 172.21.15.159:0/3332224866 >> 172.21.15.159:0/3332224866 conn(0x7fa7800d3a90 msgr2=0x7fa78015b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:48.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.893+0000 7fa7859ae640 1 -- 172.21.15.159:0/3332224866 shutdown_connections 2024-07-24T16:24:48.896 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:48.893+0000 7fa7859ae640 1 -- 172.21.15.159:0/3332224866 wait complete. 2024-07-24T16:24:48.908 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-07-24T16:24:49.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.016+0000 7f8ea5611640 1 -- 172.21.15.159:0/692984546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ea015d910 msgr2=0x7f8ea00cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:49.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.016+0000 7f8ea5611640 1 --2- 172.21.15.159:0/692984546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ea015d910 0x7f8ea00cf4b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f8ea00cdf60 tx=0x7f8e9002a4d0 comp rx=0 tx=0).stop 2024-07-24T16:24:49.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.016+0000 7f8ea5611640 1 -- 172.21.15.159:0/692984546 shutdown_connections 2024-07-24T16:24:49.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.016+0000 7f8ea5611640 1 --2- 172.21.15.159:0/692984546 >> v2:172.21.15.193:3300/0 conn(0x7f8ea00cff70 0x7f8ea00d1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:49.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.016+0000 7f8ea5611640 1 --2- 172.21.15.159:0/692984546 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ea015d910 0x7f8ea00cf4b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:49.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.016+0000 7f8ea5611640 1 -- 172.21.15.159:0/692984546 >> 172.21.15.159:0/692984546 conn(0x7f8ea00d3a90 msgr2=0x7f8ea00d3ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:49.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.016+0000 7f8ea5611640 1 -- 172.21.15.159:0/692984546 shutdown_connections 2024-07-24T16:24:49.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.016+0000 7f8ea5611640 1 -- 172.21.15.159:0/692984546 wait complete. 2024-07-24T16:24:49.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.018+0000 7f8ea5611640 1 Processor -- start 2024-07-24T16:24:49.020 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.018+0000 7f8ea5611640 1 -- start start 2024-07-24T16:24:49.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.018+0000 7f8ea5611640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ea00cff70 0x7f8ea0153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:49.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.018+0000 7f8ea5611640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8ea015d910 0x7f8ea00c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:49.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.018+0000 7f8ea5611640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ea015dcf0 0x7f8ea00c9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:49.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.018+0000 7f8ea5611640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea00d1ed0 con 0x7f8ea00cff70 2024-07-24T16:24:49.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.018+0000 7f8ea5611640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8ea00cfc00 con 0x7f8ea015dcf0 2024-07-24T16:24:49.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.018+0000 7f8ea5611640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8ea00d2050 con 0x7f8ea015d910 2024-07-24T16:24:49.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e9effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ea00cff70 0x7f8ea0153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:49.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e9effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ea00cff70 0x7f8ea0153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55360/0 (socket says 172.21.15.159:55360) 2024-07-24T16:24:49.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e9effd640 1 -- 172.21.15.159:0/1748210459 learned_addr learned my addr 172.21.15.159:0/1748210459 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:49.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e9effd640 1 -- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8ea015d910 msgr2=0x7f8ea00c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:49.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e9f7fe640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ea015dcf0 0x7f8ea00c9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:49.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e9e7fc640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8ea015d910 0x7f8ea00c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:49.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e9effd640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8ea015d910 0x7f8ea00c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:49.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e9effd640 1 -- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ea015dcf0 msgr2=0x7f8ea00c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:49.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e9effd640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ea015dcf0 0x7f8ea00c9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:49.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e9effd640 1 -- 172.21.15.159:0/1748210459 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ea01f7cd0 con 0x7f8ea00cff70 2024-07-24T16:24:49.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e9effd640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ea00cff70 0x7f8ea0153640 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009850 tx=0x7f8e900039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:49.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e977fe640 1 -- 172.21.15.159:0/1748210459 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e9003f070 con 0x7f8ea00cff70 2024-07-24T16:24:49.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e977fe640 1 -- 172.21.15.159:0/1748210459 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e90004890 con 0x7f8ea00cff70 2024-07-24T16:24:49.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8e977fe640 1 -- 172.21.15.159:0/1748210459 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e90035030 con 0x7f8ea00cff70 2024-07-24T16:24:49.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8ea5611640 1 -- 172.21.15.159:0/1748210459 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ea01f7fb0 con 0x7f8ea00cff70 2024-07-24T16:24:49.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.019+0000 7f8ea5611640 1 -- 172.21.15.159:0/1748210459 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ea01f8570 con 0x7f8ea00cff70 2024-07-24T16:24:49.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.020+0000 7f8ea5611640 1 -- 172.21.15.159:0/1748210459 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea00d25f0 con 0x7f8ea00cff70 2024-07-24T16:24:49.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.021+0000 7f8e977fe640 1 -- 172.21.15.159:0/1748210459 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f8e90042070 con 0x7f8ea00cff70 2024-07-24T16:24:49.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.021+0000 7f8e977fe640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8e80077010 0x7f8e800794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:49.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.021+0000 7f8e977fe640 1 -- 172.21.15.159:0/1748210459 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6180+0+0 (secure 0 0 0) 0x7f8e900b98d0 con 0x7f8ea00cff70 2024-07-24T16:24:49.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.021+0000 7f8e9e7fc640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8e80077010 0x7f8e800794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:49.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.022+0000 7f8e9e7fc640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8e80077010 0x7f8e800794d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8ea006dfd0 tx=0x7f8e88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:49.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.025+0000 7f8e977fe640 1 -- 172.21.15.159:0/1748210459 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f8e90082a10 con 0x7f8ea00cff70 2024-07-24T16:24:49.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.210+0000 7f8ea5611640 1 -- 172.21.15.159:0/1748210459 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8ea00d3870 con 0x7f8ea00cff70 2024-07-24T16:24:49.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.890+0000 7f8e977fe640 1 -- 172.21.15.159:0/1748210459 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) ==== 169+0+0 (secure 0 0 0) 0x7f8e90082310 con 0x7f8ea00cff70 2024-07-24T16:24:49.893 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_data' removed 2024-07-24T16:24:49.897 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.895+0000 7f8ea5611640 1 -- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8e80077010 msgr2=0x7f8e800794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:49.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.895+0000 7f8ea5611640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8e80077010 0x7f8e800794d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8ea006dfd0 tx=0x7f8e88009040 comp rx=0 tx=0).stop 2024-07-24T16:24:49.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.895+0000 7f8ea5611640 1 -- 172.21.15.159:0/1748210459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ea00cff70 msgr2=0x7f8ea0153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:49.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.895+0000 7f8ea5611640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ea00cff70 0x7f8ea0153640 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009850 tx=0x7f8e900039e0 comp rx=0 tx=0).stop 2024-07-24T16:24:49.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.895+0000 7f8ea5611640 1 -- 172.21.15.159:0/1748210459 shutdown_connections 2024-07-24T16:24:49.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.895+0000 7f8ea5611640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8e80077010 0x7f8e800794d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:49.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.895+0000 7f8ea5611640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8ea015dcf0 0x7f8ea00c9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:49.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.895+0000 7f8ea5611640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8ea015d910 0x7f8ea00c9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:49.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.895+0000 7f8ea5611640 1 --2- 172.21.15.159:0/1748210459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8ea00cff70 0x7f8ea0153640 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:49.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.895+0000 7f8ea5611640 1 -- 172.21.15.159:0/1748210459 >> 172.21.15.159:0/1748210459 conn(0x7f8ea00d3a90 msgr2=0x7f8ea006cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:49.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.895+0000 7f8ea5611640 1 -- 172.21.15.159:0/1748210459 shutdown_connections 2024-07-24T16:24:49.898 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:49.895+0000 7f8ea5611640 1 -- 172.21.15.159:0/1748210459 wait complete. 2024-07-24T16:24:49.912 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-07-24T16:24:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.022+0000 7fee3121e640 1 -- 172.21.15.159:0/40639375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee2c0705b0 msgr2=0x7fee2c0741e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.022+0000 7fee3121e640 1 --2- 172.21.15.159:0/40639375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee2c0705b0 0x7fee2c0741e0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee14005fd0 tx=0x7fee1402a530 comp rx=0 tx=0).stop 2024-07-24T16:24:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.022+0000 7fee3121e640 1 -- 172.21.15.159:0/40639375 shutdown_connections 2024-07-24T16:24:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.022+0000 7fee3121e640 1 --2- 172.21.15.159:0/40639375 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee2c0721d0 0x7fee2c06ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.022+0000 7fee3121e640 1 --2- 172.21.15.159:0/40639375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee2c0705b0 0x7fee2c0741e0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.022+0000 7fee3121e640 1 -- 172.21.15.159:0/40639375 >> 172.21.15.159:0/40639375 conn(0x7fee2c06d4a0 msgr2=0x7fee2c06d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.022+0000 7fee3121e640 1 -- 172.21.15.159:0/40639375 shutdown_connections 2024-07-24T16:24:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.022+0000 7fee3121e640 1 -- 172.21.15.159:0/40639375 wait complete. 2024-07-24T16:24:50.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.024+0000 7fee3121e640 1 Processor -- start 2024-07-24T16:24:50.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.024+0000 7fee3121e640 1 -- start start 2024-07-24T16:24:50.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.024+0000 7fee3121e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee2c0705b0 0x7fee2c14d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:50.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.024+0000 7fee3121e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee2c0721d0 0x7fee2c143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:50.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.024+0000 7fee3121e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee2c15a330 0x7fee2c1543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:50.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.024+0000 7fee3121e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c06f3a0 con 0x7fee2c15a330 2024-07-24T16:24:50.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.024+0000 7fee3121e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fee2c06f220 con 0x7fee2c0705b0 2024-07-24T16:24:50.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.024+0000 7fee3121e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fee2c06f520 con 0x7fee2c0721d0 2024-07-24T16:24:50.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee2b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee2c15a330 0x7fee2c1543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:50.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee2b59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee2c15a330 0x7fee2c1543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:55378/0 (socket says 172.21.15.159:55378) 2024-07-24T16:24:50.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee2b59e640 1 -- 172.21.15.159:0/756566552 learned_addr learned my addr 172.21.15.159:0/756566552 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee2ad9d640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee2c0705b0 0x7fee2c14d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee2a59c640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee2c0721d0 0x7fee2c143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee2b59e640 1 -- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee2c0721d0 msgr2=0x7fee2c143610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee2b59e640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee2c0721d0 0x7fee2c143610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee2b59e640 1 -- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee2c0705b0 msgr2=0x7fee2c14d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee2b59e640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee2c0705b0 0x7fee2c14d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee2b59e640 1 -- 172.21.15.159:0/756566552 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee2c143b50 con 0x7fee2c15a330 2024-07-24T16:24:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee2b59e640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee2c15a330 0x7fee2c1543a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee2400d720 tx=0x7fee2400dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee237fe640 1 -- 172.21.15.159:0/756566552 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee24017070 con 0x7fee2c15a330 2024-07-24T16:24:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee237fe640 1 -- 172.21.15.159:0/756566552 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee24009ce0 con 0x7fee2c15a330 2024-07-24T16:24:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee237fe640 1 -- 172.21.15.159:0/756566552 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee24005280 con 0x7fee2c15a330 2024-07-24T16:24:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee3121e640 1 -- 172.21.15.159:0/756566552 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee2c1f4410 con 0x7fee2c15a330 2024-07-24T16:24:50.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.025+0000 7fee3121e640 1 -- 172.21.15.159:0/756566552 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee2c1f49d0 con 0x7fee2c15a330 2024-07-24T16:24:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.026+0000 7fee3121e640 1 -- 172.21.15.159:0/756566552 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee2c06fa40 con 0x7fee2c15a330 2024-07-24T16:24:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.027+0000 7fee237fe640 1 -- 172.21.15.159:0/756566552 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fee24005420 con 0x7fee2c15a330 2024-07-24T16:24:50.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.027+0000 7fee237fe640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fee0c077010 0x7fee0c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.027+0000 7fee237fe640 1 -- 172.21.15.159:0/756566552 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 5766+0+0 (secure 0 0 0) 0x7fee24098870 con 0x7fee2c15a330 2024-07-24T16:24:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.028+0000 7fee2ad9d640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fee0c077010 0x7fee0c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.028+0000 7fee2ad9d640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fee0c077010 0x7fee0c0794d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00b450 tx=0x7fee1c00d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:50.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.031+0000 7fee237fe640 1 -- 172.21.15.159:0/756566552 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fee24061470 con 0x7fee2c15a330 2024-07-24T16:24:50.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.217+0000 7fee3121e640 1 -- 172.21.15.159:0/756566552 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fee2c06d920 con 0x7fee2c15a330 2024-07-24T16:24:50.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.901+0000 7fee237fe640 1 -- 172.21.15.159:0/756566552 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v28) ==== 178+0+0 (secure 0 0 0) 0x7fee240659c0 con 0x7fee2c15a330 2024-07-24T16:24:50.904 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_data_ec' removed 2024-07-24T16:24:50.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.905+0000 7fee3121e640 1 -- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fee0c077010 msgr2=0x7fee0c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:50.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.905+0000 7fee3121e640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fee0c077010 0x7fee0c0794d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00b450 tx=0x7fee1c00d040 comp rx=0 tx=0).stop 2024-07-24T16:24:50.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.905+0000 7fee3121e640 1 -- 172.21.15.159:0/756566552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee2c15a330 msgr2=0x7fee2c1543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:50.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.905+0000 7fee3121e640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee2c15a330 0x7fee2c1543a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fee2400d720 tx=0x7fee2400dbe0 comp rx=0 tx=0).stop 2024-07-24T16:24:50.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.908+0000 7fee3121e640 1 -- 172.21.15.159:0/756566552 shutdown_connections 2024-07-24T16:24:50.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.908+0000 7fee3121e640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fee0c077010 0x7fee0c0794d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:50.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.908+0000 7fee3121e640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee2c15a330 0x7fee2c1543a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:50.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.908+0000 7fee3121e640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee2c0721d0 0x7fee2c143610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:50.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.908+0000 7fee3121e640 1 --2- 172.21.15.159:0/756566552 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee2c0705b0 0x7fee2c14d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:50.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.908+0000 7fee3121e640 1 -- 172.21.15.159:0/756566552 >> 172.21.15.159:0/756566552 conn(0x7fee2c06d4a0 msgr2=0x7fee2c0b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:50.911 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.908+0000 7fee3121e640 1 -- 172.21.15.159:0/756566552 shutdown_connections 2024-07-24T16:24:50.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:50.908+0000 7fee3121e640 1 -- 172.21.15.159:0/756566552 wait complete. 2024-07-24T16:24:50.925 INFO:tasks.ceph.mds.a:Restarting daemon 2024-07-24T16:24:50.925 INFO:tasks.ceph.mds.a:Stopping old one... 2024-07-24T16:24:50.925 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-07-24T16:24:50.925 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:24:50.926 INFO:tasks.ceph.mds.c:Restarting daemon 2024-07-24T16:24:50.926 INFO:tasks.ceph.mds.c:Stopping old one... 2024-07-24T16:24:50.926 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-07-24T16:24:50.926 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:24:50.926 INFO:tasks.ceph.mds.b:Restarting daemon 2024-07-24T16:24:50.926 INFO:tasks.ceph.mds.b:Stopping old one... 2024-07-24T16:24:50.927 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-07-24T16:24:50.927 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:24:50.927 INFO:tasks.ceph.mds.d:Restarting daemon 2024-07-24T16:24:50.927 INFO:tasks.ceph.mds.d:Stopping old one... 2024-07-24T16:24:50.927 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-07-24T16:24:50.927 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:24:50.935 INFO:tasks.ceph.mds.a:Stopped 2024-07-24T16:24:50.935 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-07-24T16:24:50.936 INFO:tasks.ceph.mds.c:Stopped 2024-07-24T16:24:50.936 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-07-24T16:24:50.941 INFO:tasks.ceph.mds.d:Stopped 2024-07-24T16:24:50.941 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-07-24T16:24:50.942 INFO:tasks.ceph.mds.b:Stopped 2024-07-24T16:24:50.943 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-07-24T16:24:50.978 INFO:tasks.ceph.mds.a:Started 2024-07-24T16:24:50.978 DEBUG:teuthology.parallel:result is None 2024-07-24T16:24:50.979 INFO:tasks.ceph.mds.c:Started 2024-07-24T16:24:50.980 DEBUG:teuthology.parallel:result is None 2024-07-24T16:24:50.983 INFO:tasks.ceph.mds.d:Started 2024-07-24T16:24:50.984 DEBUG:teuthology.parallel:result is None 2024-07-24T16:24:50.984 INFO:tasks.ceph.mds.b:Started 2024-07-24T16:24:50.985 DEBUG:teuthology.parallel:result is None 2024-07-24T16:24:50.985 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-07-24T16:24:51.056 INFO:tasks.ceph.mds.a.smithi159.stdout:starting mds.a at 2024-07-24T16:24:51.057 INFO:tasks.ceph.mds.c.smithi159.stdout:starting mds.c at 2024-07-24T16:24:51.066 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-07-24T16:24:51.066 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-07-24T16:24:51.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.094+0000 7f552a139640 1 -- 172.21.15.159:0/45329088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f552415d950 msgr2=0x7f5524161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:51.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.094+0000 7f552a139640 1 --2- 172.21.15.159:0/45329088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f552415d950 0x7f5524161f20 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5524161470 tx=0x7f551402a560 comp rx=0 tx=0).stop 2024-07-24T16:24:51.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.094+0000 7f552a139640 1 -- 172.21.15.159:0/45329088 shutdown_connections 2024-07-24T16:24:51.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.094+0000 7f552a139640 1 --2- 172.21.15.159:0/45329088 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55240b0b60 0x7f55240cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:51.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.094+0000 7f552a139640 1 --2- 172.21.15.159:0/45329088 >> v2:172.21.15.193:3300/0 conn(0x7f55240b2ae0 0x7f55240b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:51.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.094+0000 7f552a139640 1 --2- 172.21.15.159:0/45329088 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f552415d950 0x7f5524161f20 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:51.097 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.094+0000 7f552a139640 1 -- 172.21.15.159:0/45329088 >> 172.21.15.159:0/45329088 conn(0x7f552409cd30 msgr2=0x7f55240d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:51.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.094+0000 7f552a139640 1 -- 172.21.15.159:0/45329088 shutdown_connections 2024-07-24T16:24:51.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.094+0000 7f552a139640 1 -- 172.21.15.159:0/45329088 wait complete. 2024-07-24T16:24:51.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.095+0000 7f552a139640 1 Processor -- start 2024-07-24T16:24:51.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.095+0000 7f552a139640 1 -- start start 2024-07-24T16:24:51.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f552a139640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55240b0b60 0x7f5524150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:51.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f552a139640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55240b2ae0 0x7f55240cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:51.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f552a139640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f552415d950 0x7f552415b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:51.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f552a139640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f55240d0040 con 0x7f55240b0b60 2024-07-24T16:24:51.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f552a139640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f55240cfec0 con 0x7f552415d950 2024-07-24T16:24:51.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f552a139640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f55240d02e0 con 0x7f55240b2ae0 2024-07-24T16:24:51.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f55237fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55240b0b60 0x7f5524150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:51.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f55237fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55240b0b60 0x7f5524150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44220/0 (socket says 172.21.15.159:44220) 2024-07-24T16:24:51.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f55237fe640 1 -- 172.21.15.159:0/2835060302 learned_addr learned my addr 172.21.15.159:0/2835060302 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:51.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f551affd640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55240b2ae0 0x7f55240cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:51.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f5523fff640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f552415d950 0x7f552415b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:51.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f55237fe640 1 -- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55240b2ae0 msgr2=0x7f55240cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:51.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f55237fe640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55240b2ae0 0x7f55240cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:51.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f55237fe640 1 -- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f552415d950 msgr2=0x7f552415b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:51.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f55237fe640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f552415d950 0x7f552415b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:51.104 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f55237fe640 1 -- 172.21.15.159:0/2835060302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55240c8a40 con 0x7f55240b0b60 2024-07-24T16:24:51.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f551affd640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55240b2ae0 0x7f55240cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:24:51.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.096+0000 7f5523fff640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f552415d950 0x7f552415b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:24:51.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.097+0000 7f55237fe640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55240b0b60 0x7f5524150ee0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5514034040 tx=0x7f55140038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:51.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.097+0000 7f5520ff9640 1 -- 172.21.15.159:0/2835060302 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f551403e030 con 0x7f55240b0b60 2024-07-24T16:24:51.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.097+0000 7f5520ff9640 1 -- 172.21.15.159:0/2835060302 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5514003ca0 con 0x7f55240b0b60 2024-07-24T16:24:51.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.097+0000 7f552a139640 1 -- 172.21.15.159:0/2835060302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5524151420 con 0x7f55240b0b60 2024-07-24T16:24:51.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.097+0000 7f5520ff9640 1 -- 172.21.15.159:0/2835060302 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5514035040 con 0x7f55240b0b60 2024-07-24T16:24:51.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.097+0000 7f552a139640 1 -- 172.21.15.159:0/2835060302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55240c8fc0 con 0x7f55240b0b60 2024-07-24T16:24:51.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.098+0000 7f552a139640 1 -- 172.21.15.159:0/2835060302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55240b0620 con 0x7f55240b0b60 2024-07-24T16:24:51.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.099+0000 7f5520ff9640 1 -- 172.21.15.159:0/2835060302 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5514041030 con 0x7f55240b0b60 2024-07-24T16:24:51.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.099+0000 7f5520ff9640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5504077010 0x7f55040794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:51.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.099+0000 7f5520ff9640 1 -- 172.21.15.159:0/2835060302 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 5335+0+0 (secure 0 0 0) 0x7f55140b8ac0 con 0x7f55240b0b60 2024-07-24T16:24:51.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.099+0000 7f551affd640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5504077010 0x7f55040794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:51.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.100+0000 7f551affd640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5504077010 0x7f55040794d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f552408d940 tx=0x7f550c005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:51.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.107+0000 7f5520ff9640 1 -- 172.21.15.159:0/2835060302 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f5514081900 con 0x7f55240b0b60 2024-07-24T16:24:51.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.306+0000 7f552a139640 1 -- 172.21.15.159:0/2835060302 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f55240c70c0 con 0x7f55240b0b60 2024-07-24T16:24:51.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.912+0000 7f5520ff9640 1 -- 172.21.15.159:0/2835060302 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) ==== 97+0+0 (secure 0 0 0) 0x7f5514085e50 con 0x7f55240b0b60 2024-07-24T16:24:51.914 INFO:teuthology.orchestra.run.smithi159.stderr: removed all blocklist entries 2024-07-24T16:24:51.917 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.914+0000 7f552a139640 1 -- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5504077010 msgr2=0x7f55040794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:51.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.914+0000 7f552a139640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5504077010 0x7f55040794d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f552408d940 tx=0x7f550c005f90 comp rx=0 tx=0).stop 2024-07-24T16:24:51.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.914+0000 7f552a139640 1 -- 172.21.15.159:0/2835060302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55240b0b60 msgr2=0x7f5524150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:51.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.914+0000 7f552a139640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55240b0b60 0x7f5524150ee0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f5514034040 tx=0x7f55140038a0 comp rx=0 tx=0).stop 2024-07-24T16:24:51.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.914+0000 7f552a139640 1 -- 172.21.15.159:0/2835060302 shutdown_connections 2024-07-24T16:24:51.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.914+0000 7f552a139640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5504077010 0x7f55040794d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:51.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.914+0000 7f552a139640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f552415d950 0x7f552415b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:51.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.914+0000 7f552a139640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f55240b2ae0 0x7f55240cb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:51.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.914+0000 7f552a139640 1 --2- 172.21.15.159:0/2835060302 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f55240b0b60 0x7f5524150ee0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:51.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.914+0000 7f552a139640 1 -- 172.21.15.159:0/2835060302 >> 172.21.15.159:0/2835060302 conn(0x7f552409cd30 msgr2=0x7f55240b77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:51.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.914+0000 7f552a139640 1 -- 172.21.15.159:0/2835060302 shutdown_connections 2024-07-24T16:24:51.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:51.914+0000 7f552a139640 1 -- 172.21.15.159:0/2835060302 wait complete. 2024-07-24T16:24:51.929 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-07-24T16:24:52.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.031+0000 7f6e143fa640 1 -- 172.21.15.159:0/1281858375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df4003c30 msgr2=0x7f6df4004030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:52.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.031+0000 7f6e143fa640 1 --2- 172.21.15.159:0/1281858375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df4003c30 0x7f6df4004030 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc00e3d0 tx=0x7f6df4005830 comp rx=0 tx=0).stop 2024-07-24T16:24:52.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.031+0000 7f6e143fa640 1 -- 172.21.15.159:0/1281858375 shutdown_connections 2024-07-24T16:24:52.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.031+0000 7f6e143fa640 1 --2- 172.21.15.159:0/1281858375 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df4003c30 0x7f6df4004030 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.031+0000 7f6e143fa640 1 -- 172.21.15.159:0/1281858375 >> 172.21.15.159:0/1281858375 conn(0x7f6e0c09cd30 msgr2=0x7f6e0c0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:52.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.031+0000 7f6e143fa640 1 -- 172.21.15.159:0/1281858375 shutdown_connections 2024-07-24T16:24:52.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.031+0000 7f6e143fa640 1 -- 172.21.15.159:0/1281858375 wait complete. 2024-07-24T16:24:52.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.032+0000 7f6e143fa640 1 Processor -- start 2024-07-24T16:24:52.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.032+0000 7f6e143fa640 1 -- start start 2024-07-24T16:24:52.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e143fa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df4003c30 0x7f6e0c0c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:52.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e143fa640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6e0c157310 0x7f6e0c0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:52.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e143fa640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e0c0b0b60 0x7f6e0c1f72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:52.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e143fa640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c1620a0 con 0x7f6df4003c30 2024-07-24T16:24:52.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e143fa640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c161f20 con 0x7f6e0c0b0b60 2024-07-24T16:24:52.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e143fa640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6e0c162220 con 0x7f6e0c157310 2024-07-24T16:24:52.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e12196640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df4003c30 0x7f6e0c0c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:52.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e12196640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df4003c30 0x7f6e0c0c9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44238/0 (socket says 172.21.15.159:44238) 2024-07-24T16:24:52.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e12196640 1 -- 172.21.15.159:0/4025952172 learned_addr learned my addr 172.21.15.159:0/4025952172 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:52.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e12997640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e0c0b0b60 0x7f6e0c1f72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:52.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e11995640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6e0c157310 0x7f6e0c0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:52.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e12196640 1 -- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6e0c157310 msgr2=0x7f6e0c0b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:52.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e12196640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6e0c157310 0x7f6e0c0b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e12196640 1 -- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e0c0b0b60 msgr2=0x7f6e0c1f72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:52.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e12196640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e0c0b0b60 0x7f6e0c1f72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.033+0000 7f6e12196640 1 -- 172.21.15.159:0/4025952172 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c0b1ac0 con 0x7f6df4003c30 2024-07-24T16:24:52.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.034+0000 7f6e12196640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df4003c30 0x7f6e0c0c9f80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc036040 tx=0x7f6dfc033d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:52.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.034+0000 7f6e0affd640 1 -- 172.21.15.159:0/4025952172 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc038050 con 0x7f6df4003c30 2024-07-24T16:24:52.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.034+0000 7f6e0affd640 1 -- 172.21.15.159:0/4025952172 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6dfc039040 con 0x7f6df4003c30 2024-07-24T16:24:52.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.034+0000 7f6e143fa640 1 -- 172.21.15.159:0/4025952172 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e0c0b8960 con 0x7f6df4003c30 2024-07-24T16:24:52.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.034+0000 7f6e0affd640 1 -- 172.21.15.159:0/4025952172 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dfc009200 con 0x7f6df4003c30 2024-07-24T16:24:52.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.034+0000 7f6e143fa640 1 -- 172.21.15.159:0/4025952172 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e0c0b8f20 con 0x7f6df4003c30 2024-07-24T16:24:52.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.035+0000 7f6e143fa640 1 -- 172.21.15.159:0/4025952172 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e0c0cfed0 con 0x7f6df4003c30 2024-07-24T16:24:52.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.035+0000 7f6e0affd640 1 -- 172.21.15.159:0/4025952172 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f6dfc046030 con 0x7f6df4003c30 2024-07-24T16:24:52.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.036+0000 7f6e0affd640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6df8077010 0x7f6df80794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:52.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.036+0000 7f6e0affd640 1 -- 172.21.15.159:0/4025952172 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f6dfc0b93f0 con 0x7f6df4003c30 2024-07-24T16:24:52.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.036+0000 7f6e11995640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6df8077010 0x7f6df80794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:52.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.036+0000 7f6e11995640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6df8077010 0x7f6df80794d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c161490 tx=0x7f6e00006b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:52.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.040+0000 7f6e0affd640 1 -- 172.21.15.159:0/4025952172 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f6dfc04d060 con 0x7f6df4003c30 2024-07-24T16:24:52.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.289+0000 7f6e143fa640 1 -- 172.21.15.159:0/4025952172 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f6e0c0b0f40 con 0x7f6df4003c30 2024-07-24T16:24:52.292 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.290+0000 7f6e0affd640 1 -- 172.21.15.159:0/4025952172 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7f6dfc082280 con 0x7f6df4003c30 2024-07-24T16:24:52.292 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout: "auth_dump": [ 2024-07-24T16:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "mds.a", 2024-07-24T16:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFm5KfHFhAAY2Za2E4Gx30qtxlasNyN8A==", 2024-07-24T16:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow *", 2024-07-24T16:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow *", 2024-07-24T16:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.293 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.294 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "mds.b", 2024-07-24T16:24:52.294 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFmDIh+IhAA+PC+rx36kT5DRJA9ME7ZoA==", 2024-07-24T16:24:52.294 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.294 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:24:52.294 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow *", 2024-07-24T16:24:52.294 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow *", 2024-07-24T16:24:52.294 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.294 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.294 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.294 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.294 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "mds.c", 2024-07-24T16:24:52.294 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFmEsnMHRAAb3Hsgjo+OSBszRC2eA4QAw==", 2024-07-24T16:24:52.294 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.295 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:24:52.295 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow *", 2024-07-24T16:24:52.295 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow *", 2024-07-24T16:24:52.295 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.295 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.295 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.295 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.295 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "mds.d", 2024-07-24T16:24:52.295 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFmwVuGKRAAd1JqAKzMFph6sn3NsEKNKQ==", 2024-07-24T16:24:52.295 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.295 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:24:52.295 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow *", 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow *", 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.0", 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQB0KqFmKfM9DxAADINqtpam4FeXnyDKqdKo8w==", 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.296 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.1", 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQB3KqFmVrnhDRAAIqQelAm1HZgnifSROfOC3w==", 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.2", 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQB6KqFm1MyIDBAAduCyQkJJflqiatmZQnFojA==", 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:24:52.297 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:24:52.298 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.298 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.298 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.298 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.298 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.3", 2024-07-24T16:24:52.298 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQB9KqFm+jV/CxAAhB1z7oYLJ5G5A19FyCxzoQ==", 2024-07-24T16:24:52.298 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.298 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:24:52.298 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:24:52.298 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.298 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.298 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.298 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.299 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.4", 2024-07-24T16:24:52.299 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCDKqFmRXzWEBAAcOfwJxUM0QqEhMQZJq2ttQ==", 2024-07-24T16:24:52.299 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.299 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:24:52.299 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:24:52.299 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.299 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.299 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.299 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.299 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.5", 2024-07-24T16:24:52.299 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCGKqFmvf7LDhAATDjsR+93NeLyzFgkMtlkIg==", 2024-07-24T16:24:52.299 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.6", 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCJKqFm79FbDBAAvQ7mougCMteNRU0ZYhPDtw==", 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.300 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.7", 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCMKqFm1kpRCxAAy674XU+yH6FDhRtEA6bQfw==", 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.0", 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFmSByWLRAAlc1hHDXFceGP9BYk8GpZJA==", 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.301 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:24:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow r", 2024-07-24T16:24:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow rw", 2024-07-24T16:24:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow rwx" 2024-07-24T16:24:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.1", 2024-07-24T16:24:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFmLnZUNhAADbBfaqZTiBxwXvsI/8Oetw==", 2024-07-24T16:24:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:24:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow r", 2024-07-24T16:24:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow rw", 2024-07-24T16:24:52.302 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow rwx" 2024-07-24T16:24:52.303 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.303 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.303 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.303 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.2", 2024-07-24T16:24:52.303 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFma6ElMxAAkFEc8XeYlEJfuiT5W/bnig==", 2024-07-24T16:24:52.303 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.303 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:24:52.303 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow r", 2024-07-24T16:24:52.303 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow rw", 2024-07-24T16:24:52.303 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow rwx" 2024-07-24T16:24:52.303 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.303 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.303 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.3", 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBxKqFmWh5PABAAZbCzsIQ1u3ryno6wsxLHaw==", 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow r", 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow rw", 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow rwx" 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.admin", 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBvKqFm0xQtNhAAd/lL8RpL+GWOV/8U74gvyw==", 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.304 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow *", 2024-07-24T16:24:52.305 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow *", 2024-07-24T16:24:52.305 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow *", 2024-07-24T16:24:52.305 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.305 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.305 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.305 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.305 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.bootstrap-mds", 2024-07-24T16:24:52.305 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCRKqFmpTVAOhAAblZC8Tu15CvSMJc11hYgew==", 2024-07-24T16:24:52.305 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.305 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile bootstrap-mds" 2024-07-24T16:24:52.305 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.305 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.305 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.306 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.bootstrap-mgr", 2024-07-24T16:24:52.306 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCRKqFmuz1AOhAAK2dncHrXRYTgAtbaaa2kNQ==", 2024-07-24T16:24:52.306 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.306 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile bootstrap-mgr" 2024-07-24T16:24:52.306 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.306 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.306 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.306 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.bootstrap-osd", 2024-07-24T16:24:52.306 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCRKqFm5URAOhAAGsY4wk5d+HNnA7xgzwKKEg==", 2024-07-24T16:24:52.306 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.306 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile bootstrap-osd" 2024-07-24T16:24:52.306 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.306 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.bootstrap-rbd", 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCRKqFmtktAOhAAQy/7nnHDRF54t4rR+MMymA==", 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile bootstrap-rbd" 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCRKqFmwVNAOhAAvOJfnPf51enrqtL4GKF99A==", 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.307 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.bootstrap-rgw", 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCRKqFm+VpAOhAA3lO5eF7KwDUV41TgEqnxrg==", 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile bootstrap-rgw" 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "mgr.x", 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFm5PSOExAAiVy9cpsNzzUXYeHA2ObdMQ==", 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow *", 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile mgr", 2024-07-24T16:24:52.308 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.309 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.309 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:24:52.309 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:52.309 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "mgr.y", 2024-07-24T16:24:52.309 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFmKFxUDxAAiFTz+i9lmpUGmYQLBlNfLg==", 2024-07-24T16:24:52.309 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:24:52.309 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow *", 2024-07-24T16:24:52.309 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile mgr", 2024-07-24T16:24:52.309 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:24:52.309 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.309 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:52.309 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-07-24T16:24:52.309 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:24:52.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.293+0000 7f6e143fa640 1 -- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6df8077010 msgr2=0x7f6df80794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:52.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.293+0000 7f6e143fa640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6df8077010 0x7f6df80794d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c161490 tx=0x7f6e00006b10 comp rx=0 tx=0).stop 2024-07-24T16:24:52.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.293+0000 7f6e143fa640 1 -- 172.21.15.159:0/4025952172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df4003c30 msgr2=0x7f6e0c0c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:52.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.293+0000 7f6e143fa640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df4003c30 0x7f6e0c0c9f80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6dfc036040 tx=0x7f6dfc033d70 comp rx=0 tx=0).stop 2024-07-24T16:24:52.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.293+0000 7f6e143fa640 1 -- 172.21.15.159:0/4025952172 shutdown_connections 2024-07-24T16:24:52.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.293+0000 7f6e143fa640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f6df8077010 0x7f6df80794d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.293+0000 7f6e143fa640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6e0c0b0b60 0x7f6e0c1f72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.293+0000 7f6e143fa640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6e0c157310 0x7f6e0c0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.293+0000 7f6e143fa640 1 --2- 172.21.15.159:0/4025952172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6df4003c30 0x7f6e0c0c9f80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.293+0000 7f6e143fa640 1 -- 172.21.15.159:0/4025952172 >> 172.21.15.159:0/4025952172 conn(0x7f6e0c09cd30 msgr2=0x7f6e0c15c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:52.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.293+0000 7f6e143fa640 1 -- 172.21.15.159:0/4025952172 shutdown_connections 2024-07-24T16:24:52.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.293+0000 7f6e143fa640 1 -- 172.21.15.159:0/4025952172 wait complete. 2024-07-24T16:24:52.312 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-07-24T16:24:52.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.416+0000 7f2b3004e640 1 -- 172.21.15.159:0/1009449606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b14004800 msgr2=0x7f2b14004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:52.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.416+0000 7f2b3004e640 1 --2- 172.21.15.159:0/1009449606 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b14004800 0x7f2b14004c80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2b18009b20 tx=0x7f2b14005830 comp rx=0 tx=0).stop 2024-07-24T16:24:52.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.416+0000 7f2b2e5eb640 1 -- 172.21.15.159:0/1009449606 reap_dead start 2024-07-24T16:24:52.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.416+0000 7f2b3004e640 1 -- 172.21.15.159:0/1009449606 shutdown_connections 2024-07-24T16:24:52.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.416+0000 7f2b3004e640 1 -- 172.21.15.159:0/1009449606 >> 172.21.15.159:0/1009449606 conn(0x7f2b2809cd30 msgr2=0x7f2b280d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:52.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.416+0000 7f2b3004e640 1 -- 172.21.15.159:0/1009449606 shutdown_connections 2024-07-24T16:24:52.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.416+0000 7f2b3004e640 1 -- 172.21.15.159:0/1009449606 wait complete. 2024-07-24T16:24:52.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.417+0000 7f2b3004e640 1 Processor -- start 2024-07-24T16:24:52.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.417+0000 7f2b3004e640 1 -- start start 2024-07-24T16:24:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b3004e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2b14004800 0x7f2b281f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b3004e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b2814bcd0 0x7f2b2814e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b3004e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b28151510 0x7f2b28160440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b3004e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2b280d0b70 con 0x7f2b28151510 2024-07-24T16:24:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b3004e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2b280d09f0 con 0x7f2b2814bcd0 2024-07-24T16:24:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b3004e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f2b28161f20 con 0x7f2b14004800 2024-07-24T16:24:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b2e5eb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b28151510 0x7f2b28160440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b2e5eb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b28151510 0x7f2b28160440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44260/0 (socket says 172.21.15.159:44260) 2024-07-24T16:24:52.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b2e5eb640 1 -- 172.21.15.159:0/2727451770 learned_addr learned my addr 172.21.15.159:0/2727451770 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b2ddea640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2b14004800 0x7f2b281f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b2d5e9640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b2814bcd0 0x7f2b2814e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b2e5eb640 1 -- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2b14004800 msgr2=0x7f2b281f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b2e5eb640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2b14004800 0x7f2b281f74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b2e5eb640 1 -- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b2814bcd0 msgr2=0x7f2b2814e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b2e5eb640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b2814bcd0 0x7f2b2814e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b2e5eb640 1 -- 172.21.15.159:0/2727451770 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b281f83e0 con 0x7f2b28151510 2024-07-24T16:24:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b2d5e9640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b2814bcd0 0x7f2b2814e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.418+0000 7f2b2ddea640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2b14004800 0x7f2b281f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.419+0000 7f2b2e5eb640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b28151510 0x7f2b28160440 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2b280d3210 tx=0x7f2b20006660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.419+0000 7f2b1e7fc640 1 -- 172.21.15.159:0/2727451770 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20015070 con 0x7f2b28151510 2024-07-24T16:24:52.422 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.419+0000 7f2b1e7fc640 1 -- 172.21.15.159:0/2727451770 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2b2000fc90 con 0x7f2b28151510 2024-07-24T16:24:52.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.419+0000 7f2b3004e640 1 -- 172.21.15.159:0/2727451770 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b280ccb80 con 0x7f2b28151510 2024-07-24T16:24:52.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.419+0000 7f2b1e7fc640 1 -- 172.21.15.159:0/2727451770 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b20011690 con 0x7f2b28151510 2024-07-24T16:24:52.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.419+0000 7f2b3004e640 1 -- 172.21.15.159:0/2727451770 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b281f7e20 con 0x7f2b28151510 2024-07-24T16:24:52.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.420+0000 7f2b3004e640 1 -- 172.21.15.159:0/2727451770 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b280ccd50 con 0x7f2b28151510 2024-07-24T16:24:52.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.420+0000 7f2b1e7fc640 1 -- 172.21.15.159:0/2727451770 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f2b20011830 con 0x7f2b28151510 2024-07-24T16:24:52.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.421+0000 7f2b1e7fc640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2b0c077010 0x7f2b0c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:52.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.421+0000 7f2b1e7fc640 1 -- 172.21.15.159:0/2727451770 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f2b20099460 con 0x7f2b28151510 2024-07-24T16:24:52.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.421+0000 7f2b2ddea640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2b0c077010 0x7f2b0c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:52.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.422+0000 7f2b2ddea640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2b0c077010 0x7f2b0c0794d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b24000c00 tx=0x7f2b24006b70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:52.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.425+0000 7f2b1e7fc640 1 -- 172.21.15.159:0/2727451770 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f2b200628c0 con 0x7f2b28151510 2024-07-24T16:24:52.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.677+0000 7f2b3004e640 1 -- 172.21.15.159:0/2727451770 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f2b280cfc20 con 0x7f2b28151510 2024-07-24T16:24:52.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.679+0000 7f2b1e7fc640 1 -- 172.21.15.159:0/2727451770 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f2b200621c0 con 0x7f2b28151510 2024-07-24T16:24:52.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.681+0000 7f2b3004e640 1 -- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2b0c077010 msgr2=0x7f2b0c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:52.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.681+0000 7f2b3004e640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2b0c077010 0x7f2b0c0794d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2b24000c00 tx=0x7f2b24006b70 comp rx=0 tx=0).stop 2024-07-24T16:24:52.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.681+0000 7f2b3004e640 1 -- 172.21.15.159:0/2727451770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b28151510 msgr2=0x7f2b28160440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:52.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.681+0000 7f2b3004e640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b28151510 0x7f2b28160440 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2b280d3210 tx=0x7f2b20006660 comp rx=0 tx=0).stop 2024-07-24T16:24:52.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.681+0000 7f2b3004e640 1 -- 172.21.15.159:0/2727451770 shutdown_connections 2024-07-24T16:24:52.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.681+0000 7f2b3004e640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2b0c077010 0x7f2b0c0794d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.681+0000 7f2b3004e640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2b28151510 0x7f2b28160440 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.681+0000 7f2b3004e640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2b2814bcd0 0x7f2b2814e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.681+0000 7f2b3004e640 1 --2- 172.21.15.159:0/2727451770 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2b14004800 0x7f2b281f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.681+0000 7f2b3004e640 1 -- 172.21.15.159:0/2727451770 >> 172.21.15.159:0/2727451770 conn(0x7f2b2809cd30 msgr2=0x7f2b280b8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:52.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.681+0000 7f2b3004e640 1 -- 172.21.15.159:0/2727451770 shutdown_connections 2024-07-24T16:24:52.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.681+0000 7f2b3004e640 1 -- 172.21.15.159:0/2727451770 wait complete. 2024-07-24T16:24:52.694 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-07-24T16:24:52.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.798+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1526214773 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1d980cf760 msgr2=0x7f1d980b3d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:52.800 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.798+0000 7f1d9d4f0640 1 --2- 172.21.15.159:0/1526214773 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1d980cf760 0x7f1d980b3d90 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d88005fd0 tx=0x7f1d8802aa90 comp rx=0 tx=0).stop 2024-07-24T16:24:52.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.799+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1526214773 shutdown_connections 2024-07-24T16:24:52.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.799+0000 7f1d9d4f0640 1 --2- 172.21.15.159:0/1526214773 >> v2:172.21.15.193:3300/0 conn(0x7f1d980cfb40 0x7f1d980cffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.799+0000 7f1d9d4f0640 1 --2- 172.21.15.159:0/1526214773 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1d980cf760 0x7f1d980b3d90 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.799+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1526214773 >> 172.21.15.159:0/1526214773 conn(0x7f1d980b3270 msgr2=0x7f1d980b3680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:52.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.799+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1526214773 shutdown_connections 2024-07-24T16:24:52.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.799+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1526214773 wait complete. 2024-07-24T16:24:52.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.800+0000 7f1d9d4f0640 1 Processor -- start 2024-07-24T16:24:52.802 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.800+0000 7f1d9d4f0640 1 -- start start 2024-07-24T16:24:52.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d9d4f0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d980cf760 0x7f1d98153250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:52.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d9d4f0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1d980cfb40 0x7f1d980b6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:52.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d9d4f0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d9815f670 0x7f1d980b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:52.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d9d4f0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1d980cc790 con 0x7f1d9815f670 2024-07-24T16:24:52.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d9d4f0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1d980cc610 con 0x7f1d980cf760 2024-07-24T16:24:52.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d9d4f0640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1d980cc910 con 0x7f1d980cfb40 2024-07-24T16:24:52.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d977fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d9815f670 0x7f1d980b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:52.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d977fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d9815f670 0x7f1d980b4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44272/0 (socket says 172.21.15.159:44272) 2024-07-24T16:24:52.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d977fe640 1 -- 172.21.15.159:0/1054493071 learned_addr learned my addr 172.21.15.159:0/1054493071 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:52.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d96ffd640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d980cf760 0x7f1d98153250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:52.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d967fc640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1d980cfb40 0x7f1d980b6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:52.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d977fe640 1 -- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1d980cfb40 msgr2=0x7f1d980b6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:52.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d977fe640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1d980cfb40 0x7f1d980b6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d977fe640 1 -- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d980cf760 msgr2=0x7f1d98153250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:52.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d977fe640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d980cf760 0x7f1d98153250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:52.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d977fe640 1 -- 172.21.15.159:0/1054493071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d98157090 con 0x7f1d9815f670 2024-07-24T16:24:52.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d977fe640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d9815f670 0x7f1d980b4f80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000c3c0 tx=0x7f1d9000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:52.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d8f7fe640 1 -- 172.21.15.159:0/1054493071 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d90017070 con 0x7f1d9815f670 2024-07-24T16:24:52.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.801+0000 7f1d8f7fe640 1 -- 172.21.15.159:0/1054493071 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d900053c0 con 0x7f1d9815f670 2024-07-24T16:24:52.805 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.802+0000 7f1d8f7fe640 1 -- 172.21.15.159:0/1054493071 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d90003850 con 0x7f1d9815f670 2024-07-24T16:24:52.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.802+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1054493071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d98157330 con 0x7f1d9815f670 2024-07-24T16:24:52.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.802+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1054493071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d981578f0 con 0x7f1d9815f670 2024-07-24T16:24:52.806 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.803+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1054493071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d980cffa0 con 0x7f1d9815f670 2024-07-24T16:24:52.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.803+0000 7f1d8f7fe640 1 -- 172.21.15.159:0/1054493071 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f1d9001a070 con 0x7f1d9815f670 2024-07-24T16:24:52.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.804+0000 7f1d8f7fe640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1d78077010 0x7f1d780794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:52.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.804+0000 7f1d8f7fe640 1 -- 172.21.15.159:0/1054493071 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f1d90097a10 con 0x7f1d9815f670 2024-07-24T16:24:52.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.804+0000 7f1d96ffd640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1d78077010 0x7f1d780794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:52.807 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.804+0000 7f1d96ffd640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1d78077010 0x7f1d780794d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1d88035000 tx=0x7f1d88039040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:52.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:52.808+0000 7f1d8f7fe640 1 -- 172.21.15.159:0/1054493071 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f1d90060790 con 0x7f1d9815f670 2024-07-24T16:24:53.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.065+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1054493071 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f1d980b1300 con 0x7f1d9815f670 2024-07-24T16:24:53.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.067+0000 7f1d8f7fe640 1 -- 172.21.15.159:0/1054493071 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7f1d90064ce0 con 0x7f1d9815f670 2024-07-24T16:24:53.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.069+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1d78077010 msgr2=0x7f1d780794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.069+0000 7f1d9d4f0640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1d78077010 0x7f1d780794d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1d88035000 tx=0x7f1d88039040 comp rx=0 tx=0).stop 2024-07-24T16:24:53.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.069+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1054493071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d9815f670 msgr2=0x7f1d980b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.069+0000 7f1d9d4f0640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d9815f670 0x7f1d980b4f80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1d9000c3c0 tx=0x7f1d9000c880 comp rx=0 tx=0).stop 2024-07-24T16:24:53.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.069+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1054493071 shutdown_connections 2024-07-24T16:24:53.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.069+0000 7f1d9d4f0640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1d78077010 0x7f1d780794d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.069+0000 7f1d9d4f0640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d9815f670 0x7f1d980b4f80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.069+0000 7f1d9d4f0640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1d980cfb40 0x7f1d980b6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.069+0000 7f1d9d4f0640 1 --2- 172.21.15.159:0/1054493071 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1d980cf760 0x7f1d98153250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.069+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1054493071 >> 172.21.15.159:0/1054493071 conn(0x7f1d980b3270 msgr2=0x7f1d980afe50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:53.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.069+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1054493071 shutdown_connections 2024-07-24T16:24:53.072 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.069+0000 7f1d9d4f0640 1 -- 172.21.15.159:0/1054493071 wait complete. 2024-07-24T16:24:53.082 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-07-24T16:24:53.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.185+0000 7ff9dff97640 1 -- 172.21.15.159:0/3732300774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c4004d40 msgr2=0x7ff9c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.185+0000 7ff9dff97640 1 --2- 172.21.15.159:0/3732300774 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9c4004d40 0x7ff9c40051c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ff9d0009f00 tx=0x7ff9c4005830 comp rx=0 tx=0).stop 2024-07-24T16:24:53.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.185+0000 7ff9de534640 1 -- 172.21.15.159:0/3732300774 reap_dead start 2024-07-24T16:24:53.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.185+0000 7ff9dff97640 1 -- 172.21.15.159:0/3732300774 shutdown_connections 2024-07-24T16:24:53.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.185+0000 7ff9dff97640 1 -- 172.21.15.159:0/3732300774 >> 172.21.15.159:0/3732300774 conn(0x7ff9d806d450 msgr2=0x7ff9d806d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:53.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.185+0000 7ff9dff97640 1 -- 172.21.15.159:0/3732300774 shutdown_connections 2024-07-24T16:24:53.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.185+0000 7ff9dff97640 1 -- 172.21.15.159:0/3732300774 wait complete. 2024-07-24T16:24:53.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.186+0000 7ff9dff97640 1 Processor -- start 2024-07-24T16:24:53.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.187+0000 7ff9dff97640 1 -- start start 2024-07-24T16:24:53.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.187+0000 7ff9dff97640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9c4004d40 0x7ff9d81f3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:53.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.187+0000 7ff9dff97640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d80cf210 0x7ff9d8152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:53.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.187+0000 7ff9dff97640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9d815c370 0x7ff9d8154250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:53.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.187+0000 7ff9dff97640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d8070550 con 0x7ff9d80cf210 2024-07-24T16:24:53.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.187+0000 7ff9dff97640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff9d80b3ed0 con 0x7ff9c4004d40 2024-07-24T16:24:53.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.187+0000 7ff9dff97640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff9d81f4450 con 0x7ff9d815c370 2024-07-24T16:24:53.191 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.187+0000 7ff9dd532640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d80cf210 0x7ff9d8152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:53.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.187+0000 7ff9dd532640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d80cf210 0x7ff9d8152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44290/0 (socket says 172.21.15.159:44290) 2024-07-24T16:24:53.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.187+0000 7ff9dd532640 1 -- 172.21.15.159:0/2055097247 learned_addr learned my addr 172.21.15.159:0/2055097247 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:53.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9ddd33640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9c4004d40 0x7ff9d81f3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:53.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9dd532640 1 -- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9d815c370 msgr2=0x7ff9d8154250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9de534640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9d815c370 0x7ff9d8154250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:53.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9dd532640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9d815c370 0x7ff9d8154250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9dd532640 1 -- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9c4004d40 msgr2=0x7ff9d81f3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9dd532640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9c4004d40 0x7ff9d81f3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9dd532640 1 -- 172.21.15.159:0/2055097247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9d81f4730 con 0x7ff9d80cf210 2024-07-24T16:24:53.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9ddd33640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9c4004d40 0x7ff9d81f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:53.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9dd532640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d80cf210 0x7ff9d8152080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80066b0 tx=0x7ff9c80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:53.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9ce7fc640 1 -- 172.21.15.159:0/2055097247 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8015070 con 0x7ff9d80cf210 2024-07-24T16:24:53.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9ce7fc640 1 -- 172.21.15.159:0/2055097247 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9c8011900 con 0x7ff9d80cf210 2024-07-24T16:24:53.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9dff97640 1 -- 172.21.15.159:0/2055097247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9d81f4a10 con 0x7ff9d80cf210 2024-07-24T16:24:53.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9ce7fc640 1 -- 172.21.15.159:0/2055097247 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c8011d50 con 0x7ff9d80cf210 2024-07-24T16:24:53.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.188+0000 7ff9dff97640 1 -- 172.21.15.159:0/2055097247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9d806fe90 con 0x7ff9d80cf210 2024-07-24T16:24:53.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.189+0000 7ff9dff97640 1 -- 172.21.15.159:0/2055097247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d80b43e0 con 0x7ff9d80cf210 2024-07-24T16:24:53.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.190+0000 7ff9ce7fc640 1 -- 172.21.15.159:0/2055097247 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7ff9c800f430 con 0x7ff9d80cf210 2024-07-24T16:24:53.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.190+0000 7ff9ce7fc640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff9bc077040 0x7ff9bc079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:53.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.190+0000 7ff9ce7fc640 1 -- 172.21.15.159:0/2055097247 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7ff9c8099390 con 0x7ff9d80cf210 2024-07-24T16:24:53.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.190+0000 7ff9ddd33640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff9bc077040 0x7ff9bc079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:53.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.191+0000 7ff9ddd33640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff9bc077040 0x7ff9bc079500 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4009b40 tx=0x7ff9d4005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:53.197 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.194+0000 7ff9ce7fc640 1 -- 172.21.15.159:0/2055097247 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7ff9c80627f0 con 0x7ff9d80cf210 2024-07-24T16:24:53.451 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.449+0000 7ff9dff97640 1 -- 172.21.15.159:0/2055097247 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7ff9d80afb60 con 0x7ff9d80cf210 2024-07-24T16:24:53.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.451+0000 7ff9ce7fc640 1 -- 172.21.15.159:0/2055097247 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7ff9c80620f0 con 0x7ff9d80cf210 2024-07-24T16:24:53.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.453+0000 7ff9dff97640 1 -- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff9bc077040 msgr2=0x7ff9bc079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.453+0000 7ff9dff97640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff9bc077040 0x7ff9bc079500 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff9d4009b40 tx=0x7ff9d4005f90 comp rx=0 tx=0).stop 2024-07-24T16:24:53.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.453+0000 7ff9dff97640 1 -- 172.21.15.159:0/2055097247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d80cf210 msgr2=0x7ff9d8152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.453+0000 7ff9dff97640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d80cf210 0x7ff9d8152080 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff9c80066b0 tx=0x7ff9c80039c0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.453+0000 7ff9dff97640 1 -- 172.21.15.159:0/2055097247 shutdown_connections 2024-07-24T16:24:53.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.453+0000 7ff9dff97640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7ff9bc077040 0x7ff9bc079500 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.453+0000 7ff9dff97640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff9d815c370 0x7ff9d8154250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.453+0000 7ff9dff97640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff9d80cf210 0x7ff9d8152080 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.453+0000 7ff9dff97640 1 --2- 172.21.15.159:0/2055097247 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff9c4004d40 0x7ff9d81f3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.453+0000 7ff9dff97640 1 -- 172.21.15.159:0/2055097247 >> 172.21.15.159:0/2055097247 conn(0x7ff9d806d450 msgr2=0x7ff9d8158b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:53.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.453+0000 7ff9dff97640 1 -- 172.21.15.159:0/2055097247 shutdown_connections 2024-07-24T16:24:53.457 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.453+0000 7ff9dff97640 1 -- 172.21.15.159:0/2055097247 wait complete. 2024-07-24T16:24:53.466 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-07-24T16:24:53.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.569+0000 7fc310631640 1 -- 172.21.15.159:0/1882267917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc30806f1c0 msgr2=0x7fc30815b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.569+0000 7fc310631640 1 --2- 172.21.15.159:0/1882267917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc30806f1c0 0x7fc30815b3c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8005fd0 tx=0x7fc2f802a8b0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.569+0000 7fc310631640 1 -- 172.21.15.159:0/1882267917 shutdown_connections 2024-07-24T16:24:53.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.569+0000 7fc310631640 1 --2- 172.21.15.159:0/1882267917 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc30806f1c0 0x7fc30815b3c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.569+0000 7fc310631640 1 --2- 172.21.15.159:0/1882267917 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc308070500 0x7fc3080cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.569+0000 7fc310631640 1 -- 172.21.15.159:0/1882267917 >> 172.21.15.159:0/1882267917 conn(0x7fc30806d450 msgr2=0x7fc30806d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:53.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.569+0000 7fc310631640 1 -- 172.21.15.159:0/1882267917 shutdown_connections 2024-07-24T16:24:53.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.569+0000 7fc310631640 1 -- 172.21.15.159:0/1882267917 wait complete. 2024-07-24T16:24:53.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.570+0000 7fc310631640 1 Processor -- start 2024-07-24T16:24:53.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.570+0000 7fc310631640 1 -- start start 2024-07-24T16:24:53.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc310631640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc30806f1c0 0x7fc3081f5b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:53.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc310631640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc308070500 0x7fc308073960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:53.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc310631640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc308157d50 0x7fc3081f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:53.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc310631640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc3080cdea0 con 0x7fc308157d50 2024-07-24T16:24:53.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc310631640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc3080cdd20 con 0x7fc30806f1c0 2024-07-24T16:24:53.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc310631640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc3080ce020 con 0x7fc308070500 2024-07-24T16:24:53.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc30ebce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc308157d50 0x7fc3081f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:53.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc30ebce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc308157d50 0x7fc3081f2c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44306/0 (socket says 172.21.15.159:44306) 2024-07-24T16:24:53.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc30ebce640 1 -- 172.21.15.159:0/3420773539 learned_addr learned my addr 172.21.15.159:0/3420773539 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:53.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc30dbcc640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc308070500 0x7fc308073960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:53.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc30e3cd640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc30806f1c0 0x7fc3081f5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:53.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc30ebce640 1 -- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc308070500 msgr2=0x7fc308073960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc30ebce640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc308070500 0x7fc308073960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc30ebce640 1 -- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc30806f1c0 msgr2=0x7fc3081f5b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc30ebce640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc30806f1c0 0x7fc3081f5b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc30ebce640 1 -- 172.21.15.159:0/3420773539 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3081f6260 con 0x7fc308157d50 2024-07-24T16:24:53.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.571+0000 7fc30ebce640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc308157d50 0x7fc3081f2c50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009cd0 tx=0x7fc2f8031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:53.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.572+0000 7fc306ffd640 1 -- 172.21.15.159:0/3420773539 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8040070 con 0x7fc308157d50 2024-07-24T16:24:53.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.572+0000 7fc310631640 1 -- 172.21.15.159:0/3420773539 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3081f6540 con 0x7fc308157d50 2024-07-24T16:24:53.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.572+0000 7fc306ffd640 1 -- 172.21.15.159:0/3420773539 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc2f8004040 con 0x7fc308157d50 2024-07-24T16:24:53.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.572+0000 7fc306ffd640 1 -- 172.21.15.159:0/3420773539 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8004470 con 0x7fc308157d50 2024-07-24T16:24:53.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.572+0000 7fc310631640 1 -- 172.21.15.159:0/3420773539 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3081f2730 con 0x7fc308157d50 2024-07-24T16:24:53.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.573+0000 7fc310631640 1 -- 172.21.15.159:0/3420773539 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3080cd410 con 0x7fc308157d50 2024-07-24T16:24:53.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.573+0000 7fc306ffd640 1 -- 172.21.15.159:0/3420773539 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc2f8039040 con 0x7fc308157d50 2024-07-24T16:24:53.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.574+0000 7fc306ffd640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fc2f4077010 0x7fc2f40794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:53.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.574+0000 7fc306ffd640 1 -- 172.21.15.159:0/3420773539 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7fc2f80b9b90 con 0x7fc308157d50 2024-07-24T16:24:53.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.574+0000 7fc30e3cd640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fc2f4077010 0x7fc2f40794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:53.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.574+0000 7fc30e3cd640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fc2f4077010 0x7fc2f40794d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc30806e610 tx=0x7fc300009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:53.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.578+0000 7fc306ffd640 1 -- 172.21.15.159:0/3420773539 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fc3080cd410 con 0x7fc308157d50 2024-07-24T16:24:53.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.831+0000 7fc310631640 1 -- 172.21.15.159:0/3420773539 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fc3081f2520 con 0x7fc308157d50 2024-07-24T16:24:53.835 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.833+0000 7fc306ffd640 1 -- 172.21.15.159:0/3420773539 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7fc2f8082f60 con 0x7fc308157d50 2024-07-24T16:24:53.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.835+0000 7fc310631640 1 -- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fc2f4077010 msgr2=0x7fc2f40794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.835+0000 7fc310631640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fc2f4077010 0x7fc2f40794d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc30806e610 tx=0x7fc300009040 comp rx=0 tx=0).stop 2024-07-24T16:24:53.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.835+0000 7fc310631640 1 -- 172.21.15.159:0/3420773539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc308157d50 msgr2=0x7fc3081f2c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.835+0000 7fc310631640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc308157d50 0x7fc3081f2c50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc2f8009cd0 tx=0x7fc2f8031760 comp rx=0 tx=0).stop 2024-07-24T16:24:53.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.835+0000 7fc310631640 1 -- 172.21.15.159:0/3420773539 shutdown_connections 2024-07-24T16:24:53.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.835+0000 7fc310631640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fc2f4077010 0x7fc2f40794d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.835+0000 7fc310631640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc308157d50 0x7fc3081f2c50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.835+0000 7fc310631640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc308070500 0x7fc308073960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.835+0000 7fc310631640 1 --2- 172.21.15.159:0/3420773539 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc30806f1c0 0x7fc3081f5b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.835+0000 7fc310631640 1 -- 172.21.15.159:0/3420773539 >> 172.21.15.159:0/3420773539 conn(0x7fc30806d450 msgr2=0x7fc3081541f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:53.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.835+0000 7fc310631640 1 -- 172.21.15.159:0/3420773539 shutdown_connections 2024-07-24T16:24:53.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.835+0000 7fc310631640 1 -- 172.21.15.159:0/3420773539 wait complete. 2024-07-24T16:24:53.848 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-07-24T16:24:53.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.951+0000 7f07154e1640 1 -- 172.21.15.159:0/1767190878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07100b41d0 msgr2=0x7f07100b3850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.951+0000 7f07154e1640 1 --2- 172.21.15.159:0/1767190878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07100b41d0 0x7f07100b3850 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0710154890 tx=0x7f06f802a440 comp rx=0 tx=0).stop 2024-07-24T16:24:53.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.951+0000 7f07154e1640 1 -- 172.21.15.159:0/1767190878 shutdown_connections 2024-07-24T16:24:53.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.951+0000 7f07154e1640 1 --2- 172.21.15.159:0/1767190878 >> v2:172.21.15.193:3300/0 conn(0x7f071006d670 0x7f071006db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.951+0000 7f07154e1640 1 --2- 172.21.15.159:0/1767190878 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07100b41d0 0x7f07100b3850 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.951+0000 7f07154e1640 1 --2- 172.21.15.159:0/1767190878 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0710150cc0 0x7f071015ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.951+0000 7f07154e1640 1 -- 172.21.15.159:0/1767190878 >> 172.21.15.159:0/1767190878 conn(0x7f071006c560 msgr2=0x7f071006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:53.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.951+0000 7f07154e1640 1 -- 172.21.15.159:0/1767190878 shutdown_connections 2024-07-24T16:24:53.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.951+0000 7f07154e1640 1 -- 172.21.15.159:0/1767190878 wait complete. 2024-07-24T16:24:53.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.953+0000 7f07154e1640 1 Processor -- start 2024-07-24T16:24:53.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.953+0000 7f07154e1640 1 -- start start 2024-07-24T16:24:53.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.953+0000 7f07154e1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f071006d670 0x7f07101f5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:53.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.953+0000 7f07154e1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07100b41d0 0x7f07101595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:53.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.953+0000 7f07154e1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0710150cc0 0x7f0710152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:53.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.953+0000 7f07154e1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0710071b80 con 0x7f07100b41d0 2024-07-24T16:24:53.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.953+0000 7f07154e1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0710071a00 con 0x7f0710150cc0 2024-07-24T16:24:53.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.953+0000 7f07154e1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0710071d00 con 0x7f071006d670 2024-07-24T16:24:53.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.953+0000 7f070e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07100b41d0 0x7f07101595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:53.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.953+0000 7f070e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07100b41d0 0x7f07101595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44322/0 (socket says 172.21.15.159:44322) 2024-07-24T16:24:53.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.953+0000 7f070e7fc640 1 -- 172.21.15.159:0/2614951595 learned_addr learned my addr 172.21.15.159:0/2614951595 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:53.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.954+0000 7f070effd640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f071006d670 0x7f07101f5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:53.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.954+0000 7f070f7fe640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0710150cc0 0x7f0710152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:53.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.954+0000 7f070e7fc640 1 -- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f071006d670 msgr2=0x7f07101f5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.954+0000 7f070e7fc640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f071006d670 0x7f07101f5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.954+0000 7f070e7fc640 1 -- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0710150cc0 msgr2=0x7f0710152770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:53.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.954+0000 7f070e7fc640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0710150cc0 0x7f0710152770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:53.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.954+0000 7f070e7fc640 1 -- 172.21.15.159:0/2614951595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f071013fbd0 con 0x7f07100b41d0 2024-07-24T16:24:53.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.954+0000 7f070e7fc640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07100b41d0 0x7f07101595c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009850 tx=0x7f06f8003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:53.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.954+0000 7f07077fe640 1 -- 172.21.15.159:0/2614951595 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f803f070 con 0x7f07100b41d0 2024-07-24T16:24:53.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.954+0000 7f07077fe640 1 -- 172.21.15.159:0/2614951595 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f06f80047a0 con 0x7f07100b41d0 2024-07-24T16:24:53.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.954+0000 7f07154e1640 1 -- 172.21.15.159:0/2614951595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f071013feb0 con 0x7f07100b41d0 2024-07-24T16:24:53.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.954+0000 7f07077fe640 1 -- 172.21.15.159:0/2614951595 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8035030 con 0x7f07100b41d0 2024-07-24T16:24:53.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.954+0000 7f07154e1640 1 -- 172.21.15.159:0/2614951595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0710140470 con 0x7f07100b41d0 2024-07-24T16:24:53.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.955+0000 7f07154e1640 1 -- 172.21.15.159:0/2614951595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0710152440 con 0x7f07100b41d0 2024-07-24T16:24:53.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.956+0000 7f07077fe640 1 -- 172.21.15.159:0/2614951595 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f06f8042070 con 0x7f07100b41d0 2024-07-24T16:24:53.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.956+0000 7f07077fe640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f06f0077010 0x7f06f00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:53.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.956+0000 7f07077fe640 1 -- 172.21.15.159:0/2614951595 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f06f80b9460 con 0x7f07100b41d0 2024-07-24T16:24:53.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.957+0000 7f070effd640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f06f0077010 0x7f06f00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:53.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.957+0000 7f070effd640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f06f0077010 0x7f06f00794d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0700005fd0 tx=0x7f07000095e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:53.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:53.960+0000 7f07077fe640 1 -- 172.21.15.159:0/2614951595 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f06f8082260 con 0x7f07100b41d0 2024-07-24T16:24:54.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.214+0000 7f07154e1640 1 -- 172.21.15.159:0/2614951595 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f071015d250 con 0x7f07100b41d0 2024-07-24T16:24:54.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.216+0000 7f07077fe640 1 -- 172.21.15.159:0/2614951595 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7f06f80867b0 con 0x7f07100b41d0 2024-07-24T16:24:54.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.218+0000 7f07154e1640 1 -- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f06f0077010 msgr2=0x7f06f00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:54.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.218+0000 7f07154e1640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f06f0077010 0x7f06f00794d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0700005fd0 tx=0x7f07000095e0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.218+0000 7f07154e1640 1 -- 172.21.15.159:0/2614951595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07100b41d0 msgr2=0x7f07101595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:54.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.218+0000 7f07154e1640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07100b41d0 0x7f07101595c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009850 tx=0x7f06f8003910 comp rx=0 tx=0).stop 2024-07-24T16:24:54.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.218+0000 7f07154e1640 1 -- 172.21.15.159:0/2614951595 shutdown_connections 2024-07-24T16:24:54.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.218+0000 7f07154e1640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f06f0077010 0x7f06f00794d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.218+0000 7f07154e1640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0710150cc0 0x7f0710152770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.218+0000 7f07154e1640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f07100b41d0 0x7f07101595c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.218+0000 7f07154e1640 1 --2- 172.21.15.159:0/2614951595 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f071006d670 0x7f07101f5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.218+0000 7f07154e1640 1 -- 172.21.15.159:0/2614951595 >> 172.21.15.159:0/2614951595 conn(0x7f071006c560 msgr2=0x7f071015a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:54.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.218+0000 7f07154e1640 1 -- 172.21.15.159:0/2614951595 shutdown_connections 2024-07-24T16:24:54.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.218+0000 7f07154e1640 1 -- 172.21.15.159:0/2614951595 wait complete. 2024-07-24T16:24:54.232 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-07-24T16:24:54.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.333+0000 7fd51fdbb640 1 -- 172.21.15.159:0/3872765714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd51806f1c0 msgr2=0x7fd51815b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:54.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.333+0000 7fd51fdbb640 1 --2- 172.21.15.159:0/3872765714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd51806f1c0 0x7fd51815b3c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd50c009830 tx=0x7fd50c02a510 comp rx=0 tx=0).stop 2024-07-24T16:24:54.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.333+0000 7fd51fdbb640 1 -- 172.21.15.159:0/3872765714 shutdown_connections 2024-07-24T16:24:54.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.333+0000 7fd51fdbb640 1 --2- 172.21.15.159:0/3872765714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd51806f1c0 0x7fd51815b3c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.333+0000 7fd51fdbb640 1 --2- 172.21.15.159:0/3872765714 >> v2:172.21.15.193:3300/0 conn(0x7fd518157d50 0x7fd5180cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.333+0000 7fd51fdbb640 1 -- 172.21.15.159:0/3872765714 >> 172.21.15.159:0/3872765714 conn(0x7fd51806d450 msgr2=0x7fd51806d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:54.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.333+0000 7fd51fdbb640 1 -- 172.21.15.159:0/3872765714 shutdown_connections 2024-07-24T16:24:54.337 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.333+0000 7fd51fdbb640 1 -- 172.21.15.159:0/3872765714 wait complete. 2024-07-24T16:24:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.334+0000 7fd51fdbb640 1 Processor -- start 2024-07-24T16:24:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.334+0000 7fd51fdbb640 1 -- start start 2024-07-24T16:24:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51fdbb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd51806f1c0 0x7fd5181560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51fdbb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd51806fdf0 0x7fd5181e59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51fdbb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd518157d50 0x7fd5181e5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51fdbb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd5180705d0 con 0x7fd518157d50 2024-07-24T16:24:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51fdbb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd518070450 con 0x7fd51806fdf0 2024-07-24T16:24:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51fdbb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd518070750 con 0x7fd51806f1c0 2024-07-24T16:24:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51e358640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd518157d50 0x7fd5181e5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51e358640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd518157d50 0x7fd5181e5f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44338/0 (socket says 172.21.15.159:44338) 2024-07-24T16:24:54.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51e358640 1 -- 172.21.15.159:0/1768690400 learned_addr learned my addr 172.21.15.159:0/1768690400 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51d356640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd51806fdf0 0x7fd5181e59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51db57640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd51806f1c0 0x7fd5181560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51e358640 1 -- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd51806f1c0 msgr2=0x7fd5181560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51e358640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd51806f1c0 0x7fd5181560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51e358640 1 -- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd51806fdf0 msgr2=0x7fd5181e59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51e358640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd51806fdf0 0x7fd5181e59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.335+0000 7fd51e358640 1 -- 172.21.15.159:0/1768690400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5181570f0 con 0x7fd518157d50 2024-07-24T16:24:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.336+0000 7fd51e358640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd518157d50 0x7fd5181e5f10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd51000e6c0 tx=0x7fd51000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.336+0000 7fd5167fc640 1 -- 172.21.15.159:0/1768690400 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd510001900 con 0x7fd518157d50 2024-07-24T16:24:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.336+0000 7fd5167fc640 1 -- 172.21.15.159:0/1768690400 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd510001b90 con 0x7fd518157d50 2024-07-24T16:24:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.336+0000 7fd51fdbb640 1 -- 172.21.15.159:0/1768690400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd518156850 con 0x7fd518157d50 2024-07-24T16:24:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.336+0000 7fd5167fc640 1 -- 172.21.15.159:0/1768690400 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5100116d0 con 0x7fd518157d50 2024-07-24T16:24:54.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.336+0000 7fd51fdbb640 1 -- 172.21.15.159:0/1768690400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd518156e10 con 0x7fd518157d50 2024-07-24T16:24:54.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.337+0000 7fd51fdbb640 1 -- 172.21.15.159:0/1768690400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5181594e0 con 0x7fd518157d50 2024-07-24T16:24:54.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.337+0000 7fd5167fc640 1 -- 172.21.15.159:0/1768690400 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fd510011870 con 0x7fd518157d50 2024-07-24T16:24:54.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.338+0000 7fd5167fc640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd504077010 0x7fd5040794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:54.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.338+0000 7fd5167fc640 1 -- 172.21.15.159:0/1768690400 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7fd51009ac30 con 0x7fd518157d50 2024-07-24T16:24:54.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.338+0000 7fd51db57640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd504077010 0x7fd5040794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:54.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.338+0000 7fd51db57640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd504077010 0x7fd5040794d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd5080099a0 tx=0x7fd508009500 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:54.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.342+0000 7fd5167fc640 1 -- 172.21.15.159:0/1768690400 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fd5181594e0 con 0x7fd518157d50 2024-07-24T16:24:54.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.598+0000 7fd51fdbb640 1 -- 172.21.15.159:0/1768690400 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7fd5180cd410 con 0x7fd518157d50 2024-07-24T16:24:54.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.600+0000 7fd5167fc640 1 -- 172.21.15.159:0/1768690400 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fd5180cd410 con 0x7fd518157d50 2024-07-24T16:24:54.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.602+0000 7fd51fdbb640 1 -- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd504077010 msgr2=0x7fd5040794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:54.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.602+0000 7fd51fdbb640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd504077010 0x7fd5040794d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd5080099a0 tx=0x7fd508009500 comp rx=0 tx=0).stop 2024-07-24T16:24:54.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.602+0000 7fd51fdbb640 1 -- 172.21.15.159:0/1768690400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd518157d50 msgr2=0x7fd5181e5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:54.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.602+0000 7fd51fdbb640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd518157d50 0x7fd5181e5f10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd51000e6c0 tx=0x7fd51000eb80 comp rx=0 tx=0).stop 2024-07-24T16:24:54.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.603+0000 7fd51fdbb640 1 -- 172.21.15.159:0/1768690400 shutdown_connections 2024-07-24T16:24:54.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.603+0000 7fd51fdbb640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fd504077010 0x7fd5040794d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.603+0000 7fd51fdbb640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd518157d50 0x7fd5181e5f10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.603+0000 7fd51fdbb640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd51806fdf0 0x7fd5181e59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.603+0000 7fd51fdbb640 1 --2- 172.21.15.159:0/1768690400 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd51806f1c0 0x7fd5181560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.603+0000 7fd51fdbb640 1 -- 172.21.15.159:0/1768690400 >> 172.21.15.159:0/1768690400 conn(0x7fd51806d450 msgr2=0x7fd5180682a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:54.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.603+0000 7fd51fdbb640 1 -- 172.21.15.159:0/1768690400 shutdown_connections 2024-07-24T16:24:54.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.603+0000 7fd51fdbb640 1 -- 172.21.15.159:0/1768690400 wait complete. 2024-07-24T16:24:54.616 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-07-24T16:24:54.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.716+0000 7f115ebc0640 1 -- 172.21.15.159:0/2598875862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1158158fe0 msgr2=0x7f115806f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:54.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.716+0000 7f115ebc0640 1 --2- 172.21.15.159:0/2598875862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1158158fe0 0x7f115806f890 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1154009830 tx=0x7f115402a480 comp rx=0 tx=0).stop 2024-07-24T16:24:54.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.716+0000 7f115ebc0640 1 -- 172.21.15.159:0/2598875862 shutdown_connections 2024-07-24T16:24:54.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.716+0000 7f115ebc0640 1 --2- 172.21.15.159:0/2598875862 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1158158fe0 0x7f115806f890 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.716+0000 7f115ebc0640 1 -- 172.21.15.159:0/2598875862 >> 172.21.15.159:0/2598875862 conn(0x7f115806c560 msgr2=0x7f115806c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:54.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.716+0000 7f115ebc0640 1 -- 172.21.15.159:0/2598875862 shutdown_connections 2024-07-24T16:24:54.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.716+0000 7f115ebc0640 1 -- 172.21.15.159:0/2598875862 wait complete. 2024-07-24T16:24:54.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.717+0000 7f115ebc0640 1 Processor -- start 2024-07-24T16:24:54.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.717+0000 7f115ebc0640 1 -- start start 2024-07-24T16:24:54.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115ebc0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f115806d670 0x7f115815d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:54.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115ebc0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11580cfa30 0x7f11580ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:54.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115ebc0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1158158fe0 0x7f11580addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:54.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115ebc0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1158159540 con 0x7f1158158fe0 2024-07-24T16:24:54.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115ebc0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f11581593c0 con 0x7f11580cfa30 2024-07-24T16:24:54.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115ebc0640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f115815c6a0 con 0x7f115806d670 2024-07-24T16:24:54.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115d15d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1158158fe0 0x7f11580addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:54.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115d15d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1158158fe0 0x7f11580addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44348/0 (socket says 172.21.15.159:44348) 2024-07-24T16:24:54.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115d15d640 1 -- 172.21.15.159:0/1540443450 learned_addr learned my addr 172.21.15.159:0/1540443450 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:54.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f114ffff640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11580cfa30 0x7f11580ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:54.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115c95c640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f115806d670 0x7f115815d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:54.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115d15d640 1 -- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f115806d670 msgr2=0x7f115815d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:54.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115d15d640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f115806d670 0x7f115815d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115d15d640 1 -- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11580cfa30 msgr2=0x7f11580ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:54.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115d15d640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11580cfa30 0x7f11580ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115d15d640 1 -- 172.21.15.159:0/1540443450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11581f74e0 con 0x7f1158158fe0 2024-07-24T16:24:54.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.718+0000 7f115d15d640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1158158fe0 0x7f11580addd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f115000c780 tx=0x7f115000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:54.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.719+0000 7f114d7fa640 1 -- 172.21.15.159:0/1540443450 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1150004b60 con 0x7f1158158fe0 2024-07-24T16:24:54.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.719+0000 7f114d7fa640 1 -- 172.21.15.159:0/1540443450 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1150004df0 con 0x7f1158158fe0 2024-07-24T16:24:54.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.719+0000 7f114d7fa640 1 -- 172.21.15.159:0/1540443450 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f115000aa70 con 0x7f1158158fe0 2024-07-24T16:24:54.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.719+0000 7f115ebc0640 1 -- 172.21.15.159:0/1540443450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11581f77c0 con 0x7f1158158fe0 2024-07-24T16:24:54.726 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.719+0000 7f115ebc0640 1 -- 172.21.15.159:0/1540443450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11581f7d80 con 0x7f1158158fe0 2024-07-24T16:24:54.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.720+0000 7f115ebc0640 1 -- 172.21.15.159:0/1540443450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f115806f890 con 0x7f1158158fe0 2024-07-24T16:24:54.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.720+0000 7f114d7fa640 1 -- 172.21.15.159:0/1540443450 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f115000ac10 con 0x7f1158158fe0 2024-07-24T16:24:54.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.721+0000 7f114d7fa640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1144077010 0x7f11440794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:54.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.721+0000 7f114d7fa640 1 -- 172.21.15.159:0/1540443450 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f1150098890 con 0x7f1158158fe0 2024-07-24T16:24:54.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.721+0000 7f115c95c640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1144077010 0x7f11440794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:54.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.721+0000 7f115c95c640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1144077010 0x7f11440794d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1154034000 tx=0x7f1154004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:54.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.725+0000 7f114d7fa640 1 -- 172.21.15.159:0/1540443450 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f1150020070 con 0x7f1158158fe0 2024-07-24T16:24:54.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.912+0000 7f115ebc0640 1 -- 172.21.15.159:0/1540443450 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f115806c9e0 con 0x7f1158158fe0 2024-07-24T16:24:54.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.913+0000 7f114d7fa640 1 -- 172.21.15.159:0/1540443450 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v32) ==== 84+0+65 (secure 0 0 0) 0x7f1150061720 con 0x7f1158158fe0 2024-07-24T16:24:54.915 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:54.915 INFO:teuthology.orchestra.run.smithi159.stdout:[ 2024-07-24T16:24:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:24:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: "poolnum": 1, 2024-07-24T16:24:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: "poolname": ".mgr" 2024-07-24T16:24:54.916 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:24:54.916 INFO:teuthology.orchestra.run.smithi159.stdout:] 2024-07-24T16:24:54.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.915+0000 7f115ebc0640 1 -- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1144077010 msgr2=0x7f11440794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:54.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.915+0000 7f115ebc0640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1144077010 0x7f11440794d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f1154034000 tx=0x7f1154004730 comp rx=0 tx=0).stop 2024-07-24T16:24:54.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.915+0000 7f115ebc0640 1 -- 172.21.15.159:0/1540443450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1158158fe0 msgr2=0x7f11580addd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:54.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.915+0000 7f115ebc0640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1158158fe0 0x7f11580addd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f115000c780 tx=0x7f115000cc40 comp rx=0 tx=0).stop 2024-07-24T16:24:54.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.915+0000 7f115ebc0640 1 -- 172.21.15.159:0/1540443450 shutdown_connections 2024-07-24T16:24:54.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.915+0000 7f115ebc0640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1144077010 0x7f11440794d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.915+0000 7f115ebc0640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1158158fe0 0x7f11580addd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.915+0000 7f115ebc0640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f11580cfa30 0x7f11580ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.915+0000 7f115ebc0640 1 --2- 172.21.15.159:0/1540443450 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f115806d670 0x7f115815d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:54.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.915+0000 7f115ebc0640 1 -- 172.21.15.159:0/1540443450 >> 172.21.15.159:0/1540443450 conn(0x7f115806c560 msgr2=0x7f1158158230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:54.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.915+0000 7f115ebc0640 1 -- 172.21.15.159:0/1540443450 shutdown_connections 2024-07-24T16:24:54.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:54.915+0000 7f115ebc0640 1 -- 172.21.15.159:0/1540443450 wait complete. 2024-07-24T16:24:54.929 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-07-24T16:24:54.929 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-07-24T16:24:55.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.034+0000 7f5255ccb640 1 -- 172.21.15.159:0/1395274070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525015b310 msgr2=0x7f52500b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:55.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.034+0000 7f5255ccb640 1 --2- 172.21.15.159:0/1395274070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525015b310 0x7f52500b0cf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f52500cec20 tx=0x7f524002aa30 comp rx=0 tx=0).stop 2024-07-24T16:24:55.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.034+0000 7f5255ccb640 1 -- 172.21.15.159:0/1395274070 shutdown_connections 2024-07-24T16:24:55.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.034+0000 7f5255ccb640 1 --2- 172.21.15.159:0/1395274070 >> v2:172.21.15.193:3300/0 conn(0x7f52500b07a0 0x7f525006fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:55.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.034+0000 7f5255ccb640 1 --2- 172.21.15.159:0/1395274070 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525015b310 0x7f52500b0cf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:55.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.034+0000 7f5255ccb640 1 -- 172.21.15.159:0/1395274070 >> 172.21.15.159:0/1395274070 conn(0x7f5250073c80 msgr2=0x7f5250074090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:55.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.034+0000 7f5255ccb640 1 -- 172.21.15.159:0/1395274070 shutdown_connections 2024-07-24T16:24:55.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.034+0000 7f5255ccb640 1 -- 172.21.15.159:0/1395274070 wait complete. 2024-07-24T16:24:55.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.035+0000 7f5255ccb640 1 Processor -- start 2024-07-24T16:24:55.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.035+0000 7f5255ccb640 1 -- start start 2024-07-24T16:24:55.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f5255ccb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52500b07a0 0x7f52500c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:55.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f5255ccb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f525015b310 0x7f5250149780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:55.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f5255ccb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525015b6f0 0x7f52501f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:55.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f5255ccb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f52500cf540 con 0x7f525015b6f0 2024-07-24T16:24:55.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f5255ccb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f52500cf3c0 con 0x7f52500b07a0 2024-07-24T16:24:55.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f5255ccb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f52500cf6c0 con 0x7f525015b310 2024-07-24T16:24:55.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f524ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525015b6f0 0x7f52501f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:55.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f524ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525015b6f0 0x7f52501f55f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44362/0 (socket says 172.21.15.159:44362) 2024-07-24T16:24:55.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f524ffff640 1 -- 172.21.15.159:0/1506491361 learned_addr learned my addr 172.21.15.159:0/1506491361 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:55.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f524f7fe640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52500b07a0 0x7f52500c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:55.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f524effd640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f525015b310 0x7f5250149780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:55.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f524ffff640 1 -- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f525015b310 msgr2=0x7f5250149780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:55.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f524ffff640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f525015b310 0x7f5250149780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:55.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f524ffff640 1 -- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52500b07a0 msgr2=0x7f52500c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:55.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f524ffff640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52500b07a0 0x7f52500c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:55.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f524ffff640 1 -- 172.21.15.159:0/1506491361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52500ac100 con 0x7f525015b6f0 2024-07-24T16:24:55.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f524effd640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f525015b310 0x7f5250149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:55.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f524f7fe640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52500b07a0 0x7f52500c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:55.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f524ffff640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525015b6f0 0x7f52501f55f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f524800b450 tx=0x7f524800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:55.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.036+0000 7f5237fff640 1 -- 172.21.15.159:0/1506491361 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248015020 con 0x7f525015b6f0 2024-07-24T16:24:55.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.037+0000 7f5237fff640 1 -- 172.21.15.159:0/1506491361 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5248011980 con 0x7f525015b6f0 2024-07-24T16:24:55.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.037+0000 7f5255ccb640 1 -- 172.21.15.159:0/1506491361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52500ac370 con 0x7f525015b6f0 2024-07-24T16:24:55.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.037+0000 7f5237fff640 1 -- 172.21.15.159:0/1506491361 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248011db0 con 0x7f525015b6f0 2024-07-24T16:24:55.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.037+0000 7f5255ccb640 1 -- 172.21.15.159:0/1506491361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5250149cc0 con 0x7f525015b6f0 2024-07-24T16:24:55.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.037+0000 7f5255ccb640 1 -- 172.21.15.159:0/1506491361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52500cfc60 con 0x7f525015b6f0 2024-07-24T16:24:55.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.038+0000 7f5237fff640 1 -- 172.21.15.159:0/1506491361 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f5248018020 con 0x7f525015b6f0 2024-07-24T16:24:55.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.039+0000 7f5237fff640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f523c077010 0x7f523c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:55.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.039+0000 7f5237fff640 1 -- 172.21.15.159:0/1506491361 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5249+0+0 (secure 0 0 0) 0x7f52480988f0 con 0x7f525015b6f0 2024-07-24T16:24:55.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.039+0000 7f524f7fe640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f523c077010 0x7f523c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:55.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.039+0000 7f524f7fe640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f523c077010 0x7f523c0794d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5240035000 tx=0x7f5240004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:55.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.043+0000 7f5237fff640 1 -- 172.21.15.159:0/1506491361 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f524801f020 con 0x7f525015b6f0 2024-07-24T16:24:55.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:55.226+0000 7f5255ccb640 1 -- 172.21.15.159:0/1506491361 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f52500d11a0 con 0x7f525015b6f0 2024-07-24T16:24:56.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.220+0000 7f5237fff640 1 -- 172.21.15.159:0/1506491361 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v33) ==== 138+0+0 (secure 0 0 0) 0x7f524800d040 con 0x7f525015b6f0 2024-07-24T16:24:56.222 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_metadata' created 2024-07-24T16:24:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.223+0000 7f5255ccb640 1 -- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f523c077010 msgr2=0x7f523c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.223+0000 7f5255ccb640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f523c077010 0x7f523c0794d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5240035000 tx=0x7f5240004ab0 comp rx=0 tx=0).stop 2024-07-24T16:24:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.223+0000 7f5255ccb640 1 -- 172.21.15.159:0/1506491361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525015b6f0 msgr2=0x7f52501f55f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.223+0000 7f5255ccb640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525015b6f0 0x7f52501f55f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f524800b450 tx=0x7f524800b910 comp rx=0 tx=0).stop 2024-07-24T16:24:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.223+0000 7f5255ccb640 1 -- 172.21.15.159:0/1506491361 shutdown_connections 2024-07-24T16:24:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.223+0000 7f5255ccb640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f523c077010 0x7f523c0794d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:56.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.223+0000 7f5255ccb640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f525015b6f0 0x7f52501f55f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:56.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.223+0000 7f5255ccb640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f525015b310 0x7f5250149780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:56.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.223+0000 7f5255ccb640 1 --2- 172.21.15.159:0/1506491361 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f52500b07a0 0x7f52500c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:56.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.223+0000 7f5255ccb640 1 -- 172.21.15.159:0/1506491361 >> 172.21.15.159:0/1506491361 conn(0x7f5250073c80 msgr2=0x7f5250074060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:56.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.224+0000 7f5255ccb640 1 -- 172.21.15.159:0/1506491361 shutdown_connections 2024-07-24T16:24:56.227 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.224+0000 7f5255ccb640 1 -- 172.21.15.159:0/1506491361 wait complete. 2024-07-24T16:24:56.243 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-07-24T16:24:56.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.358+0000 7f80e0665640 1 -- 172.21.15.159:0/2059999259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80c4004020 msgr2=0x7f80c4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:56.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.358+0000 7f80e0665640 1 --2- 172.21.15.159:0/2059999259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80c4004020 0x7f80c4004800 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f80c8009b50 tx=0x7f80c4005830 comp rx=0 tx=0).stop 2024-07-24T16:24:56.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.358+0000 7f80dec02640 1 -- 172.21.15.159:0/2059999259 reap_dead start 2024-07-24T16:24:56.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.358+0000 7f80e0665640 1 -- 172.21.15.159:0/2059999259 shutdown_connections 2024-07-24T16:24:56.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.358+0000 7f80e0665640 1 -- 172.21.15.159:0/2059999259 >> 172.21.15.159:0/2059999259 conn(0x7f80d806d450 msgr2=0x7f80d806d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:56.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.358+0000 7f80e0665640 1 -- 172.21.15.159:0/2059999259 shutdown_connections 2024-07-24T16:24:56.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.358+0000 7f80e0665640 1 -- 172.21.15.159:0/2059999259 wait complete. 2024-07-24T16:24:56.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.359+0000 7f80e0665640 1 Processor -- start 2024-07-24T16:24:56.362 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.359+0000 7f80e0665640 1 -- start start 2024-07-24T16:24:56.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80e0665640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80c4004020 0x7f80d814ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:56.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80e0665640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80d80738b0 0x7f80d80ab360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:56.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80e0665640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d8073d30 0x7f80d80ab8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:56.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80e0665640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f80d815b750 con 0x7f80d8073d30 2024-07-24T16:24:56.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80e0665640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f80d815b5d0 con 0x7f80d80738b0 2024-07-24T16:24:56.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80e0665640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f80d815b8d0 con 0x7f80c4004020 2024-07-24T16:24:56.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80dec02640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d8073d30 0x7f80d80ab8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:56.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80dec02640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d8073d30 0x7f80d80ab8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44370/0 (socket says 172.21.15.159:44370) 2024-07-24T16:24:56.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80dec02640 1 -- 172.21.15.159:0/1135991891 learned_addr learned my addr 172.21.15.159:0/1135991891 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:56.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80ddc00640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80d80738b0 0x7f80d80ab360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:56.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80de401640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80c4004020 0x7f80d814ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:56.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80dec02640 1 -- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80c4004020 msgr2=0x7f80d814ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:56.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80dec02640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80c4004020 0x7f80d814ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:56.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80dec02640 1 -- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80d80738b0 msgr2=0x7f80d80ab360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:56.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80dec02640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80d80738b0 0x7f80d80ab360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:56.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80dec02640 1 -- 172.21.15.159:0/1135991891 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d814efb0 con 0x7f80d8073d30 2024-07-24T16:24:56.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.360+0000 7f80dec02640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d8073d30 0x7f80d80ab8a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f80d0001f60 tx=0x7f80d000ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:56.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.361+0000 7f80ceffd640 1 -- 172.21.15.159:0/1135991891 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d000cba0 con 0x7f80d8073d30 2024-07-24T16:24:56.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.361+0000 7f80ceffd640 1 -- 172.21.15.159:0/1135991891 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80d0018070 con 0x7f80d8073d30 2024-07-24T16:24:56.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.361+0000 7f80e0665640 1 -- 172.21.15.159:0/1135991891 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80d8072560 con 0x7f80d8073d30 2024-07-24T16:24:56.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.361+0000 7f80ceffd640 1 -- 172.21.15.159:0/1135991891 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d00116c0 con 0x7f80d8073d30 2024-07-24T16:24:56.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.361+0000 7f80e0665640 1 -- 172.21.15.159:0/1135991891 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80d8072b20 con 0x7f80d8073d30 2024-07-24T16:24:56.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.362+0000 7f80e0665640 1 -- 172.21.15.159:0/1135991891 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80d80cd130 con 0x7f80d8073d30 2024-07-24T16:24:56.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.362+0000 7f80ceffd640 1 -- 172.21.15.159:0/1135991891 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f80d0011860 con 0x7f80d8073d30 2024-07-24T16:24:56.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.363+0000 7f80ceffd640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f80bc077040 0x7f80bc079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:56.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.363+0000 7f80ceffd640 1 -- 172.21.15.159:0/1135991891 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5619+0+0 (secure 0 0 0) 0x7f80d0098cb0 con 0x7f80d8073d30 2024-07-24T16:24:56.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.363+0000 7f80de401640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f80bc077040 0x7f80bc079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:56.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.364+0000 7f80de401640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f80bc077040 0x7f80bc079500 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009b10 tx=0x7f80d4005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:56.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.367+0000 7f80ceffd640 1 -- 172.21.15.159:0/1135991891 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f80d80cd130 con 0x7f80d8073d30 2024-07-24T16:24:56.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:56.551+0000 7f80e0665640 1 -- 172.21.15.159:0/1135991891 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f80d8070650 con 0x7f80d8073d30 2024-07-24T16:24:57.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.227+0000 7f80ceffd640 1 -- 172.21.15.159:0/1135991891 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v34) ==== 170+0+0 (secure 0 0 0) 0x7f80d0061f90 con 0x7f80d8073d30 2024-07-24T16:24:57.230 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_data' created 2024-07-24T16:24:57.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.230+0000 7f80e0665640 1 -- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f80bc077040 msgr2=0x7f80bc079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:57.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.230+0000 7f80e0665640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f80bc077040 0x7f80bc079500 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f80d4009b10 tx=0x7f80d4005f90 comp rx=0 tx=0).stop 2024-07-24T16:24:57.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.230+0000 7f80e0665640 1 -- 172.21.15.159:0/1135991891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d8073d30 msgr2=0x7f80d80ab8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:57.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.230+0000 7f80e0665640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d8073d30 0x7f80d80ab8a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f80d0001f60 tx=0x7f80d000ec60 comp rx=0 tx=0).stop 2024-07-24T16:24:57.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.230+0000 7f80e0665640 1 -- 172.21.15.159:0/1135991891 shutdown_connections 2024-07-24T16:24:57.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.230+0000 7f80e0665640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f80bc077040 0x7f80bc079500 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:57.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.230+0000 7f80e0665640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f80d8073d30 0x7f80d80ab8a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:57.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.230+0000 7f80e0665640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80d80738b0 0x7f80d80ab360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:57.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.230+0000 7f80e0665640 1 --2- 172.21.15.159:0/1135991891 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f80c4004020 0x7f80d814ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:57.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.230+0000 7f80e0665640 1 -- 172.21.15.159:0/1135991891 >> 172.21.15.159:0/1135991891 conn(0x7f80d806d450 msgr2=0x7f80d80aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:57.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.230+0000 7f80e0665640 1 -- 172.21.15.159:0/1135991891 shutdown_connections 2024-07-24T16:24:57.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.231+0000 7f80e0665640 1 -- 172.21.15.159:0/1135991891 wait complete. 2024-07-24T16:24:57.259 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-07-24T16:24:57.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.368+0000 7f81ae339640 1 -- 172.21.15.159:0/2532146678 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81a815d950 msgr2=0x7f81a8161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:57.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.368+0000 7f81ae339640 1 --2- 172.21.15.159:0/2532146678 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81a815d950 0x7f81a8161f20 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8198005fd0 tx=0x7f819802a670 comp rx=0 tx=0).stop 2024-07-24T16:24:57.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.368+0000 7f81ae339640 1 -- 172.21.15.159:0/2532146678 shutdown_connections 2024-07-24T16:24:57.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.368+0000 7f81ae339640 1 --2- 172.21.15.159:0/2532146678 >> v2:172.21.15.193:3300/0 conn(0x7f81a80cf770 0x7f81a80cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:57.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.368+0000 7f81ae339640 1 --2- 172.21.15.159:0/2532146678 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81a815d950 0x7f81a8161f20 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:57.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.368+0000 7f81ae339640 1 -- 172.21.15.159:0/2532146678 >> 172.21.15.159:0/2532146678 conn(0x7f81a809cd30 msgr2=0x7f81a80d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:57.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.368+0000 7f81ae339640 1 -- 172.21.15.159:0/2532146678 shutdown_connections 2024-07-24T16:24:57.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.368+0000 7f81ae339640 1 -- 172.21.15.159:0/2532146678 wait complete. 2024-07-24T16:24:57.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.369+0000 7f81ae339640 1 Processor -- start 2024-07-24T16:24:57.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.369+0000 7f81ae339640 1 -- start start 2024-07-24T16:24:57.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81ae339640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81a80b2ae0 0x7f81a81f3be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:57.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81ae339640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81a80cf770 0x7f81a80b8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:57.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81ae339640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81a815d950 0x7f81a80b8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:57.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81ae339640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f81a80d0460 con 0x7f81a80b2ae0 2024-07-24T16:24:57.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81ae339640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f81a80d02e0 con 0x7f81a815d950 2024-07-24T16:24:57.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81ae339640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f81a80d05e0 con 0x7f81a80cf770 2024-07-24T16:24:57.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81a7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81a80b2ae0 0x7f81a81f3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:57.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81a7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81a80b2ae0 0x7f81a81f3be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44372/0 (socket says 172.21.15.159:44372) 2024-07-24T16:24:57.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81a7fff640 1 -- 172.21.15.159:0/2498843143 learned_addr learned my addr 172.21.15.159:0/2498843143 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:57.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81a77fe640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81a80cf770 0x7f81a80b8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:57.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81ac8d6640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81a815d950 0x7f81a80b8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:57.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81a7fff640 1 -- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81a80cf770 msgr2=0x7f81a80b8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:57.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81a7fff640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81a80cf770 0x7f81a80b8700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:57.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81a7fff640 1 -- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81a815d950 msgr2=0x7f81a80b8d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:57.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81a7fff640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81a815d950 0x7f81a80b8d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:57.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81a7fff640 1 -- 172.21.15.159:0/2498843143 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81a814d540 con 0x7f81a80b2ae0 2024-07-24T16:24:57.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81ac8d6640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81a815d950 0x7f81a80b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:57.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.370+0000 7f81a7fff640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81a80b2ae0 0x7f81a81f3be0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8198034040 tx=0x7f81980038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:57.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.371+0000 7f81a4ff9640 1 -- 172.21.15.159:0/2498843143 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f819803e030 con 0x7f81a80b2ae0 2024-07-24T16:24:57.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.371+0000 7f81a4ff9640 1 -- 172.21.15.159:0/2498843143 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8198003db0 con 0x7f81a80b2ae0 2024-07-24T16:24:57.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.371+0000 7f81ae339640 1 -- 172.21.15.159:0/2498843143 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81a814d820 con 0x7f81a80b2ae0 2024-07-24T16:24:57.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.371+0000 7f81a4ff9640 1 -- 172.21.15.159:0/2498843143 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8198035040 con 0x7f81a80b2ae0 2024-07-24T16:24:57.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.371+0000 7f81ae339640 1 -- 172.21.15.159:0/2498843143 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81a80b7ab0 con 0x7f81a80b2ae0 2024-07-24T16:24:57.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.372+0000 7f81ae339640 1 -- 172.21.15.159:0/2498843143 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81a80d0a90 con 0x7f81a80b2ae0 2024-07-24T16:24:57.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.372+0000 7f81a4ff9640 1 -- 172.21.15.159:0/2498843143 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f8198041030 con 0x7f81a80b2ae0 2024-07-24T16:24:57.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.373+0000 7f81a4ff9640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8194077010 0x7f81940794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:57.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.373+0000 7f81a4ff9640 1 -- 172.21.15.159:0/2498843143 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 6001+0+0 (secure 0 0 0) 0x7f81980b8f80 con 0x7f81a80b2ae0 2024-07-24T16:24:57.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.373+0000 7f81a77fe640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8194077010 0x7f81940794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:57.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.374+0000 7f81a77fe640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8194077010 0x7f81940794d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f81a806d020 tx=0x7f819c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:57.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.377+0000 7f81a4ff9640 1 -- 172.21.15.159:0/2498843143 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f8198082170 con 0x7f81a80b2ae0 2024-07-24T16:24:57.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:57.600+0000 7f81ae339640 1 -- 172.21.15.159:0/2498843143 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f81a815d110 con 0x7f81a80b2ae0 2024-07-24T16:24:58.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.228+0000 7f81a4ff9640 1 -- 172.21.15.159:0/2498843143 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) ==== 172+0+0 (secure 0 0 0) 0x7f8198081a70 con 0x7f81a80b2ae0 2024-07-24T16:24:58.231 INFO:teuthology.orchestra.run.smithi159.stderr:new fs with metadata pool 5 and data pool 6 2024-07-24T16:24:58.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.234+0000 7f81ae339640 1 -- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8194077010 msgr2=0x7f81940794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:58.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.234+0000 7f81ae339640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8194077010 0x7f81940794d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f81a806d020 tx=0x7f819c009040 comp rx=0 tx=0).stop 2024-07-24T16:24:58.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.234+0000 7f81ae339640 1 -- 172.21.15.159:0/2498843143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81a80b2ae0 msgr2=0x7f81a81f3be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:58.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.234+0000 7f81ae339640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81a80b2ae0 0x7f81a81f3be0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8198034040 tx=0x7f81980038a0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.234+0000 7f81ae339640 1 -- 172.21.15.159:0/2498843143 shutdown_connections 2024-07-24T16:24:58.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.234+0000 7f81ae339640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f8194077010 0x7f81940794d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.234+0000 7f81ae339640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f81a815d950 0x7f81a80b8d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.234+0000 7f81ae339640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f81a80cf770 0x7f81a80b8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.234+0000 7f81ae339640 1 --2- 172.21.15.159:0/2498843143 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f81a80b2ae0 0x7f81a81f3be0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.234+0000 7f81ae339640 1 -- 172.21.15.159:0/2498843143 >> 172.21.15.159:0/2498843143 conn(0x7f81a809cd30 msgr2=0x7f81a8161bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:58.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.235+0000 7f81ae339640 1 -- 172.21.15.159:0/2498843143 shutdown_connections 2024-07-24T16:24:58.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.235+0000 7f81ae339640 1 -- 172.21.15.159:0/2498843143 wait complete. 2024-07-24T16:24:58.267 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:58.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.369+0000 7f17bf21d640 1 -- 172.21.15.159:0/394159745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b809af50 msgr2=0x7f17b815f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:58.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.369+0000 7f17bf21d640 1 --2- 172.21.15.159:0/394159745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b809af50 0x7f17b815f290 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f17a8005fd0 tx=0x7f17a802a940 comp rx=0 tx=0).stop 2024-07-24T16:24:58.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.370+0000 7f17bf21d640 1 -- 172.21.15.159:0/394159745 shutdown_connections 2024-07-24T16:24:58.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.370+0000 7f17bf21d640 1 --2- 172.21.15.159:0/394159745 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17b815b8b0 0x7f17b815f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.370+0000 7f17bf21d640 1 --2- 172.21.15.159:0/394159745 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b809af50 0x7f17b815f290 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.370+0000 7f17bf21d640 1 -- 172.21.15.159:0/394159745 >> 172.21.15.159:0/394159745 conn(0x7f17b809aa20 msgr2=0x7f17b80d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:58.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.370+0000 7f17bf21d640 1 -- 172.21.15.159:0/394159745 shutdown_connections 2024-07-24T16:24:58.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.370+0000 7f17bf21d640 1 -- 172.21.15.159:0/394159745 wait complete. 2024-07-24T16:24:58.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.371+0000 7f17bf21d640 1 Processor -- start 2024-07-24T16:24:58.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.371+0000 7f17bf21d640 1 -- start start 2024-07-24T16:24:58.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bf21d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b809af50 0x7f17b80b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:58.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bf21d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b815b4d0 0x7f17b815da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:58.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bf21d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17b815b8b0 0x7f17b81f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bf21d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f17b80aef00 con 0x7f17b809af50 2024-07-24T16:24:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bf21d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f17b80aed80 con 0x7f17b815b4d0 2024-07-24T16:24:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bf21d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f17b80af080 con 0x7f17b815b8b0 2024-07-24T16:24:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bcfb9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b809af50 0x7f17b80b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bcfb9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b809af50 0x7f17b80b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44386/0 (socket says 172.21.15.159:44386) 2024-07-24T16:24:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bcfb9640 1 -- 172.21.15.159:0/3304038095 learned_addr learned my addr 172.21.15.159:0/3304038095 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17b7fff640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b815b4d0 0x7f17b815da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bd7ba640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17b815b8b0 0x7f17b81f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bcfb9640 1 -- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17b815b8b0 msgr2=0x7f17b81f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bcfb9640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17b815b8b0 0x7f17b81f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bcfb9640 1 -- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b815b4d0 msgr2=0x7f17b815da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bcfb9640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b815b4d0 0x7f17b815da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bcfb9640 1 -- 172.21.15.159:0/3304038095 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b81f5bb0 con 0x7f17b809af50 2024-07-24T16:24:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17bcfb9640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b809af50 0x7f17b80b5ce0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f17b000c450 tx=0x7f17b000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.372+0000 7f17b57fa640 1 -- 172.21.15.159:0/3304038095 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b00052d0 con 0x7f17b809af50 2024-07-24T16:24:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.373+0000 7f17b57fa640 1 -- 172.21.15.159:0/3304038095 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17b0005470 con 0x7f17b809af50 2024-07-24T16:24:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.373+0000 7f17bf21d640 1 -- 172.21.15.159:0/3304038095 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b81f5e90 con 0x7f17b809af50 2024-07-24T16:24:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.373+0000 7f17b57fa640 1 -- 172.21.15.159:0/3304038095 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b0012870 con 0x7f17b809af50 2024-07-24T16:24:58.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.373+0000 7f17bf21d640 1 -- 172.21.15.159:0/3304038095 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b81f6970 con 0x7f17b809af50 2024-07-24T16:24:58.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.374+0000 7f17bf21d640 1 -- 172.21.15.159:0/3304038095 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b80af530 con 0x7f17b809af50 2024-07-24T16:24:58.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.374+0000 7f17b57fa640 1 -- 172.21.15.159:0/3304038095 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f17b0012a10 con 0x7f17b809af50 2024-07-24T16:24:58.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.375+0000 7f17b57fa640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1798077010 0x7f17980794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:58.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.375+0000 7f17b57fa640 1 -- 172.21.15.159:0/3304038095 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6101+0+0 (secure 0 0 0) 0x7f17b0098420 con 0x7f17b809af50 2024-07-24T16:24:58.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.375+0000 7f17b7fff640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1798077010 0x7f17980794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:58.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.376+0000 7f17b7fff640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1798077010 0x7f17980794d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f17a8034000 tx=0x7f17a8004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:58.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.379+0000 7f17b57fa640 1 -- 172.21.15.159:0/3304038095 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f17b0060f60 con 0x7f17b809af50 2024-07-24T16:24:58.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.564+0000 7f17bf21d640 1 -- 172.21.15.159:0/3304038095 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17b80cd450 con 0x7f17b809af50 2024-07-24T16:24:58.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.565+0000 7f17b57fa640 1 -- 172.21.15.159:0/3304038095 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16991 (secure 0 0 0) 0x7f17b00654b0 con 0x7f17b809af50 2024-07-24T16:24:58.567 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:58.568 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":35,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:57.601538+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:55.230299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:56.555270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:58.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.567+0000 7f17bf21d640 1 -- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1798077010 msgr2=0x7f17980794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:58.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.567+0000 7f17bf21d640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1798077010 0x7f17980794d0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f17a8034000 tx=0x7f17a8004ab0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.567+0000 7f17bf21d640 1 -- 172.21.15.159:0/3304038095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b809af50 msgr2=0x7f17b80b5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:58.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.567+0000 7f17bf21d640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b809af50 0x7f17b80b5ce0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f17b000c450 tx=0x7f17b000c910 comp rx=0 tx=0).stop 2024-07-24T16:24:58.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.567+0000 7f17bf21d640 1 -- 172.21.15.159:0/3304038095 shutdown_connections 2024-07-24T16:24:58.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.567+0000 7f17bf21d640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f1798077010 0x7f17980794d0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.567+0000 7f17bf21d640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17b815b8b0 0x7f17b81f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.567+0000 7f17bf21d640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17b815b4d0 0x7f17b815da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.567+0000 7f17bf21d640 1 --2- 172.21.15.159:0/3304038095 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17b809af50 0x7f17b80b5ce0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.567+0000 7f17bf21d640 1 -- 172.21.15.159:0/3304038095 >> 172.21.15.159:0/3304038095 conn(0x7f17b809aa20 msgr2=0x7f17b80cc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:58.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.567+0000 7f17bf21d640 1 -- 172.21.15.159:0/3304038095 shutdown_connections 2024-07-24T16:24:58.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.567+0000 7f17bf21d640 1 -- 172.21.15.159:0/3304038095 wait complete. 2024-07-24T16:24:58.581 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:24:58.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.681+0000 7f31c3406640 1 -- 172.21.15.159:0/630944205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc0cfb50 msgr2=0x7f31bc0cba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:58.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.681+0000 7f31c3406640 1 --2- 172.21.15.159:0/630944205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc0cfb50 0x7f31bc0cba40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f31bc073da0 tx=0x7f31b402aa30 comp rx=0 tx=0).stop 2024-07-24T16:24:58.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.682+0000 7f31c3406640 1 -- 172.21.15.159:0/630944205 shutdown_connections 2024-07-24T16:24:58.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.682+0000 7f31c3406640 1 --2- 172.21.15.159:0/630944205 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc0cfb50 0x7f31bc0cba40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.682+0000 7f31c3406640 1 --2- 172.21.15.159:0/630944205 >> v2:172.21.15.193:3300/0 conn(0x7f31bc06dba0 0x7f31bc0cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.682+0000 7f31c3406640 1 --2- 172.21.15.159:0/630944205 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f31bc0cf770 0x7f31bc15b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.682+0000 7f31c3406640 1 -- 172.21.15.159:0/630944205 >> 172.21.15.159:0/630944205 conn(0x7f31bc06c560 msgr2=0x7f31bc06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:58.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.682+0000 7f31c3406640 1 -- 172.21.15.159:0/630944205 shutdown_connections 2024-07-24T16:24:58.685 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.682+0000 7f31c3406640 1 -- 172.21.15.159:0/630944205 wait complete. 2024-07-24T16:24:58.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.683+0000 7f31c3406640 1 Processor -- start 2024-07-24T16:24:58.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.683+0000 7f31c3406640 1 -- start start 2024-07-24T16:24:58.687 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c3406640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31bc06dba0 0x7f31bc1f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:58.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c3406640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f31bc0cf770 0x7f31bc0ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:58.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c3406640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc0cfb50 0x7f31bc0addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:58.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c3406640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f31bc0ae860 con 0x7f31bc0cfb50 2024-07-24T16:24:58.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c3406640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f31bc0ae6e0 con 0x7f31bc06dba0 2024-07-24T16:24:58.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c3406640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f31bc0ae9e0 con 0x7f31bc0cf770 2024-07-24T16:24:58.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c19a3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc0cfb50 0x7f31bc0addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:58.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c19a3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc0cfb50 0x7f31bc0addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44402/0 (socket says 172.21.15.159:44402) 2024-07-24T16:24:58.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c19a3640 1 -- 172.21.15.159:0/3233393543 learned_addr learned my addr 172.21.15.159:0/3233393543 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:58.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c09a1640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f31bc0cf770 0x7f31bc0ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:58.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c11a2640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31bc06dba0 0x7f31bc1f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:58.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c19a3640 1 -- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f31bc0cf770 msgr2=0x7f31bc0ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:58.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c19a3640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f31bc0cf770 0x7f31bc0ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.688 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c19a3640 1 -- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31bc06dba0 msgr2=0x7f31bc1f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:58.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c19a3640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31bc06dba0 0x7f31bc1f3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c19a3640 1 -- 172.21.15.159:0/3233393543 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31bc1529a0 con 0x7f31bc0cfb50 2024-07-24T16:24:58.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c11a2640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31bc06dba0 0x7f31bc1f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:24:58.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c19a3640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc0cfb50 0x7f31bc0addd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f31b402b020 tx=0x7f31b4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:58.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31b1ffb640 1 -- 172.21.15.159:0/3233393543 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b4033050 con 0x7f31bc0cfb50 2024-07-24T16:24:58.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31b1ffb640 1 -- 172.21.15.159:0/3233393543 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f31b4004450 con 0x7f31bc0cfb50 2024-07-24T16:24:58.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31c3406640 1 -- 172.21.15.159:0/3233393543 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31bc14ea80 con 0x7f31bc0cfb50 2024-07-24T16:24:58.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.684+0000 7f31b1ffb640 1 -- 172.21.15.159:0/3233393543 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31b4004860 con 0x7f31bc0cfb50 2024-07-24T16:24:58.689 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.685+0000 7f31c3406640 1 -- 172.21.15.159:0/3233393543 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31bc1f3990 con 0x7f31bc0cfb50 2024-07-24T16:24:58.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.685+0000 7f31c3406640 1 -- 172.21.15.159:0/3233393543 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31bc14e870 con 0x7f31bc0cfb50 2024-07-24T16:24:58.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.686+0000 7f31b1ffb640 1 -- 172.21.15.159:0/3233393543 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f31b4036070 con 0x7f31bc0cfb50 2024-07-24T16:24:58.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.686+0000 7f31b1ffb640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f31a0077010 0x7f31a00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:58.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.687+0000 7f31b1ffb640 1 -- 172.21.15.159:0/3233393543 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6101+0+0 (secure 0 0 0) 0x7f31b40b9c90 con 0x7f31bc0cfb50 2024-07-24T16:24:58.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.687+0000 7f31c11a2640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f31a0077010 0x7f31a00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:58.691 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.687+0000 7f31c11a2640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f31a0077010 0x7f31a00794d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f31b8005fd0 tx=0x7f31b8005cf0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:58.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.691+0000 7f31b1ffb640 1 -- 172.21.15.159:0/3233393543 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f31b4082e20 con 0x7f31bc0cfb50 2024-07-24T16:24:58.877 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.875+0000 7f31c3406640 1 -- 172.21.15.159:0/3233393543 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31bc0aef00 con 0x7f31bc0cfb50 2024-07-24T16:24:58.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.876+0000 7f31b1ffb640 1 -- 172.21.15.159:0/3233393543 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16991 (secure 0 0 0) 0x7f31b4082720 con 0x7f31bc0cfb50 2024-07-24T16:24:58.879 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:24:58.879 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":35,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:57.601538+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:55.230299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:56.555270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:24:58.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.878+0000 7f31c3406640 1 -- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f31a0077010 msgr2=0x7f31a00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:58.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.878+0000 7f31c3406640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f31a0077010 0x7f31a00794d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f31b8005fd0 tx=0x7f31b8005cf0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.878+0000 7f31c3406640 1 -- 172.21.15.159:0/3233393543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc0cfb50 msgr2=0x7f31bc0addd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:58.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.878+0000 7f31c3406640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc0cfb50 0x7f31bc0addd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f31b402b020 tx=0x7f31b4003f10 comp rx=0 tx=0).stop 2024-07-24T16:24:58.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.878+0000 7f31c3406640 1 -- 172.21.15.159:0/3233393543 shutdown_connections 2024-07-24T16:24:58.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.878+0000 7f31c3406640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f31a0077010 0x7f31a00794d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.878+0000 7f31c3406640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f31bc0cfb50 0x7f31bc0addd0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.878+0000 7f31c3406640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f31bc0cf770 0x7f31bc0ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.878+0000 7f31c3406640 1 --2- 172.21.15.159:0/3233393543 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f31bc06dba0 0x7f31bc1f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:58.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.878+0000 7f31c3406640 1 -- 172.21.15.159:0/3233393543 >> 172.21.15.159:0/3233393543 conn(0x7f31bc06c560 msgr2=0x7f31bc071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:58.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.878+0000 7f31c3406640 1 -- 172.21.15.159:0/3233393543 shutdown_connections 2024-07-24T16:24:58.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.878+0000 7f31c3406640 1 -- 172.21.15.159:0/3233393543 wait complete. 2024-07-24T16:24:58.892 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-07-24T16:24:58.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.996+0000 7f32ee512640 1 -- 172.21.15.159:0/2375037469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32e8071ca0 msgr2=0x7f32e80b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:58.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.996+0000 7f32ee512640 1 --2- 172.21.15.159:0/2375037469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32e8071ca0 0x7f32e80b5450 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f32e0005fd0 tx=0x7f32e002aa10 comp rx=0 tx=0).stop 2024-07-24T16:24:59.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.996+0000 7f32ee512640 1 -- 172.21.15.159:0/2375037469 shutdown_connections 2024-07-24T16:24:59.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.996+0000 7f32ee512640 1 --2- 172.21.15.159:0/2375037469 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32e8071ca0 0x7f32e80b5450 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:59.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.997+0000 7f32ee512640 1 --2- 172.21.15.159:0/2375037469 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32e80cee10 0x7f32e80d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:59.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.997+0000 7f32ee512640 1 -- 172.21.15.159:0/2375037469 >> 172.21.15.159:0/2375037469 conn(0x7f32e80b36f0 msgr2=0x7f32e80b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:59.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.997+0000 7f32ee512640 1 -- 172.21.15.159:0/2375037469 shutdown_connections 2024-07-24T16:24:59.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.997+0000 7f32ee512640 1 -- 172.21.15.159:0/2375037469 wait complete. 2024-07-24T16:24:59.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.998+0000 7f32ee512640 1 Processor -- start 2024-07-24T16:24:59.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.998+0000 7f32ee512640 1 -- start start 2024-07-24T16:24:59.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32ee512640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32e80707c0 0x7f32e814f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:59.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32ee512640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32e8071ca0 0x7f32e81f5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:59.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32ee512640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32e80cee10 0x7f32e81f5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:59.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32ee512640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f32e80b5b10 con 0x7f32e8071ca0 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32ee512640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f32e80b5990 con 0x7f32e80707c0 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32ee512640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f32e80b5c90 con 0x7f32e80cee10 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32e77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32e8071ca0 0x7f32e81f5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32e77fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32e8071ca0 0x7f32e81f5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44408/0 (socket says 172.21.15.159:44408) 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32e77fe640 1 -- 172.21.15.159:0/1454625315 learned_addr learned my addr 172.21.15.159:0/1454625315 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32e7fff640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32e80707c0 0x7f32e814f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32ecaaf640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32e80cee10 0x7f32e81f5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32e77fe640 1 -- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32e80cee10 msgr2=0x7f32e81f5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32e77fe640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32e80cee10 0x7f32e81f5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32e77fe640 1 -- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32e80707c0 msgr2=0x7f32e814f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32e77fe640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32e80707c0 0x7f32e814f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32e77fe640 1 -- 172.21.15.159:0/1454625315 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e814d890 con 0x7f32e8071ca0 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32e77fe640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32e8071ca0 0x7f32e81f5700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c3c0 tx=0x7f32dc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32e4ff9640 1 -- 172.21.15.159:0/1454625315 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0052d0 con 0x7f32e8071ca0 2024-07-24T16:24:59.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32e4ff9640 1 -- 172.21.15.159:0/1454625315 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32dc007020 con 0x7f32e8071ca0 2024-07-24T16:24:59.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32ee512640 1 -- 172.21.15.159:0/1454625315 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e814db70 con 0x7f32e8071ca0 2024-07-24T16:24:59.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32e4ff9640 1 -- 172.21.15.159:0/1454625315 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0074b0 con 0x7f32e8071ca0 2024-07-24T16:24:59.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:58.999+0000 7f32ee512640 1 -- 172.21.15.159:0/1454625315 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e814e130 con 0x7f32e8071ca0 2024-07-24T16:24:59.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.000+0000 7f32ee512640 1 -- 172.21.15.159:0/1454625315 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e80b61b0 con 0x7f32e8071ca0 2024-07-24T16:24:59.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.001+0000 7f32e4ff9640 1 -- 172.21.15.159:0/1454625315 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f32dc0067d0 con 0x7f32e8071ca0 2024-07-24T16:24:59.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.001+0000 7f32e4ff9640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f32d4077070 0x7f32d4079530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:59.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.001+0000 7f32e4ff9640 1 -- 172.21.15.159:0/1454625315 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6101+0+0 (secure 0 0 0) 0x7f32dc097e40 con 0x7f32e8071ca0 2024-07-24T16:24:59.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.002+0000 7f32e7fff640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f32d4077070 0x7f32d4079530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:59.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.002+0000 7f32e7fff640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f32d4077070 0x7f32d4079530 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f32d8005fd0 tx=0x7f32d800b390 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:59.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.005+0000 7f32e4ff9640 1 -- 172.21.15.159:0/1454625315 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f32dc060980 con 0x7f32e8071ca0 2024-07-24T16:24:59.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.226+0000 7f32ee512640 1 -- 172.21.15.159:0/1454625315 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f32e815ed20 con 0x7f32e8071ca0 2024-07-24T16:24:59.242 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.239+0000 7f32e4ff9640 1 -- 172.21.15.159:0/1454625315 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) ==== 118+0+0 (secure 0 0 0) 0x7f32dc064ed0 con 0x7f32e8071ca0 2024-07-24T16:24:59.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.242+0000 7f32ee512640 1 -- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f32d4077070 msgr2=0x7f32d4079530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:59.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.242+0000 7f32ee512640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f32d4077070 0x7f32d4079530 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f32d8005fd0 tx=0x7f32d800b390 comp rx=0 tx=0).stop 2024-07-24T16:24:59.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.242+0000 7f32ee512640 1 -- 172.21.15.159:0/1454625315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32e8071ca0 msgr2=0x7f32e81f5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:59.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.242+0000 7f32ee512640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32e8071ca0 0x7f32e81f5700 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c3c0 tx=0x7f32dc00c880 comp rx=0 tx=0).stop 2024-07-24T16:24:59.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.242+0000 7f32ee512640 1 -- 172.21.15.159:0/1454625315 shutdown_connections 2024-07-24T16:24:59.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.242+0000 7f32ee512640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f32d4077070 0x7f32d4079530 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:59.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.242+0000 7f32ee512640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32e80cee10 0x7f32e81f5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:59.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.242+0000 7f32ee512640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32e8071ca0 0x7f32e81f5700 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:59.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.242+0000 7f32ee512640 1 --2- 172.21.15.159:0/1454625315 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32e80707c0 0x7f32e814f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:59.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.242+0000 7f32ee512640 1 -- 172.21.15.159:0/1454625315 >> 172.21.15.159:0/1454625315 conn(0x7f32e80b36f0 msgr2=0x7f32e80b63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:59.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.242+0000 7f32ee512640 1 -- 172.21.15.159:0/1454625315 shutdown_connections 2024-07-24T16:24:59.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.242+0000 7f32ee512640 1 -- 172.21.15.159:0/1454625315 wait complete. 2024-07-24T16:24:59.256 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-07-24T16:24:59.257 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-07-24T16:24:59.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.361+0000 7f0724e06640 1 -- 172.21.15.159:0/394204577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0720157d50 msgr2=0x7f07200cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:59.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.361+0000 7f0724e06640 1 --2- 172.21.15.159:0/394204577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0720157d50 0x7f07200cf410 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0710009830 tx=0x7f071002a510 comp rx=0 tx=0).stop 2024-07-24T16:24:59.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.361+0000 7f0724e06640 1 -- 172.21.15.159:0/394204577 shutdown_connections 2024-07-24T16:24:59.364 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.361+0000 7f0724e06640 1 --2- 172.21.15.159:0/394204577 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0720070500 0x7f072015b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:59.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.361+0000 7f0724e06640 1 --2- 172.21.15.159:0/394204577 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0720157d50 0x7f07200cf410 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:59.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.361+0000 7f0724e06640 1 -- 172.21.15.159:0/394204577 >> 172.21.15.159:0/394204577 conn(0x7f072006d450 msgr2=0x7f072006d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:24:59.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.361+0000 7f0724e06640 1 -- 172.21.15.159:0/394204577 shutdown_connections 2024-07-24T16:24:59.365 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.361+0000 7f0724e06640 1 -- 172.21.15.159:0/394204577 wait complete. 2024-07-24T16:24:59.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.362+0000 7f0724e06640 1 Processor -- start 2024-07-24T16:24:59.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.363+0000 7f0724e06640 1 -- start start 2024-07-24T16:24:59.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.363+0000 7f0724e06640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f072006f1c0 0x7f07201513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:59.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.363+0000 7f0724e06640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0720070500 0x7f07201f1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:59.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.363+0000 7f0724e06640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0720157d50 0x7f07201f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:59.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.363+0000 7f0724e06640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f07200cdea0 con 0x7f0720070500 2024-07-24T16:24:59.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.363+0000 7f0724e06640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f07200cdd20 con 0x7f072006f1c0 2024-07-24T16:24:59.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.363+0000 7f0724e06640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f07200ce020 con 0x7f0720157d50 2024-07-24T16:24:59.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.363+0000 7f0715d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0720070500 0x7f07201f1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:59.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.363+0000 7f0715d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0720070500 0x7f07201f1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44418/0 (socket says 172.21.15.159:44418) 2024-07-24T16:24:59.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.363+0000 7f0715d9b640 1 -- 172.21.15.159:0/3563183185 learned_addr learned my addr 172.21.15.159:0/3563183185 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:24:59.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f071ed9d640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0720157d50 0x7f07201f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:59.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f071e59c640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f072006f1c0 0x7f07201513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:59.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f0715d9b640 1 -- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0720157d50 msgr2=0x7f07201f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:59.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f0715d9b640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0720157d50 0x7f07201f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f0715d9b640 1 -- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f072006f1c0 msgr2=0x7f07201513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:24:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f0715d9b640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f072006f1c0 0x7f07201513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:24:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f0715d9b640 1 -- 172.21.15.159:0/3563183185 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f072014ced0 con 0x7f0720070500 2024-07-24T16:24:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f071ed9d640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0720157d50 0x7f07201f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:24:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f0715d9b640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0720070500 0x7f07201f1d20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f070800c450 tx=0x7f070800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f07177fe640 1 -- 172.21.15.159:0/3563183185 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708016020 con 0x7f0720070500 2024-07-24T16:24:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f07177fe640 1 -- 172.21.15.159:0/3563183185 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0708005400 con 0x7f0720070500 2024-07-24T16:24:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f0724e06640 1 -- 172.21.15.159:0/3563183185 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07201f2940 con 0x7f0720070500 2024-07-24T16:24:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f07177fe640 1 -- 172.21.15.159:0/3563183185 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0708007280 con 0x7f0720070500 2024-07-24T16:24:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.364+0000 7f0724e06640 1 -- 172.21.15.159:0/3563183185 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f072014f480 con 0x7f0720070500 2024-07-24T16:24:59.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.365+0000 7f0724e06640 1 -- 172.21.15.159:0/3563183185 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f072015b3c0 con 0x7f0720070500 2024-07-24T16:24:59.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.366+0000 7f07177fe640 1 -- 172.21.15.159:0/3563183185 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0708007420 con 0x7f0720070500 2024-07-24T16:24:59.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.366+0000 7f07177fe640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0700077010 0x7f07000794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:24:59.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.366+0000 7f07177fe640 1 -- 172.21.15.159:0/3563183185 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f07080984d0 con 0x7f0720070500 2024-07-24T16:24:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.366+0000 7f071e59c640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0700077010 0x7f07000794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:24:59.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.367+0000 7f071e59c640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0700077010 0x7f07000794d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0710034000 tx=0x7f0710004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:24:59.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.370+0000 7f07177fe640 1 -- 172.21.15.159:0/3563183185 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f0708020020 con 0x7f0720070500 2024-07-24T16:24:59.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:24:59.596+0000 7f0724e06640 1 -- 172.21.15.159:0/3563183185 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f07200b40e0 con 0x7f0720070500 2024-07-24T16:25:00.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.246+0000 7f07177fe640 1 -- 172.21.15.159:0/3563183185 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) ==== 122+0+0 (secure 0 0 0) 0x7f07080615e0 con 0x7f0720070500 2024-07-24T16:25:00.251 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.249+0000 7f0724e06640 1 -- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0700077010 msgr2=0x7f07000794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:00.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.249+0000 7f0724e06640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0700077010 0x7f07000794d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0710034000 tx=0x7f0710004730 comp rx=0 tx=0).stop 2024-07-24T16:25:00.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.249+0000 7f0724e06640 1 -- 172.21.15.159:0/3563183185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0720070500 msgr2=0x7f07201f1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:00.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.249+0000 7f0724e06640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0720070500 0x7f07201f1d20 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f070800c450 tx=0x7f070800c910 comp rx=0 tx=0).stop 2024-07-24T16:25:00.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.249+0000 7f0724e06640 1 -- 172.21.15.159:0/3563183185 shutdown_connections 2024-07-24T16:25:00.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.249+0000 7f0724e06640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0700077010 0x7f07000794d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.249+0000 7f0724e06640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0720157d50 0x7f07201f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.249+0000 7f0724e06640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0720070500 0x7f07201f1d20 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.249+0000 7f0724e06640 1 --2- 172.21.15.159:0/3563183185 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f072006f1c0 0x7f07201513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.249+0000 7f0724e06640 1 -- 172.21.15.159:0/3563183185 >> 172.21.15.159:0/3563183185 conn(0x7f072006d450 msgr2=0x7f07200b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:00.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.249+0000 7f0724e06640 1 -- 172.21.15.159:0/3563183185 shutdown_connections 2024-07-24T16:25:00.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.249+0000 7f0724e06640 1 -- 172.21.15.159:0/3563183185 wait complete. 2024-07-24T16:25:00.263 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-07-24T16:25:00.263 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:25:00.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.364+0000 7f7bd0231640 1 -- 172.21.15.159:0/3296117023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bb4003a00 msgr2=0x7f7bb4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:00.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.364+0000 7f7bd0231640 1 --2- 172.21.15.159:0/3296117023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bb4003a00 0x7f7bb4003e20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f7bc4009b80 tx=0x7f7bb4005830 comp rx=0 tx=0).stop 2024-07-24T16:25:00.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.364+0000 7f7bce7ce640 1 -- 172.21.15.159:0/3296117023 reap_dead start 2024-07-24T16:25:00.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.364+0000 7f7bd0231640 1 -- 172.21.15.159:0/3296117023 shutdown_connections 2024-07-24T16:25:00.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.364+0000 7f7bd0231640 1 -- 172.21.15.159:0/3296117023 >> 172.21.15.159:0/3296117023 conn(0x7f7bc80b2230 msgr2=0x7f7bc80b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:00.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.364+0000 7f7bd0231640 1 -- 172.21.15.159:0/3296117023 shutdown_connections 2024-07-24T16:25:00.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.364+0000 7f7bd0231640 1 -- 172.21.15.159:0/3296117023 wait complete. 2024-07-24T16:25:00.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.365+0000 7f7bd0231640 1 Processor -- start 2024-07-24T16:25:00.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.366+0000 7f7bd0231640 1 -- start start 2024-07-24T16:25:00.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.366+0000 7f7bd0231640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bb4003a00 0x7f7bc8146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:00.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.366+0000 7f7bd0231640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bc8155fc0 0x7f7bc8148880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:00.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.366+0000 7f7bd0231640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bc8146e70 0x7f7bc815a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:00.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.366+0000 7f7bd0231640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc8070110 con 0x7f7bb4003a00 2024-07-24T16:25:00.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.366+0000 7f7bd0231640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc80736f0 con 0x7f7bc8155fc0 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.366+0000 7f7bd0231640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7bc81483f0 con 0x7f7bc8146e70 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.366+0000 7f7bcdfcd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bb4003a00 0x7f7bc8146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.366+0000 7f7bcdfcd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bb4003a00 0x7f7bc8146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44432/0 (socket says 172.21.15.159:44432) 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.366+0000 7f7bcdfcd640 1 -- 172.21.15.159:0/14297179 learned_addr learned my addr 172.21.15.159:0/14297179 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.366+0000 7f7bcd7cc640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bc8155fc0 0x7f7bc8148880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.366+0000 7f7bce7ce640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bc8146e70 0x7f7bc815a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.367+0000 7f7bcdfcd640 1 -- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bc8146e70 msgr2=0x7f7bc815a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.367+0000 7f7bcdfcd640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bc8146e70 0x7f7bc815a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.367+0000 7f7bcdfcd640 1 -- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bc8155fc0 msgr2=0x7f7bc8148880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.367+0000 7f7bcdfcd640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bc8155fc0 0x7f7bc8148880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.367+0000 7f7bcdfcd640 1 -- 172.21.15.159:0/14297179 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc81477e0 con 0x7f7bb4003a00 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.367+0000 7f7bcd7cc640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bc8155fc0 0x7f7bc8148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.367+0000 7f7bcdfcd640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bb4003a00 0x7f7bc8146820 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7bc402b4f0 tx=0x7f7bc4033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:00.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.367+0000 7f7bbe7fc640 1 -- 172.21.15.159:0/14297179 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4038040 con 0x7f7bb4003a00 2024-07-24T16:25:00.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.367+0000 7f7bbe7fc640 1 -- 172.21.15.159:0/14297179 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bc4004020 con 0x7f7bb4003a00 2024-07-24T16:25:00.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.367+0000 7f7bd0231640 1 -- 172.21.15.159:0/14297179 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc8147ac0 con 0x7f7bb4003a00 2024-07-24T16:25:00.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.367+0000 7f7bbe7fc640 1 -- 172.21.15.159:0/14297179 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bc4004450 con 0x7f7bb4003a00 2024-07-24T16:25:00.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.367+0000 7f7bd0231640 1 -- 172.21.15.159:0/14297179 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc8148080 con 0x7f7bb4003a00 2024-07-24T16:25:00.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.368+0000 7f7bd0231640 1 -- 172.21.15.159:0/14297179 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bc806c940 con 0x7f7bb4003a00 2024-07-24T16:25:00.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.368+0000 7f7bbe7fc640 1 -- 172.21.15.159:0/14297179 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f7bc4045020 con 0x7f7bb4003a00 2024-07-24T16:25:00.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.369+0000 7f7bbe7fc640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7bac077040 0x7f7bac079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:00.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.369+0000 7f7bbe7fc640 1 -- 172.21.15.159:0/14297179 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f7bc40b92e0 con 0x7f7bb4003a00 2024-07-24T16:25:00.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.369+0000 7f7bcd7cc640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7bac077040 0x7f7bac079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:00.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.370+0000 7f7bcd7cc640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7bac077040 0x7f7bac079500 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7bc815abe0 tx=0x7f7bb8005f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:00.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.373+0000 7f7bbe7fc640 1 -- 172.21.15.159:0/14297179 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f7bc40823e0 con 0x7f7bb4003a00 2024-07-24T16:25:00.593 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.591+0000 7f7bd0231640 1 -- 172.21.15.159:0/14297179 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bc80cd090 con 0x7f7bb4003a00 2024-07-24T16:25:00.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.591+0000 7f7bbe7fc640 1 -- 172.21.15.159:0/14297179 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f7bc4081ce0 con 0x7f7bb4003a00 2024-07-24T16:25:00.594 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:25:00.594 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":16,"btime":"2024-07-24T16:25:00:240907+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2383254131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2383254131},{"type":"v1","addr":"172.21.15.159:6835","nonce":2383254131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1682765472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1682765472},{"type":"v1","addr":"172.21.15.193:6836","nonce":1682765472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4840,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/306853489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":306853489},{"type":"v1","addr":"172.21.15.193:6837","nonce":306853489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:57.601499+0000","modified":"2024-07-24T16:24:59.597468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/279171348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":279171348},{"type":"v1","addr":"172.21.15.159:6834","nonce":279171348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":2}]} 2024-07-24T16:25:00.594 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 16 2024-07-24T16:25:00.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.593+0000 7f7bd0231640 1 -- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7bac077040 msgr2=0x7f7bac079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:00.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.593+0000 7f7bd0231640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7bac077040 0x7f7bac079500 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f7bc815abe0 tx=0x7f7bb8005f90 comp rx=0 tx=0).stop 2024-07-24T16:25:00.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.593+0000 7f7bd0231640 1 -- 172.21.15.159:0/14297179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bb4003a00 msgr2=0x7f7bc8146820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:00.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.593+0000 7f7bd0231640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bb4003a00 0x7f7bc8146820 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f7bc402b4f0 tx=0x7f7bc4033670 comp rx=0 tx=0).stop 2024-07-24T16:25:00.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.593+0000 7f7bd0231640 1 -- 172.21.15.159:0/14297179 shutdown_connections 2024-07-24T16:25:00.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.593+0000 7f7bd0231640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7bac077040 0x7f7bac079500 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.593+0000 7f7bd0231640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bc8146e70 0x7f7bc815a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.593+0000 7f7bd0231640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bc8155fc0 0x7f7bc8148880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.593+0000 7f7bd0231640 1 --2- 172.21.15.159:0/14297179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bb4003a00 0x7f7bc8146820 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.593+0000 7f7bd0231640 1 -- 172.21.15.159:0/14297179 >> 172.21.15.159:0/14297179 conn(0x7f7bc80b2230 msgr2=0x7f7bc8158880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:00.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.593+0000 7f7bd0231640 1 -- 172.21.15.159:0/14297179 shutdown_connections 2024-07-24T16:25:00.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.593+0000 7f7bd0231640 1 -- 172.21.15.159:0/14297179 wait complete. 2024-07-24T16:25:00.607 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:25:00.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.708+0000 7f0325ffa640 1 -- 172.21.15.159:0/1188229368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c004d40 msgr2=0x7f030c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:00.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.708+0000 7f0325ffa640 1 --2- 172.21.15.159:0/1188229368 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f030c004d40 0x7f030c0051c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0318009f00 tx=0x7f030c005830 comp rx=0 tx=0).stop 2024-07-24T16:25:00.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.708+0000 7f031ffff640 1 -- 172.21.15.159:0/1188229368 reap_dead start 2024-07-24T16:25:00.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.708+0000 7f0325ffa640 1 -- 172.21.15.159:0/1188229368 shutdown_connections 2024-07-24T16:25:00.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.708+0000 7f0325ffa640 1 -- 172.21.15.159:0/1188229368 >> 172.21.15.159:0/1188229368 conn(0x7f032006c560 msgr2=0x7f032006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:00.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.708+0000 7f0325ffa640 1 -- 172.21.15.159:0/1188229368 shutdown_connections 2024-07-24T16:25:00.711 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.708+0000 7f0325ffa640 1 -- 172.21.15.159:0/1188229368 wait complete. 2024-07-24T16:25:00.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.709+0000 7f0325ffa640 1 Processor -- start 2024-07-24T16:25:00.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.709+0000 7f0325ffa640 1 -- start start 2024-07-24T16:25:00.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.710+0000 7f0325ffa640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f030c004d40 0x7f0320146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:00.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.710+0000 7f0325ffa640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0320146ba0 0x7f032015acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:00.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.710+0000 7f0325ffa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f032015b230 0x7f03201491d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:00.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.710+0000 7f0325ffa640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0320159540 con 0x7f032015b230 2024-07-24T16:25:00.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.710+0000 7f0325ffa640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f03201593c0 con 0x7f030c004d40 2024-07-24T16:25:00.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.710+0000 7f0325ffa640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f03200cf320 con 0x7f0320146ba0 2024-07-24T16:25:00.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.710+0000 7f031ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f032015b230 0x7f03201491d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:00.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.710+0000 7f031ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f032015b230 0x7f03201491d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:44452/0 (socket says 172.21.15.159:44452) 2024-07-24T16:25:00.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.710+0000 7f031ffff640 1 -- 172.21.15.159:0/343604791 learned_addr learned my addr 172.21.15.159:0/343604791 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:00.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.710+0000 7f031effd640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0320146ba0 0x7f032015acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:00.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.710+0000 7f031f7fe640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f030c004d40 0x7f0320146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:00.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.711+0000 7f031ffff640 1 -- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0320146ba0 msgr2=0x7f032015acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:00.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.711+0000 7f031ffff640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0320146ba0 0x7f032015acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.711+0000 7f031ffff640 1 -- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f030c004d40 msgr2=0x7f0320146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:00.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.711+0000 7f031ffff640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f030c004d40 0x7f0320146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.711+0000 7f031ffff640 1 -- 172.21.15.159:0/343604791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0320149ec0 con 0x7f032015b230 2024-07-24T16:25:00.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.711+0000 7f031ffff640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f032015b230 0x7f03201491d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0318009f00 tx=0x7f0318033d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:00.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.711+0000 7f0317fff640 1 -- 172.21.15.159:0/343604791 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0318043070 con 0x7f032015b230 2024-07-24T16:25:00.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.711+0000 7f0317fff640 1 -- 172.21.15.159:0/343604791 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0318003c60 con 0x7f032015b230 2024-07-24T16:25:00.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.711+0000 7f0325ffa640 1 -- 172.21.15.159:0/343604791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03201472e0 con 0x7f032015b230 2024-07-24T16:25:00.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.711+0000 7f0317fff640 1 -- 172.21.15.159:0/343604791 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0318038040 con 0x7f032015b230 2024-07-24T16:25:00.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.711+0000 7f0325ffa640 1 -- 172.21.15.159:0/343604791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03201478a0 con 0x7f032015b230 2024-07-24T16:25:00.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.712+0000 7f0325ffa640 1 -- 172.21.15.159:0/343604791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f032015b6a0 con 0x7f032015b230 2024-07-24T16:25:00.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.713+0000 7f0317fff640 1 -- 172.21.15.159:0/343604791 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0318004290 con 0x7f032015b230 2024-07-24T16:25:00.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.713+0000 7f0317fff640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0300077010 0x7f03000794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:00.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.713+0000 7f0317fff640 1 -- 172.21.15.159:0/343604791 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f03180b8d60 con 0x7f032015b230 2024-07-24T16:25:00.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.713+0000 7f031f7fe640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0300077010 0x7f03000794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:00.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.714+0000 7f031f7fe640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0300077010 0x7f03000794d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0310001010 tx=0x7f0310001150 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:00.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.717+0000 7f0317fff640 1 -- 172.21.15.159:0/343604791 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f032015b6a0 con 0x7f032015b230 2024-07-24T16:25:00.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.906+0000 7f0325ffa640 1 -- 172.21.15.159:0/343604791 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0320148f20 con 0x7f032015b230 2024-07-24T16:25:00.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.907+0000 7f0317fff640 1 -- 172.21.15.159:0/343604791 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v36) ==== 74+0+16978 (secure 0 0 0) 0x7f0320148f20 con 0x7f032015b230 2024-07-24T16:25:00.909 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:25:00.910 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":36,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:24:59.236260+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:55.230299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:56.555270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:25:00.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.909+0000 7f0325ffa640 1 -- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0300077010 msgr2=0x7f03000794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:00.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.909+0000 7f0325ffa640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0300077010 0x7f03000794d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0310001010 tx=0x7f0310001150 comp rx=0 tx=0).stop 2024-07-24T16:25:00.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.909+0000 7f0325ffa640 1 -- 172.21.15.159:0/343604791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f032015b230 msgr2=0x7f03201491d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:00.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.909+0000 7f0325ffa640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f032015b230 0x7f03201491d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f0318009f00 tx=0x7f0318033d30 comp rx=0 tx=0).stop 2024-07-24T16:25:00.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.909+0000 7f0325ffa640 1 -- 172.21.15.159:0/343604791 shutdown_connections 2024-07-24T16:25:00.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.909+0000 7f0325ffa640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0300077010 0x7f03000794d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.912 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.909+0000 7f0325ffa640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f032015b230 0x7f03201491d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.909+0000 7f0325ffa640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0320146ba0 0x7f032015acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.909+0000 7f0325ffa640 1 --2- 172.21.15.159:0/343604791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f030c004d40 0x7f0320146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:00.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.909+0000 7f0325ffa640 1 -- 172.21.15.159:0/343604791 >> 172.21.15.159:0/343604791 conn(0x7f032006c560 msgr2=0x7f03201596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:00.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.909+0000 7f0325ffa640 1 -- 172.21.15.159:0/343604791 shutdown_connections 2024-07-24T16:25:00.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:00.909+0000 7f0325ffa640 1 -- 172.21.15.159:0/343604791 wait complete. 2024-07-24T16:25:00.923 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-07-24T16:25:00.923 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:25:01.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.023+0000 7f42abdc3640 1 -- 172.21.15.159:0/684094999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a4157130 msgr2=0x7f42a40cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.023+0000 7f42abdc3640 1 --2- 172.21.15.159:0/684094999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a4157130 0x7f42a40cf500 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f42a40b3b80 tx=0x7f42a002a4d0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.024+0000 7f42abdc3640 1 -- 172.21.15.159:0/684094999 shutdown_connections 2024-07-24T16:25:01.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.024+0000 7f42abdc3640 1 --2- 172.21.15.159:0/684094999 >> v2:172.21.15.193:3300/0 conn(0x7f42a406e360 0x7f42a415a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.024+0000 7f42abdc3640 1 --2- 172.21.15.159:0/684094999 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a4157130 0x7f42a40cf500 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.024+0000 7f42abdc3640 1 -- 172.21.15.159:0/684094999 >> 172.21.15.159:0/684094999 conn(0x7f42a406c560 msgr2=0x7f42a406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:01.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.024+0000 7f42abdc3640 1 -- 172.21.15.159:0/684094999 shutdown_connections 2024-07-24T16:25:01.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.024+0000 7f42abdc3640 1 -- 172.21.15.159:0/684094999 wait complete. 2024-07-24T16:25:01.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.025+0000 7f42abdc3640 1 Processor -- start 2024-07-24T16:25:01.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.025+0000 7f42abdc3640 1 -- start start 2024-07-24T16:25:01.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.025+0000 7f42abdc3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a406e360 0x7f42a40ce1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:01.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42abdc3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42a4157130 0x7f42a40cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:01.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42abdc3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42a4157510 0x7f42a415bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:01.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42abdc3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f42a4142eb0 con 0x7f42a406e360 2024-07-24T16:25:01.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42abdc3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f42a40cfe90 con 0x7f42a4157130 2024-07-24T16:25:01.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42abdc3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f42a4143030 con 0x7f42a4157510 2024-07-24T16:25:01.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42a9b5f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a406e360 0x7f42a40ce1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:01.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42a9b5f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a406e360 0x7f42a40ce1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43272/0 (socket says 172.21.15.159:43272) 2024-07-24T16:25:01.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42a9b5f640 1 -- 172.21.15.159:0/710726971 learned_addr learned my addr 172.21.15.159:0/710726971 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:01.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42aa360640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42a4157510 0x7f42a415bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:01.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42a9b5f640 1 -- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42a4157510 msgr2=0x7f42a415bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42a935e640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42a4157130 0x7f42a40cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:01.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42a9b5f640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42a4157510 0x7f42a415bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42a9b5f640 1 -- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42a4157130 msgr2=0x7f42a40cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42a9b5f640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42a4157130 0x7f42a40cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42a9b5f640 1 -- 172.21.15.159:0/710726971 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42a41378e0 con 0x7f42a406e360 2024-07-24T16:25:01.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42a9b5f640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a406e360 0x7f42a40ce1a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009850 tx=0x7f42a00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:01.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f429a7fc640 1 -- 172.21.15.159:0/710726971 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a003f070 con 0x7f42a406e360 2024-07-24T16:25:01.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f429a7fc640 1 -- 172.21.15.159:0/710726971 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42a0004890 con 0x7f42a406e360 2024-07-24T16:25:01.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f429a7fc640 1 -- 172.21.15.159:0/710726971 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42a0035030 con 0x7f42a406e360 2024-07-24T16:25:01.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42abdc3640 1 -- 172.21.15.159:0/710726971 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42a40cd6c0 con 0x7f42a406e360 2024-07-24T16:25:01.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.026+0000 7f42abdc3640 1 -- 172.21.15.159:0/710726971 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42a40cdc80 con 0x7f42a406e360 2024-07-24T16:25:01.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.027+0000 7f42abdc3640 1 -- 172.21.15.159:0/710726971 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42a40cf500 con 0x7f42a406e360 2024-07-24T16:25:01.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.028+0000 7f429a7fc640 1 -- 172.21.15.159:0/710726971 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f42a0042070 con 0x7f42a406e360 2024-07-24T16:25:01.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.028+0000 7f429a7fc640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4288077010 0x7f42880794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:01.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.028+0000 7f429a7fc640 1 -- 172.21.15.159:0/710726971 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f42a00b9900 con 0x7f42a406e360 2024-07-24T16:25:01.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.029+0000 7f42a935e640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4288077010 0x7f42880794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:01.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.029+0000 7f42a935e640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4288077010 0x7f42880794d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f42a415a520 tx=0x7f4294008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:01.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.032+0000 7f429a7fc640 1 -- 172.21.15.159:0/710726971 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f42a0082a00 con 0x7f42a406e360 2024-07-24T16:25:01.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.212+0000 7f42abdc3640 1 -- 172.21.15.159:0/710726971 --> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42a4156850 con 0x7f4288077010 2024-07-24T16:25:01.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.217+0000 7f429a7fc640 1 -- 172.21.15.159:0/710726971 <== mgr.4103 v2:172.21.15.193:6832/222319347 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246651 (secure 0 0 0) 0x7f429400a380 con 0x7f4288077010 2024-07-24T16:25:01.222 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:25:01.223 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:25:01.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.220+0000 7f42abdc3640 1 -- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4288077010 msgr2=0x7f42880794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.220+0000 7f42abdc3640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4288077010 0x7f42880794d0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f42a415a520 tx=0x7f4294008040 comp rx=0 tx=0).stop 2024-07-24T16:25:01.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.220+0000 7f42abdc3640 1 -- 172.21.15.159:0/710726971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a406e360 msgr2=0x7f42a40ce1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.220+0000 7f42abdc3640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a406e360 0x7f42a40ce1a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f42a0009850 tx=0x7f42a00039e0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.220+0000 7f42abdc3640 1 -- 172.21.15.159:0/710726971 shutdown_connections 2024-07-24T16:25:01.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.220+0000 7f42abdc3640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f4288077010 0x7f42880794d0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.220+0000 7f42abdc3640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f42a4157510 0x7f42a415bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.220+0000 7f42abdc3640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f42a4157130 0x7f42a40cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.220+0000 7f42abdc3640 1 --2- 172.21.15.159:0/710726971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f42a406e360 0x7f42a40ce1a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.220+0000 7f42abdc3640 1 -- 172.21.15.159:0/710726971 >> 172.21.15.159:0/710726971 conn(0x7f42a406c560 msgr2=0x7f42a40b4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:01.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.220+0000 7f42abdc3640 1 -- 172.21.15.159:0/710726971 shutdown_connections 2024-07-24T16:25:01.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.220+0000 7f42abdc3640 1 -- 172.21.15.159:0/710726971 wait complete. 2024-07-24T16:25:01.233 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-07-24T16:25:00.374743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220324,"kb_used_data":4152,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754396,"statfs":{"total":773094113280,"available":772868501504,"internally_reserved":0,"allocated":4251648,"data_stored":2442596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.151724"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238072+0000","last_change":"2024-07-24T16:24:57.238072+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238072+0000","last_undegraded":"2024-07-24T16:24:57.238072+0000","last_fullsized":"2024-07-24T16:24:57.238072+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237601+0000","last_change":"2024-07-24T16:24:57.237601+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237601+0000","last_undegraded":"2024-07-24T16:24:57.237601+0000","last_fullsized":"2024-07-24T16:24:57.237601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241140+0000","last_change":"2024-07-24T16:24:57.241140+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241140+0000","last_undegraded":"2024-07-24T16:24:57.241140+0000","last_fullsized":"2024-07-24T16:24:57.241140+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236609+0000","last_change":"2024-07-24T16:24:57.236609+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236609+0000","last_undegraded":"2024-07-24T16:24:57.236609+0000","last_fullsized":"2024-07-24T16:24:57.236609+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237318+0000","last_change":"2024-07-24T16:24:57.237318+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237318+0000","last_undegraded":"2024-07-24T16:24:57.237318+0000","last_fullsized":"2024-07-24T16:24:57.237318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235075+0000","last_change":"2024-07-24T16:24:57.235075+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235075+0000","last_undegraded":"2024-07-24T16:24:57.235075+0000","last_fullsized":"2024-07-24T16:24:57.235075+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235951+0000","last_change":"2024-07-24T16:24:57.235951+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235951+0000","last_undegraded":"2024-07-24T16:24:57.235951+0000","last_fullsized":"2024-07-24T16:24:57.235951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237138+0000","last_change":"2024-07-24T16:24:57.237138+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237138+0000","last_undegraded":"2024-07-24T16:24:57.237138+0000","last_fullsized":"2024-07-24T16:24:57.237138+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239769+0000","last_change":"2024-07-24T16:24:57.239769+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239769+0000","last_undegraded":"2024-07-24T16:24:57.239769+0000","last_fullsized":"2024-07-24T16:24:57.239769+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236925+0000","last_change":"2024-07-24T16:24:57.236925+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236925+0000","last_undegraded":"2024-07-24T16:24:57.236925+0000","last_fullsized":"2024-07-24T16:24:57.236925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239132+0000","last_change":"2024-07-24T16:24:57.239132+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239132+0000","last_undegraded":"2024-07-24T16:24:57.239132+0000","last_fullsized":"2024-07-24T16:24:57.239132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.240696+0000","last_change":"2024-07-24T16:24:57.240696+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.240696+0000","last_undegraded":"2024-07-24T16:24:57.240696+0000","last_fullsized":"2024-07-24T16:24:57.240696+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238291+0000","last_change":"2024-07-24T16:24:57.238291+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238291+0000","last_undegraded":"2024-07-24T16:24:57.238291+0000","last_fullsized":"2024-07-24T16:24:57.238291+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233515+0000","last_change":"2024-07-24T16:24:57.233515+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233515+0000","last_undegraded":"2024-07-24T16:24:57.233515+0000","last_fullsized":"2024-07-24T16:24:57.233515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235497+0000","last_change":"2024-07-24T16:24:57.235497+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235497+0000","last_undegraded":"2024-07-24T16:24:57.235497+0000","last_fullsized":"2024-07-24T16:24:57.235497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232777+0000","last_change":"2024-07-24T16:24:57.232777+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232777+0000","last_undegraded":"2024-07-24T16:24:57.232777+0000","last_fullsized":"2024-07-24T16:24:57.232777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234368+0000","last_change":"2024-07-24T16:24:57.234368+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234368+0000","last_undegraded":"2024-07-24T16:24:57.234368+0000","last_fullsized":"2024-07-24T16:24:57.234368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238629+0000","last_change":"2024-07-24T16:24:57.238629+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238629+0000","last_undegraded":"2024-07-24T16:24:57.238629+0000","last_fullsized":"2024-07-24T16:24:57.238629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238246+0000","last_change":"2024-07-24T16:24:57.238246+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238246+0000","last_undegraded":"2024-07-24T16:24:57.238246+0000","last_fullsized":"2024-07-24T16:24:57.238246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.240318+0000","last_change":"2024-07-24T16:24:57.240318+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.240318+0000","last_undegraded":"2024-07-24T16:24:57.240318+0000","last_fullsized":"2024-07-24T16:24:57.240318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237867+0000","last_change":"2024-07-24T16:24:57.237867+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237867+0000","last_undegraded":"2024-07-24T16:24:57.237867+0000","last_fullsized":"2024-07-24T16:24:57.237867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233049+0000","last_change":"2024-07-24T16:24:57.233049+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233049+0000","last_undegraded":"2024-07-24T16:24:57.233049+0000","last_fullsized":"2024-07-24T16:24:57.233049+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233898+0000","last_change":"2024-07-24T16:24:57.233898+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233898+0000","last_undegraded":"2024-07-24T16:24:57.233898+0000","last_fullsized":"2024-07-24T16:24:57.233898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238241+0000","last_change":"2024-07-24T16:24:57.238241+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238241+0000","last_undegraded":"2024-07-24T16:24:57.238241+0000","last_fullsized":"2024-07-24T16:24:57.238241+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.243721+0000","last_change":"2024-07-24T16:24:57.243721+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.243721+0000","last_undegraded":"2024-07-24T16:24:57.243721+0000","last_fullsized":"2024-07-24T16:24:57.243721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238407+0000","last_change":"2024-07-24T16:24:57.238407+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238407+0000","last_undegraded":"2024-07-24T16:24:57.238407+0000","last_fullsized":"2024-07-24T16:24:57.238407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241095+0000","last_change":"2024-07-24T16:24:57.241095+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241095+0000","last_undegraded":"2024-07-24T16:24:57.241095+0000","last_fullsized":"2024-07-24T16:24:57.241095+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237042+0000","last_change":"2024-07-24T16:24:57.237042+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237042+0000","last_undegraded":"2024-07-24T16:24:57.237042+0000","last_fullsized":"2024-07-24T16:24:57.237042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.242307+0000","last_change":"2024-07-24T16:24:57.242307+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.242307+0000","last_undegraded":"2024-07-24T16:24:57.242307+0000","last_fullsized":"2024-07-24T16:24:57.242307+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237099+0000","last_change":"2024-07-24T16:24:57.237099+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237099+0000","last_undegraded":"2024-07-24T16:24:57.237099+0000","last_fullsized":"2024-07-24T16:24:57.237099+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233235+0000","last_change":"2024-07-24T16:24:57.233235+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233235+0000","last_undegraded":"2024-07-24T16:24:57.233235+0000","last_fullsized":"2024-07-24T16:24:57.233235+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236797+0000","last_change":"2024-07-24T16:24:57.236797+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236797+0000","last_undegraded":"2024-07-24T16:24:57.236797+0000","last_fullsized":"2024-07-24T16:24:57.236797+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232989+0000","last_change":"2024-07-24T16:24:57.232989+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232989+0000","last_undegraded":"2024-07-24T16:24:57.232989+0000","last_fullsized":"2024-07-24T16:24:57.232989+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250427+0000","last_change":"2024-07-24T16:24:57.248705+0000","last_active":"2024-07-24T16:24:57.250427+0000","last_peered":"2024-07-24T16:24:57.250427+0000","last_clean":"2024-07-24T16:24:57.250427+0000","last_became_active":"2024-07-24T16:24:57.247318+0000","last_became_peered":"2024-07-24T16:24:57.247318+0000","last_unstale":"2024-07-24T16:24:57.250427+0000","last_undegraded":"2024-07-24T16:24:57.250427+0000","last_fullsized":"2024-07-24T16:24:57.250427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:41.244903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235709+0000","last_change":"2024-07-24T16:24:57.235709+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235709+0000","last_undegraded":"2024-07-24T16:24:57.235709+0000","last_fullsized":"2024-07-24T16:24:57.235709+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248881+0000","last_change":"2024-07-24T16:24:57.245395+0000","last_active":"2024-07-24T16:24:57.248881+0000","last_peered":"2024-07-24T16:24:57.248881+0000","last_clean":"2024-07-24T16:24:57.248881+0000","last_became_active":"2024-07-24T16:24:57.245020+0000","last_became_peered":"2024-07-24T16:24:57.245020+0000","last_unstale":"2024-07-24T16:24:57.248881+0000","last_undegraded":"2024-07-24T16:24:57.248881+0000","last_fullsized":"2024-07-24T16:24:57.248881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:46:07.474602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232148+0000","last_change":"2024-07-24T16:24:57.232148+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232148+0000","last_undegraded":"2024-07-24T16:24:57.232148+0000","last_fullsized":"2024-07-24T16:24:57.232148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252122+0000","last_change":"2024-07-24T16:24:57.246910+0000","last_active":"2024-07-24T16:24:57.252122+0000","last_peered":"2024-07-24T16:24:57.252122+0000","last_clean":"2024-07-24T16:24:57.252122+0000","last_became_active":"2024-07-24T16:24:57.246638+0000","last_became_peered":"2024-07-24T16:24:57.246638+0000","last_unstale":"2024-07-24T16:24:57.252122+0000","last_undegraded":"2024-07-24T16:24:57.252122+0000","last_fullsized":"2024-07-24T16:24:57.252122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:51.538511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237176+0000","last_change":"2024-07-24T16:24:57.237176+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237176+0000","last_undegraded":"2024-07-24T16:24:57.237176+0000","last_fullsized":"2024-07-24T16:24:57.237176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.246256+0000","last_change":"2024-07-24T16:24:57.242358+0000","last_active":"2024-07-24T16:24:57.246256+0000","last_peered":"2024-07-24T16:24:57.246256+0000","last_clean":"2024-07-24T16:24:57.246256+0000","last_became_active":"2024-07-24T16:24:57.242040+0000","last_became_peered":"2024-07-24T16:24:57.242040+0000","last_unstale":"2024-07-24T16:24:57.246256+0000","last_undegraded":"2024-07-24T16:24:57.246256+0000","last_fullsized":"2024-07-24T16:24:57.246256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:15:07.269777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.242278+0000","last_change":"2024-07-24T16:24:57.242278+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.242278+0000","last_undegraded":"2024-07-24T16:24:57.242278+0000","last_fullsized":"2024-07-24T16:24:57.242278+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.249387+0000","last_change":"2024-07-24T16:24:57.247796+0000","last_active":"2024-07-24T16:24:57.249387+0000","last_peered":"2024-07-24T16:24:57.249387+0000","last_clean":"2024-07-24T16:24:57.249387+0000","last_became_active":"2024-07-24T16:24:57.247526+0000","last_became_peered":"2024-07-24T16:24:57.247526+0000","last_unstale":"2024-07-24T16:24:57.249387+0000","last_undegraded":"2024-07-24T16:24:57.249387+0000","last_fullsized":"2024-07-24T16:24:57.249387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:50.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235001+0000","last_change":"2024-07-24T16:24:57.235001+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235001+0000","last_undegraded":"2024-07-24T16:24:57.235001+0000","last_fullsized":"2024-07-24T16:24:57.235001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.242229+0000","last_change":"2024-07-24T16:24:57.239638+0000","last_active":"2024-07-24T16:24:57.242229+0000","last_peered":"2024-07-24T16:24:57.242229+0000","last_clean":"2024-07-24T16:24:57.242229+0000","last_became_active":"2024-07-24T16:24:57.239216+0000","last_became_peered":"2024-07-24T16:24:57.239216+0000","last_unstale":"2024-07-24T16:24:57.242229+0000","last_undegraded":"2024-07-24T16:24:57.242229+0000","last_fullsized":"2024-07-24T16:24:57.242229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232190+0000","last_change":"2024-07-24T16:24:57.232190+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232190+0000","last_undegraded":"2024-07-24T16:24:57.232190+0000","last_fullsized":"2024-07-24T16:24:57.232190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252216+0000","last_change":"2024-07-24T16:24:57.247845+0000","last_active":"2024-07-24T16:24:57.252216+0000","last_peered":"2024-07-24T16:24:57.252216+0000","last_clean":"2024-07-24T16:24:57.252216+0000","last_became_active":"2024-07-24T16:24:57.247357+0000","last_became_peered":"2024-07-24T16:24:57.247357+0000","last_unstale":"2024-07-24T16:24:57.252216+0000","last_undegraded":"2024-07-24T16:24:57.252216+0000","last_fullsized":"2024-07-24T16:24:57.252216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235898+0000","last_change":"2024-07-24T16:24:57.235898+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235898+0000","last_undegraded":"2024-07-24T16:24:57.235898+0000","last_fullsized":"2024-07-24T16:24:57.235898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.246190+0000","last_change":"2024-07-24T16:24:57.242475+0000","last_active":"2024-07-24T16:24:57.246190+0000","last_peered":"2024-07-24T16:24:57.246190+0000","last_clean":"2024-07-24T16:24:57.246190+0000","last_became_active":"2024-07-24T16:24:57.242192+0000","last_became_peered":"2024-07-24T16:24:57.242192+0000","last_unstale":"2024-07-24T16:24:57.246190+0000","last_undegraded":"2024-07-24T16:24:57.246190+0000","last_fullsized":"2024-07-24T16:24:57.246190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:11:26.761665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236183+0000","last_change":"2024-07-24T16:24:57.236183+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236183+0000","last_undegraded":"2024-07-24T16:24:57.236183+0000","last_fullsized":"2024-07-24T16:24:57.236183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248310+0000","last_change":"2024-07-24T16:24:57.239691+0000","last_active":"2024-07-24T16:24:57.248310+0000","last_peered":"2024-07-24T16:24:57.248310+0000","last_clean":"2024-07-24T16:24:57.248310+0000","last_became_active":"2024-07-24T16:24:57.239430+0000","last_became_peered":"2024-07-24T16:24:57.239430+0000","last_unstale":"2024-07-24T16:24:57.248310+0000","last_undegraded":"2024-07-24T16:24:57.248310+0000","last_fullsized":"2024-07-24T16:24:57.248310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:36:59.542494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234227+0000","last_change":"2024-07-24T16:24:57.234227+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234227+0000","last_undegraded":"2024-07-24T16:24:57.234227+0000","last_fullsized":"2024-07-24T16:24:57.234227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.247935+0000","last_change":"2024-07-24T16:24:57.246040+0000","last_active":"2024-07-24T16:24:57.247935+0000","last_peered":"2024-07-24T16:24:57.247935+0000","last_clean":"2024-07-24T16:24:57.247935+0000","last_became_active":"2024-07-24T16:24:57.245741+0000","last_became_peered":"2024-07-24T16:24:57.245741+0000","last_unstale":"2024-07-24T16:24:57.247935+0000","last_undegraded":"2024-07-24T16:24:57.247935+0000","last_fullsized":"2024-07-24T16:24:57.247935+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239300+0000","last_change":"2024-07-24T16:24:57.239300+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239300+0000","last_undegraded":"2024-07-24T16:24:57.239300+0000","last_fullsized":"2024-07-24T16:24:57.239300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.253527+0000","last_change":"2024-07-24T16:24:57.252143+0000","last_active":"2024-07-24T16:24:57.253527+0000","last_peered":"2024-07-24T16:24:57.253527+0000","last_clean":"2024-07-24T16:24:57.253527+0000","last_became_active":"2024-07-24T16:24:57.251822+0000","last_became_peered":"2024-07-24T16:24:57.251822+0000","last_unstale":"2024-07-24T16:24:57.253527+0000","last_undegraded":"2024-07-24T16:24:57.253527+0000","last_fullsized":"2024-07-24T16:24:57.253527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:16:33.614437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.231847+0000","last_change":"2024-07-24T16:24:57.231847+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.231847+0000","last_undegraded":"2024-07-24T16:24:57.231847+0000","last_fullsized":"2024-07-24T16:24:57.231847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.240743+0000","last_change":"2024-07-24T16:24:57.237331+0000","last_active":"2024-07-24T16:24:57.240743+0000","last_peered":"2024-07-24T16:24:57.240743+0000","last_clean":"2024-07-24T16:24:57.240743+0000","last_became_active":"2024-07-24T16:24:57.237045+0000","last_became_peered":"2024-07-24T16:24:57.237045+0000","last_unstale":"2024-07-24T16:24:57.240743+0000","last_undegraded":"2024-07-24T16:24:57.240743+0000","last_fullsized":"2024-07-24T16:24:57.240743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:05:44.263080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241850+0000","last_change":"2024-07-24T16:24:57.241850+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241850+0000","last_undegraded":"2024-07-24T16:24:57.241850+0000","last_fullsized":"2024-07-24T16:24:57.241850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251261+0000","last_change":"2024-07-24T16:24:57.248002+0000","last_active":"2024-07-24T16:24:57.251261+0000","last_peered":"2024-07-24T16:24:57.251261+0000","last_clean":"2024-07-24T16:24:57.251261+0000","last_became_active":"2024-07-24T16:24:57.247736+0000","last_became_peered":"2024-07-24T16:24:57.247736+0000","last_unstale":"2024-07-24T16:24:57.251261+0000","last_undegraded":"2024-07-24T16:24:57.251261+0000","last_fullsized":"2024-07-24T16:24:57.251261+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:44:19.124214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234781+0000","last_change":"2024-07-24T16:24:57.234781+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234781+0000","last_undegraded":"2024-07-24T16:24:57.234781+0000","last_fullsized":"2024-07-24T16:24:57.234781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252154+0000","last_change":"2024-07-24T16:24:57.247616+0000","last_active":"2024-07-24T16:24:57.252154+0000","last_peered":"2024-07-24T16:24:57.252154+0000","last_clean":"2024-07-24T16:24:57.252154+0000","last_became_active":"2024-07-24T16:24:57.247334+0000","last_became_peered":"2024-07-24T16:24:57.247334+0000","last_unstale":"2024-07-24T16:24:57.252154+0000","last_undegraded":"2024-07-24T16:24:57.252154+0000","last_fullsized":"2024-07-24T16:24:57.252154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233217+0000","last_change":"2024-07-24T16:24:57.233217+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233217+0000","last_undegraded":"2024-07-24T16:24:57.233217+0000","last_fullsized":"2024-07-24T16:24:57.233217+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250982+0000","last_change":"2024-07-24T16:24:57.250024+0000","last_active":"2024-07-24T16:24:57.250982+0000","last_peered":"2024-07-24T16:24:57.250982+0000","last_clean":"2024-07-24T16:24:57.250982+0000","last_became_active":"2024-07-24T16:24:57.249723+0000","last_became_peered":"2024-07-24T16:24:57.249723+0000","last_unstale":"2024-07-24T16:24:57.250982+0000","last_undegraded":"2024-07-24T16:24:57.250982+0000","last_fullsized":"2024-07-24T16:24:57.250982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:12.087663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235430+0000","last_change":"2024-07-24T16:24:57.235430+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235430+0000","last_undegraded":"2024-07-24T16:24:57.235430+0000","last_fullsized":"2024-07-24T16:24:57.235430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.239610+0000","last_change":"2024-07-24T16:24:57.238606+0000","last_active":"2024-07-24T16:24:57.239610+0000","last_peered":"2024-07-24T16:24:57.239610+0000","last_clean":"2024-07-24T16:24:57.239610+0000","last_became_active":"2024-07-24T16:24:57.238268+0000","last_became_peered":"2024-07-24T16:24:57.238268+0000","last_unstale":"2024-07-24T16:24:57.239610+0000","last_undegraded":"2024-07-24T16:24:57.239610+0000","last_fullsized":"2024-07-24T16:24:57.239610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:51.538511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234290+0000","last_change":"2024-07-24T16:24:57.234290+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234290+0000","last_undegraded":"2024-07-24T16:24:57.234290+0000","last_fullsized":"2024-07-24T16:24:57.234290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248589+0000","last_change":"2024-07-24T16:24:57.247263+0000","last_active":"2024-07-24T16:24:57.248589+0000","last_peered":"2024-07-24T16:24:57.248589+0000","last_clean":"2024-07-24T16:24:57.248589+0000","last_became_active":"2024-07-24T16:24:57.246829+0000","last_became_peered":"2024-07-24T16:24:57.246829+0000","last_unstale":"2024-07-24T16:24:57.248589+0000","last_undegraded":"2024-07-24T16:24:57.248589+0000","last_fullsized":"2024-07-24T16:24:57.248589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238678+0000","last_change":"2024-07-24T16:24:57.238678+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238678+0000","last_undegraded":"2024-07-24T16:24:57.238678+0000","last_fullsized":"2024-07-24T16:24:57.238678+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248784+0000","last_change":"2024-07-24T16:24:57.246981+0000","last_active":"2024-07-24T16:24:57.248784+0000","last_peered":"2024-07-24T16:24:57.248784+0000","last_clean":"2024-07-24T16:24:57.248784+0000","last_became_active":"2024-07-24T16:24:57.246677+0000","last_became_peered":"2024-07-24T16:24:57.246677+0000","last_unstale":"2024-07-24T16:24:57.248784+0000","last_undegraded":"2024-07-24T16:24:57.248784+0000","last_fullsized":"2024-07-24T16:24:57.248784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:46:07.474602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234413+0000","last_change":"2024-07-24T16:24:57.234413+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234413+0000","last_undegraded":"2024-07-24T16:24:57.234413+0000","last_fullsized":"2024-07-24T16:24:57.234413+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251566+0000","last_change":"2024-07-24T16:24:57.246148+0000","last_active":"2024-07-24T16:24:57.251566+0000","last_peered":"2024-07-24T16:24:57.251566+0000","last_clean":"2024-07-24T16:24:57.251566+0000","last_became_active":"2024-07-24T16:24:57.245850+0000","last_became_peered":"2024-07-24T16:24:57.245850+0000","last_unstale":"2024-07-24T16:24:57.251566+0000","last_undegraded":"2024-07-24T16:24:57.251566+0000","last_fullsized":"2024-07-24T16:24:57.251566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:34:36.379487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235713+0000","last_change":"2024-07-24T16:24:57.235713+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235713+0000","last_undegraded":"2024-07-24T16:24:57.235713+0000","last_fullsized":"2024-07-24T16:24:57.235713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251085+0000","last_change":"2024-07-24T16:24:57.244659+0000","last_active":"2024-07-24T16:24:57.251085+0000","last_peered":"2024-07-24T16:24:57.251085+0000","last_clean":"2024-07-24T16:24:57.251085+0000","last_became_active":"2024-07-24T16:24:57.244361+0000","last_became_peered":"2024-07-24T16:24:57.244361+0000","last_unstale":"2024-07-24T16:24:57.251085+0000","last_undegraded":"2024-07-24T16:24:57.251085+0000","last_fullsized":"2024-07-24T16:24:57.251085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:46:07.474602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232220+0000","last_change":"2024-07-24T16:24:57.232220+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232220+0000","last_undegraded":"2024-07-24T16:24:57.232220+0000","last_fullsized":"2024-07-24T16:24:57.232220+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.253915+0000","last_change":"2024-07-24T16:24:57.249844+0000","last_active":"2024-07-24T16:24:57.253915+0000","last_peered":"2024-07-24T16:24:57.253915+0000","last_clean":"2024-07-24T16:24:57.253915+0000","last_became_active":"2024-07-24T16:24:57.249555+0000","last_became_peered":"2024-07-24T16:24:57.249555+0000","last_unstale":"2024-07-24T16:24:57.253915+0000","last_undegraded":"2024-07-24T16:24:57.253915+0000","last_fullsized":"2024-07-24T16:24:57.253915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:50:55.883018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.240246+0000","last_change":"2024-07-24T16:24:57.240246+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.240246+0000","last_undegraded":"2024-07-24T16:24:57.240246+0000","last_fullsized":"2024-07-24T16:24:57.240246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251531+0000","last_change":"2024-07-24T16:24:57.247926+0000","last_active":"2024-07-24T16:24:57.251531+0000","last_peered":"2024-07-24T16:24:57.251531+0000","last_clean":"2024-07-24T16:24:57.251531+0000","last_became_active":"2024-07-24T16:24:57.247680+0000","last_became_peered":"2024-07-24T16:24:57.247680+0000","last_unstale":"2024-07-24T16:24:57.251531+0000","last_undegraded":"2024-07-24T16:24:57.251531+0000","last_fullsized":"2024-07-24T16:24:57.251531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:00:31.435044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239293+0000","last_change":"2024-07-24T16:24:57.239293+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239293+0000","last_undegraded":"2024-07-24T16:24:57.239293+0000","last_fullsized":"2024-07-24T16:24:57.239293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250249+0000","last_change":"2024-07-24T16:24:57.248109+0000","last_active":"2024-07-24T16:24:57.250249+0000","last_peered":"2024-07-24T16:24:57.250249+0000","last_clean":"2024-07-24T16:24:57.250249+0000","last_became_active":"2024-07-24T16:24:57.247809+0000","last_became_peered":"2024-07-24T16:24:57.247809+0000","last_unstale":"2024-07-24T16:24:57.250249+0000","last_undegraded":"2024-07-24T16:24:57.250249+0000","last_fullsized":"2024-07-24T16:24:57.250249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:50.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234303+0000","last_change":"2024-07-24T16:24:57.234303+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234303+0000","last_undegraded":"2024-07-24T16:24:57.234303+0000","last_fullsized":"2024-07-24T16:24:57.234303+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251540+0000","last_change":"2024-07-24T16:24:57.247519+0000","last_active":"2024-07-24T16:24:57.251540+0000","last_peered":"2024-07-24T16:24:57.251540+0000","last_clean":"2024-07-24T16:24:57.251540+0000","last_became_active":"2024-07-24T16:24:57.247224+0000","last_became_peered":"2024-07-24T16:24:57.247224+0000","last_unstale":"2024-07-24T16:24:57.251540+0000","last_undegraded":"2024-07-24T16:24:57.251540+0000","last_fullsized":"2024-07-24T16:24:57.251540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:03:31.080074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235291+0000","last_change":"2024-07-24T16:24:57.235291+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235291+0000","last_undegraded":"2024-07-24T16:24:57.235291+0000","last_fullsized":"2024-07-24T16:24:57.235291+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252625+0000","last_change":"2024-07-24T16:24:57.251681+0000","last_active":"2024-07-24T16:24:57.252625+0000","last_peered":"2024-07-24T16:24:57.252625+0000","last_clean":"2024-07-24T16:24:57.252625+0000","last_became_active":"2024-07-24T16:24:57.251383+0000","last_became_peered":"2024-07-24T16:24:57.251383+0000","last_unstale":"2024-07-24T16:24:57.252625+0000","last_undegraded":"2024-07-24T16:24:57.252625+0000","last_fullsized":"2024-07-24T16:24:57.252625+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:40.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232319+0000","last_change":"2024-07-24T16:24:57.232319+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232319+0000","last_undegraded":"2024-07-24T16:24:57.232319+0000","last_fullsized":"2024-07-24T16:24:57.232319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.253877+0000","last_change":"2024-07-24T16:24:57.249314+0000","last_active":"2024-07-24T16:24:57.253877+0000","last_peered":"2024-07-24T16:24:57.253877+0000","last_clean":"2024-07-24T16:24:57.253877+0000","last_became_active":"2024-07-24T16:24:57.249068+0000","last_became_peered":"2024-07-24T16:24:57.249068+0000","last_unstale":"2024-07-24T16:24:57.253877+0000","last_undegraded":"2024-07-24T16:24:57.253877+0000","last_fullsized":"2024-07-24T16:24:57.253877+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:49:44.981927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233764+0000","last_change":"2024-07-24T16:24:57.233764+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233764+0000","last_undegraded":"2024-07-24T16:24:57.233764+0000","last_fullsized":"2024-07-24T16:24:57.233764+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.256647+0000","last_change":"2024-07-24T16:24:57.251715+0000","last_active":"2024-07-24T16:24:57.256647+0000","last_peered":"2024-07-24T16:24:57.256647+0000","last_clean":"2024-07-24T16:24:57.256647+0000","last_became_active":"2024-07-24T16:24:57.251432+0000","last_became_peered":"2024-07-24T16:24:57.251432+0000","last_unstale":"2024-07-24T16:24:57.256647+0000","last_undegraded":"2024-07-24T16:24:57.256647+0000","last_fullsized":"2024-07-24T16:24:57.256647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241467+0000","last_change":"2024-07-24T16:24:57.241467+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241467+0000","last_undegraded":"2024-07-24T16:24:57.241467+0000","last_fullsized":"2024-07-24T16:24:57.241467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252185+0000","last_change":"2024-07-24T16:24:57.250429+0000","last_active":"2024-07-24T16:24:57.252185+0000","last_peered":"2024-07-24T16:24:57.252185+0000","last_clean":"2024-07-24T16:24:57.252185+0000","last_became_active":"2024-07-24T16:24:57.250254+0000","last_became_peered":"2024-07-24T16:24:57.250254+0000","last_unstale":"2024-07-24T16:24:57.252185+0000","last_undegraded":"2024-07-24T16:24:57.252185+0000","last_fullsized":"2024-07-24T16:24:57.252185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:51.538511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234731+0000","last_change":"2024-07-24T16:24:57.234731+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234731+0000","last_undegraded":"2024-07-24T16:24:57.234731+0000","last_fullsized":"2024-07-24T16:24:57.234731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.249775+0000","last_change":"2024-07-24T16:24:57.244665+0000","last_active":"2024-07-24T16:24:57.249775+0000","last_peered":"2024-07-24T16:24:57.249775+0000","last_clean":"2024-07-24T16:24:57.249775+0000","last_became_active":"2024-07-24T16:24:57.244293+0000","last_became_peered":"2024-07-24T16:24:57.244293+0000","last_unstale":"2024-07-24T16:24:57.249775+0000","last_undegraded":"2024-07-24T16:24:57.249775+0000","last_fullsized":"2024-07-24T16:24:57.249775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:09:53.165693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232619+0000","last_change":"2024-07-24T16:24:57.232619+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232619+0000","last_undegraded":"2024-07-24T16:24:57.232619+0000","last_fullsized":"2024-07-24T16:24:57.232619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.246943+0000","last_change":"2024-07-24T16:24:57.243037+0000","last_active":"2024-07-24T16:24:57.246943+0000","last_peered":"2024-07-24T16:24:57.246943+0000","last_clean":"2024-07-24T16:24:57.246943+0000","last_became_active":"2024-07-24T16:24:57.242776+0000","last_became_peered":"2024-07-24T16:24:57.242776+0000","last_unstale":"2024-07-24T16:24:57.246943+0000","last_undegraded":"2024-07-24T16:24:57.246943+0000","last_fullsized":"2024-07-24T16:24:57.246943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:28:36.598035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234621+0000","last_change":"2024-07-24T16:24:57.234621+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234621+0000","last_undegraded":"2024-07-24T16:24:57.234621+0000","last_fullsized":"2024-07-24T16:24:57.234621+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248424+0000","last_change":"2024-07-24T16:24:57.239764+0000","last_active":"2024-07-24T16:24:57.248424+0000","last_peered":"2024-07-24T16:24:57.248424+0000","last_clean":"2024-07-24T16:24:57.248424+0000","last_became_active":"2024-07-24T16:24:57.239454+0000","last_became_peered":"2024-07-24T16:24:57.239454+0000","last_unstale":"2024-07-24T16:24:57.248424+0000","last_undegraded":"2024-07-24T16:24:57.248424+0000","last_fullsized":"2024-07-24T16:24:57.248424+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:26:13.775005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238068+0000","last_change":"2024-07-24T16:24:57.238068+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238068+0000","last_undegraded":"2024-07-24T16:24:57.238068+0000","last_fullsized":"2024-07-24T16:24:57.238068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250284+0000","last_change":"2024-07-24T16:24:57.247349+0000","last_active":"2024-07-24T16:24:57.250284+0000","last_peered":"2024-07-24T16:24:57.250284+0000","last_clean":"2024-07-24T16:24:57.250284+0000","last_became_active":"2024-07-24T16:24:57.246965+0000","last_became_peered":"2024-07-24T16:24:57.246965+0000","last_unstale":"2024-07-24T16:24:57.250284+0000","last_undegraded":"2024-07-24T16:24:57.250284+0000","last_fullsized":"2024-07-24T16:24:57.250284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":133,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.235180+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:24:57.235180+0000","last_peered":"2024-07-24T16:24:57.235180+0000","last_clean":"2024-07-24T16:24:57.235180+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:24:57.235180+0000","last_undegraded":"2024-07-24T16:24:57.235180+0000","last_fullsized":"2024-07-24T16:24:57.235180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":751434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":154399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":154399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":154399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":744767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:25:01.237 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:25:01.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.374+0000 7f3781ba2640 1 -- 172.21.15.159:0/3938230970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377c06f890 msgr2=0x7f377c0cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.374+0000 7f3781ba2640 1 --2- 172.21.15.159:0/3938230970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377c06f890 0x7f377c0cf320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f3770005fd0 tx=0x7f377002a580 comp rx=0 tx=0).stop 2024-07-24T16:25:01.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.374+0000 7f3781ba2640 1 -- 172.21.15.159:0/3938230970 shutdown_connections 2024-07-24T16:25:01.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.374+0000 7f3781ba2640 1 --2- 172.21.15.159:0/3938230970 >> v2:172.21.15.193:3300/0 conn(0x7f377c0cf860 0x7f377c15bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.374+0000 7f3781ba2640 1 --2- 172.21.15.159:0/3938230970 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377c06f890 0x7f377c0cf320 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.374+0000 7f3781ba2640 1 -- 172.21.15.159:0/3938230970 >> 172.21.15.159:0/3938230970 conn(0x7f377c06c560 msgr2=0x7f377c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:01.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.374+0000 7f3781ba2640 1 -- 172.21.15.159:0/3938230970 shutdown_connections 2024-07-24T16:25:01.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.374+0000 7f3781ba2640 1 -- 172.21.15.159:0/3938230970 wait complete. 2024-07-24T16:25:01.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.375+0000 7f3781ba2640 1 Processor -- start 2024-07-24T16:25:01.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.375+0000 7f3781ba2640 1 -- start start 2024-07-24T16:25:01.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f3781ba2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377c06f890 0x7f377c1f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:01.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f3781ba2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f377c0cf860 0x7f377c151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:01.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f3781ba2640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f377c158fe0 0x7f377c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:01.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f3781ba2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f377c159540 con 0x7f377c06f890 2024-07-24T16:25:01.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f3781ba2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f377c1593c0 con 0x7f377c0cf860 2024-07-24T16:25:01.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f3781ba2640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f377c15c4d0 con 0x7f377c158fe0 2024-07-24T16:25:01.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f377b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377c06f890 0x7f377c1f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:01.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f377b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377c06f890 0x7f377c1f1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43294/0 (socket says 172.21.15.159:43294) 2024-07-24T16:25:01.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f377b7fe640 1 -- 172.21.15.159:0/4172317957 learned_addr learned my addr 172.21.15.159:0/4172317957 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:01.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f377b7fe640 1 -- 172.21.15.159:0/4172317957 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f377c158fe0 msgr2=0x7f377c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f377affd640 1 --2- 172.21.15.159:0/4172317957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f377c0cf860 0x7f377c151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:01.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f377b7fe640 1 --2- 172.21.15.159:0/4172317957 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f377c158fe0 0x7f377c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f377b7fe640 1 -- 172.21.15.159:0/4172317957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f377c0cf860 msgr2=0x7f377c151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f377b7fe640 1 --2- 172.21.15.159:0/4172317957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f377c0cf860 0x7f377c151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f377b7fe640 1 -- 172.21.15.159:0/4172317957 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377c1f3130 con 0x7f377c06f890 2024-07-24T16:25:01.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.376+0000 7f377b7fe640 1 --2- 172.21.15.159:0/4172317957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377c06f890 0x7f377c1f1e80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f376c00ba50 tx=0x7f376c00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:01.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.377+0000 7f3763fff640 1 -- 172.21.15.159:0/4172317957 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c019070 con 0x7f377c06f890 2024-07-24T16:25:01.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.377+0000 7f3763fff640 1 -- 172.21.15.159:0/4172317957 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f376c00cd10 con 0x7f377c06f890 2024-07-24T16:25:01.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.377+0000 7f3781ba2640 1 -- 172.21.15.159:0/4172317957 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f377c1f2800 con 0x7f377c06f890 2024-07-24T16:25:01.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.377+0000 7f3763fff640 1 -- 172.21.15.159:0/4172317957 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c0146a0 con 0x7f377c06f890 2024-07-24T16:25:01.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.377+0000 7f3781ba2640 1 -- 172.21.15.159:0/4172317957 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f377c1f2dc0 con 0x7f377c06f890 2024-07-24T16:25:01.381 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.378+0000 7f3781ba2640 1 -- 172.21.15.159:0/4172317957 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f377c15c9d0 con 0x7f377c06f890 2024-07-24T16:25:01.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.378+0000 7f3763fff640 1 -- 172.21.15.159:0/4172317957 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f376c01c070 con 0x7f377c06f890 2024-07-24T16:25:01.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.379+0000 7f3763fff640 1 --2- 172.21.15.159:0/4172317957 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3768077010 0x7f37680794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:01.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.379+0000 7f3763fff640 1 -- 172.21.15.159:0/4172317957 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f376c098710 con 0x7f377c06f890 2024-07-24T16:25:01.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.379+0000 7f377affd640 1 --2- 172.21.15.159:0/4172317957 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3768077010 0x7f37680794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:01.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.380+0000 7f377affd640 1 --2- 172.21.15.159:0/4172317957 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3768077010 0x7f37680794d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3770033000 tx=0x7f3770004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:01.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.383+0000 7f3763fff640 1 -- 172.21.15.159:0/4172317957 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f376c0611d0 con 0x7f377c06f890 2024-07-24T16:25:01.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.588+0000 7f3781ba2640 1 -- 172.21.15.159:0/4172317957 --> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f377c1f3300 con 0x7f3768077010 2024-07-24T16:25:01.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.592+0000 7f3763fff640 1 -- 172.21.15.159:0/4172317957 <== mgr.4103 v2:172.21.15.193:6832/222319347 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246651 (secure 0 0 0) 0x7f377c1f3300 con 0x7f3768077010 2024-07-24T16:25:01.597 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:25:01.598 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:25:01.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.595+0000 7f3781ba2640 1 -- 172.21.15.159:0/4172317957 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3768077010 msgr2=0x7f37680794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.595+0000 7f3781ba2640 1 --2- 172.21.15.159:0/4172317957 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3768077010 0x7f37680794d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3770033000 tx=0x7f3770004730 comp rx=0 tx=0).stop 2024-07-24T16:25:01.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.595+0000 7f3781ba2640 1 -- 172.21.15.159:0/4172317957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377c06f890 msgr2=0x7f377c1f1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.595+0000 7f3781ba2640 1 --2- 172.21.15.159:0/4172317957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377c06f890 0x7f377c1f1e80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f376c00ba50 tx=0x7f376c00bf10 comp rx=0 tx=0).stop 2024-07-24T16:25:01.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.595+0000 7f3781ba2640 1 -- 172.21.15.159:0/4172317957 shutdown_connections 2024-07-24T16:25:01.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.595+0000 7f3781ba2640 1 --2- 172.21.15.159:0/4172317957 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f3768077010 0x7f37680794d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.595+0000 7f3781ba2640 1 --2- 172.21.15.159:0/4172317957 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f377c158fe0 0x7f377c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.595+0000 7f3781ba2640 1 --2- 172.21.15.159:0/4172317957 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f377c0cf860 0x7f377c151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.595+0000 7f3781ba2640 1 --2- 172.21.15.159:0/4172317957 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f377c06f890 0x7f377c1f1e80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.596+0000 7f3781ba2640 1 -- 172.21.15.159:0/4172317957 >> 172.21.15.159:0/4172317957 conn(0x7f377c06c560 msgr2=0x7f377c06ddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.596+0000 7f3781ba2640 1 -- 172.21.15.159:0/4172317957 shutdown_connections 2024-07-24T16:25:01.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.596+0000 7f3781ba2640 1 -- 172.21.15.159:0/4172317957 wait complete. 2024-07-24T16:25:01.609 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-07-24T16:25:00.374743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220324,"kb_used_data":4152,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754396,"statfs":{"total":773094113280,"available":772868501504,"internally_reserved":0,"allocated":4251648,"data_stored":2442596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.151724"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238072+0000","last_change":"2024-07-24T16:24:57.238072+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238072+0000","last_undegraded":"2024-07-24T16:24:57.238072+0000","last_fullsized":"2024-07-24T16:24:57.238072+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237601+0000","last_change":"2024-07-24T16:24:57.237601+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237601+0000","last_undegraded":"2024-07-24T16:24:57.237601+0000","last_fullsized":"2024-07-24T16:24:57.237601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241140+0000","last_change":"2024-07-24T16:24:57.241140+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241140+0000","last_undegraded":"2024-07-24T16:24:57.241140+0000","last_fullsized":"2024-07-24T16:24:57.241140+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236609+0000","last_change":"2024-07-24T16:24:57.236609+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236609+0000","last_undegraded":"2024-07-24T16:24:57.236609+0000","last_fullsized":"2024-07-24T16:24:57.236609+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237318+0000","last_change":"2024-07-24T16:24:57.237318+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237318+0000","last_undegraded":"2024-07-24T16:24:57.237318+0000","last_fullsized":"2024-07-24T16:24:57.237318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235075+0000","last_change":"2024-07-24T16:24:57.235075+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235075+0000","last_undegraded":"2024-07-24T16:24:57.235075+0000","last_fullsized":"2024-07-24T16:24:57.235075+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235951+0000","last_change":"2024-07-24T16:24:57.235951+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235951+0000","last_undegraded":"2024-07-24T16:24:57.235951+0000","last_fullsized":"2024-07-24T16:24:57.235951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237138+0000","last_change":"2024-07-24T16:24:57.237138+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237138+0000","last_undegraded":"2024-07-24T16:24:57.237138+0000","last_fullsized":"2024-07-24T16:24:57.237138+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239769+0000","last_change":"2024-07-24T16:24:57.239769+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239769+0000","last_undegraded":"2024-07-24T16:24:57.239769+0000","last_fullsized":"2024-07-24T16:24:57.239769+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236925+0000","last_change":"2024-07-24T16:24:57.236925+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236925+0000","last_undegraded":"2024-07-24T16:24:57.236925+0000","last_fullsized":"2024-07-24T16:24:57.236925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239132+0000","last_change":"2024-07-24T16:24:57.239132+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239132+0000","last_undegraded":"2024-07-24T16:24:57.239132+0000","last_fullsized":"2024-07-24T16:24:57.239132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.240696+0000","last_change":"2024-07-24T16:24:57.240696+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.240696+0000","last_undegraded":"2024-07-24T16:24:57.240696+0000","last_fullsized":"2024-07-24T16:24:57.240696+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238291+0000","last_change":"2024-07-24T16:24:57.238291+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238291+0000","last_undegraded":"2024-07-24T16:24:57.238291+0000","last_fullsized":"2024-07-24T16:24:57.238291+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233515+0000","last_change":"2024-07-24T16:24:57.233515+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233515+0000","last_undegraded":"2024-07-24T16:24:57.233515+0000","last_fullsized":"2024-07-24T16:24:57.233515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235497+0000","last_change":"2024-07-24T16:24:57.235497+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235497+0000","last_undegraded":"2024-07-24T16:24:57.235497+0000","last_fullsized":"2024-07-24T16:24:57.235497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232777+0000","last_change":"2024-07-24T16:24:57.232777+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232777+0000","last_undegraded":"2024-07-24T16:24:57.232777+0000","last_fullsized":"2024-07-24T16:24:57.232777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234368+0000","last_change":"2024-07-24T16:24:57.234368+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234368+0000","last_undegraded":"2024-07-24T16:24:57.234368+0000","last_fullsized":"2024-07-24T16:24:57.234368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238629+0000","last_change":"2024-07-24T16:24:57.238629+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238629+0000","last_undegraded":"2024-07-24T16:24:57.238629+0000","last_fullsized":"2024-07-24T16:24:57.238629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238246+0000","last_change":"2024-07-24T16:24:57.238246+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238246+0000","last_undegraded":"2024-07-24T16:24:57.238246+0000","last_fullsized":"2024-07-24T16:24:57.238246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.240318+0000","last_change":"2024-07-24T16:24:57.240318+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.240318+0000","last_undegraded":"2024-07-24T16:24:57.240318+0000","last_fullsized":"2024-07-24T16:24:57.240318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237867+0000","last_change":"2024-07-24T16:24:57.237867+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237867+0000","last_undegraded":"2024-07-24T16:24:57.237867+0000","last_fullsized":"2024-07-24T16:24:57.237867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233049+0000","last_change":"2024-07-24T16:24:57.233049+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233049+0000","last_undegraded":"2024-07-24T16:24:57.233049+0000","last_fullsized":"2024-07-24T16:24:57.233049+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233898+0000","last_change":"2024-07-24T16:24:57.233898+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233898+0000","last_undegraded":"2024-07-24T16:24:57.233898+0000","last_fullsized":"2024-07-24T16:24:57.233898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238241+0000","last_change":"2024-07-24T16:24:57.238241+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238241+0000","last_undegraded":"2024-07-24T16:24:57.238241+0000","last_fullsized":"2024-07-24T16:24:57.238241+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.243721+0000","last_change":"2024-07-24T16:24:57.243721+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.243721+0000","last_undegraded":"2024-07-24T16:24:57.243721+0000","last_fullsized":"2024-07-24T16:24:57.243721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238407+0000","last_change":"2024-07-24T16:24:57.238407+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238407+0000","last_undegraded":"2024-07-24T16:24:57.238407+0000","last_fullsized":"2024-07-24T16:24:57.238407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241095+0000","last_change":"2024-07-24T16:24:57.241095+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241095+0000","last_undegraded":"2024-07-24T16:24:57.241095+0000","last_fullsized":"2024-07-24T16:24:57.241095+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237042+0000","last_change":"2024-07-24T16:24:57.237042+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237042+0000","last_undegraded":"2024-07-24T16:24:57.237042+0000","last_fullsized":"2024-07-24T16:24:57.237042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.242307+0000","last_change":"2024-07-24T16:24:57.242307+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.242307+0000","last_undegraded":"2024-07-24T16:24:57.242307+0000","last_fullsized":"2024-07-24T16:24:57.242307+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237099+0000","last_change":"2024-07-24T16:24:57.237099+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237099+0000","last_undegraded":"2024-07-24T16:24:57.237099+0000","last_fullsized":"2024-07-24T16:24:57.237099+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233235+0000","last_change":"2024-07-24T16:24:57.233235+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233235+0000","last_undegraded":"2024-07-24T16:24:57.233235+0000","last_fullsized":"2024-07-24T16:24:57.233235+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236797+0000","last_change":"2024-07-24T16:24:57.236797+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236797+0000","last_undegraded":"2024-07-24T16:24:57.236797+0000","last_fullsized":"2024-07-24T16:24:57.236797+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232989+0000","last_change":"2024-07-24T16:24:57.232989+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232989+0000","last_undegraded":"2024-07-24T16:24:57.232989+0000","last_fullsized":"2024-07-24T16:24:57.232989+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250427+0000","last_change":"2024-07-24T16:24:57.248705+0000","last_active":"2024-07-24T16:24:57.250427+0000","last_peered":"2024-07-24T16:24:57.250427+0000","last_clean":"2024-07-24T16:24:57.250427+0000","last_became_active":"2024-07-24T16:24:57.247318+0000","last_became_peered":"2024-07-24T16:24:57.247318+0000","last_unstale":"2024-07-24T16:24:57.250427+0000","last_undegraded":"2024-07-24T16:24:57.250427+0000","last_fullsized":"2024-07-24T16:24:57.250427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:41.244903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235709+0000","last_change":"2024-07-24T16:24:57.235709+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235709+0000","last_undegraded":"2024-07-24T16:24:57.235709+0000","last_fullsized":"2024-07-24T16:24:57.235709+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248881+0000","last_change":"2024-07-24T16:24:57.245395+0000","last_active":"2024-07-24T16:24:57.248881+0000","last_peered":"2024-07-24T16:24:57.248881+0000","last_clean":"2024-07-24T16:24:57.248881+0000","last_became_active":"2024-07-24T16:24:57.245020+0000","last_became_peered":"2024-07-24T16:24:57.245020+0000","last_unstale":"2024-07-24T16:24:57.248881+0000","last_undegraded":"2024-07-24T16:24:57.248881+0000","last_fullsized":"2024-07-24T16:24:57.248881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:46:07.474602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232148+0000","last_change":"2024-07-24T16:24:57.232148+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232148+0000","last_undegraded":"2024-07-24T16:24:57.232148+0000","last_fullsized":"2024-07-24T16:24:57.232148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252122+0000","last_change":"2024-07-24T16:24:57.246910+0000","last_active":"2024-07-24T16:24:57.252122+0000","last_peered":"2024-07-24T16:24:57.252122+0000","last_clean":"2024-07-24T16:24:57.252122+0000","last_became_active":"2024-07-24T16:24:57.246638+0000","last_became_peered":"2024-07-24T16:24:57.246638+0000","last_unstale":"2024-07-24T16:24:57.252122+0000","last_undegraded":"2024-07-24T16:24:57.252122+0000","last_fullsized":"2024-07-24T16:24:57.252122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:51.538511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237176+0000","last_change":"2024-07-24T16:24:57.237176+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237176+0000","last_undegraded":"2024-07-24T16:24:57.237176+0000","last_fullsized":"2024-07-24T16:24:57.237176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.246256+0000","last_change":"2024-07-24T16:24:57.242358+0000","last_active":"2024-07-24T16:24:57.246256+0000","last_peered":"2024-07-24T16:24:57.246256+0000","last_clean":"2024-07-24T16:24:57.246256+0000","last_became_active":"2024-07-24T16:24:57.242040+0000","last_became_peered":"2024-07-24T16:24:57.242040+0000","last_unstale":"2024-07-24T16:24:57.246256+0000","last_undegraded":"2024-07-24T16:24:57.246256+0000","last_fullsized":"2024-07-24T16:24:57.246256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:15:07.269777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.242278+0000","last_change":"2024-07-24T16:24:57.242278+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.242278+0000","last_undegraded":"2024-07-24T16:24:57.242278+0000","last_fullsized":"2024-07-24T16:24:57.242278+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.249387+0000","last_change":"2024-07-24T16:24:57.247796+0000","last_active":"2024-07-24T16:24:57.249387+0000","last_peered":"2024-07-24T16:24:57.249387+0000","last_clean":"2024-07-24T16:24:57.249387+0000","last_became_active":"2024-07-24T16:24:57.247526+0000","last_became_peered":"2024-07-24T16:24:57.247526+0000","last_unstale":"2024-07-24T16:24:57.249387+0000","last_undegraded":"2024-07-24T16:24:57.249387+0000","last_fullsized":"2024-07-24T16:24:57.249387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:50.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235001+0000","last_change":"2024-07-24T16:24:57.235001+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235001+0000","last_undegraded":"2024-07-24T16:24:57.235001+0000","last_fullsized":"2024-07-24T16:24:57.235001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.242229+0000","last_change":"2024-07-24T16:24:57.239638+0000","last_active":"2024-07-24T16:24:57.242229+0000","last_peered":"2024-07-24T16:24:57.242229+0000","last_clean":"2024-07-24T16:24:57.242229+0000","last_became_active":"2024-07-24T16:24:57.239216+0000","last_became_peered":"2024-07-24T16:24:57.239216+0000","last_unstale":"2024-07-24T16:24:57.242229+0000","last_undegraded":"2024-07-24T16:24:57.242229+0000","last_fullsized":"2024-07-24T16:24:57.242229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232190+0000","last_change":"2024-07-24T16:24:57.232190+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232190+0000","last_undegraded":"2024-07-24T16:24:57.232190+0000","last_fullsized":"2024-07-24T16:24:57.232190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252216+0000","last_change":"2024-07-24T16:24:57.247845+0000","last_active":"2024-07-24T16:24:57.252216+0000","last_peered":"2024-07-24T16:24:57.252216+0000","last_clean":"2024-07-24T16:24:57.252216+0000","last_became_active":"2024-07-24T16:24:57.247357+0000","last_became_peered":"2024-07-24T16:24:57.247357+0000","last_unstale":"2024-07-24T16:24:57.252216+0000","last_undegraded":"2024-07-24T16:24:57.252216+0000","last_fullsized":"2024-07-24T16:24:57.252216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235898+0000","last_change":"2024-07-24T16:24:57.235898+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235898+0000","last_undegraded":"2024-07-24T16:24:57.235898+0000","last_fullsized":"2024-07-24T16:24:57.235898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.246190+0000","last_change":"2024-07-24T16:24:57.242475+0000","last_active":"2024-07-24T16:24:57.246190+0000","last_peered":"2024-07-24T16:24:57.246190+0000","last_clean":"2024-07-24T16:24:57.246190+0000","last_became_active":"2024-07-24T16:24:57.242192+0000","last_became_peered":"2024-07-24T16:24:57.242192+0000","last_unstale":"2024-07-24T16:24:57.246190+0000","last_undegraded":"2024-07-24T16:24:57.246190+0000","last_fullsized":"2024-07-24T16:24:57.246190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:11:26.761665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236183+0000","last_change":"2024-07-24T16:24:57.236183+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236183+0000","last_undegraded":"2024-07-24T16:24:57.236183+0000","last_fullsized":"2024-07-24T16:24:57.236183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248310+0000","last_change":"2024-07-24T16:24:57.239691+0000","last_active":"2024-07-24T16:24:57.248310+0000","last_peered":"2024-07-24T16:24:57.248310+0000","last_clean":"2024-07-24T16:24:57.248310+0000","last_became_active":"2024-07-24T16:24:57.239430+0000","last_became_peered":"2024-07-24T16:24:57.239430+0000","last_unstale":"2024-07-24T16:24:57.248310+0000","last_undegraded":"2024-07-24T16:24:57.248310+0000","last_fullsized":"2024-07-24T16:24:57.248310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:36:59.542494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234227+0000","last_change":"2024-07-24T16:24:57.234227+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234227+0000","last_undegraded":"2024-07-24T16:24:57.234227+0000","last_fullsized":"2024-07-24T16:24:57.234227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.247935+0000","last_change":"2024-07-24T16:24:57.246040+0000","last_active":"2024-07-24T16:24:57.247935+0000","last_peered":"2024-07-24T16:24:57.247935+0000","last_clean":"2024-07-24T16:24:57.247935+0000","last_became_active":"2024-07-24T16:24:57.245741+0000","last_became_peered":"2024-07-24T16:24:57.245741+0000","last_unstale":"2024-07-24T16:24:57.247935+0000","last_undegraded":"2024-07-24T16:24:57.247935+0000","last_fullsized":"2024-07-24T16:24:57.247935+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239300+0000","last_change":"2024-07-24T16:24:57.239300+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239300+0000","last_undegraded":"2024-07-24T16:24:57.239300+0000","last_fullsized":"2024-07-24T16:24:57.239300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.253527+0000","last_change":"2024-07-24T16:24:57.252143+0000","last_active":"2024-07-24T16:24:57.253527+0000","last_peered":"2024-07-24T16:24:57.253527+0000","last_clean":"2024-07-24T16:24:57.253527+0000","last_became_active":"2024-07-24T16:24:57.251822+0000","last_became_peered":"2024-07-24T16:24:57.251822+0000","last_unstale":"2024-07-24T16:24:57.253527+0000","last_undegraded":"2024-07-24T16:24:57.253527+0000","last_fullsized":"2024-07-24T16:24:57.253527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:16:33.614437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.231847+0000","last_change":"2024-07-24T16:24:57.231847+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.231847+0000","last_undegraded":"2024-07-24T16:24:57.231847+0000","last_fullsized":"2024-07-24T16:24:57.231847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.240743+0000","last_change":"2024-07-24T16:24:57.237331+0000","last_active":"2024-07-24T16:24:57.240743+0000","last_peered":"2024-07-24T16:24:57.240743+0000","last_clean":"2024-07-24T16:24:57.240743+0000","last_became_active":"2024-07-24T16:24:57.237045+0000","last_became_peered":"2024-07-24T16:24:57.237045+0000","last_unstale":"2024-07-24T16:24:57.240743+0000","last_undegraded":"2024-07-24T16:24:57.240743+0000","last_fullsized":"2024-07-24T16:24:57.240743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:05:44.263080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241850+0000","last_change":"2024-07-24T16:24:57.241850+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241850+0000","last_undegraded":"2024-07-24T16:24:57.241850+0000","last_fullsized":"2024-07-24T16:24:57.241850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251261+0000","last_change":"2024-07-24T16:24:57.248002+0000","last_active":"2024-07-24T16:24:57.251261+0000","last_peered":"2024-07-24T16:24:57.251261+0000","last_clean":"2024-07-24T16:24:57.251261+0000","last_became_active":"2024-07-24T16:24:57.247736+0000","last_became_peered":"2024-07-24T16:24:57.247736+0000","last_unstale":"2024-07-24T16:24:57.251261+0000","last_undegraded":"2024-07-24T16:24:57.251261+0000","last_fullsized":"2024-07-24T16:24:57.251261+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:44:19.124214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234781+0000","last_change":"2024-07-24T16:24:57.234781+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234781+0000","last_undegraded":"2024-07-24T16:24:57.234781+0000","last_fullsized":"2024-07-24T16:24:57.234781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252154+0000","last_change":"2024-07-24T16:24:57.247616+0000","last_active":"2024-07-24T16:24:57.252154+0000","last_peered":"2024-07-24T16:24:57.252154+0000","last_clean":"2024-07-24T16:24:57.252154+0000","last_became_active":"2024-07-24T16:24:57.247334+0000","last_became_peered":"2024-07-24T16:24:57.247334+0000","last_unstale":"2024-07-24T16:24:57.252154+0000","last_undegraded":"2024-07-24T16:24:57.252154+0000","last_fullsized":"2024-07-24T16:24:57.252154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233217+0000","last_change":"2024-07-24T16:24:57.233217+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233217+0000","last_undegraded":"2024-07-24T16:24:57.233217+0000","last_fullsized":"2024-07-24T16:24:57.233217+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250982+0000","last_change":"2024-07-24T16:24:57.250024+0000","last_active":"2024-07-24T16:24:57.250982+0000","last_peered":"2024-07-24T16:24:57.250982+0000","last_clean":"2024-07-24T16:24:57.250982+0000","last_became_active":"2024-07-24T16:24:57.249723+0000","last_became_peered":"2024-07-24T16:24:57.249723+0000","last_unstale":"2024-07-24T16:24:57.250982+0000","last_undegraded":"2024-07-24T16:24:57.250982+0000","last_fullsized":"2024-07-24T16:24:57.250982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:12.087663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235430+0000","last_change":"2024-07-24T16:24:57.235430+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235430+0000","last_undegraded":"2024-07-24T16:24:57.235430+0000","last_fullsized":"2024-07-24T16:24:57.235430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.239610+0000","last_change":"2024-07-24T16:24:57.238606+0000","last_active":"2024-07-24T16:24:57.239610+0000","last_peered":"2024-07-24T16:24:57.239610+0000","last_clean":"2024-07-24T16:24:57.239610+0000","last_became_active":"2024-07-24T16:24:57.238268+0000","last_became_peered":"2024-07-24T16:24:57.238268+0000","last_unstale":"2024-07-24T16:24:57.239610+0000","last_undegraded":"2024-07-24T16:24:57.239610+0000","last_fullsized":"2024-07-24T16:24:57.239610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:51.538511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234290+0000","last_change":"2024-07-24T16:24:57.234290+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234290+0000","last_undegraded":"2024-07-24T16:24:57.234290+0000","last_fullsized":"2024-07-24T16:24:57.234290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248589+0000","last_change":"2024-07-24T16:24:57.247263+0000","last_active":"2024-07-24T16:24:57.248589+0000","last_peered":"2024-07-24T16:24:57.248589+0000","last_clean":"2024-07-24T16:24:57.248589+0000","last_became_active":"2024-07-24T16:24:57.246829+0000","last_became_peered":"2024-07-24T16:24:57.246829+0000","last_unstale":"2024-07-24T16:24:57.248589+0000","last_undegraded":"2024-07-24T16:24:57.248589+0000","last_fullsized":"2024-07-24T16:24:57.248589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238678+0000","last_change":"2024-07-24T16:24:57.238678+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238678+0000","last_undegraded":"2024-07-24T16:24:57.238678+0000","last_fullsized":"2024-07-24T16:24:57.238678+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248784+0000","last_change":"2024-07-24T16:24:57.246981+0000","last_active":"2024-07-24T16:24:57.248784+0000","last_peered":"2024-07-24T16:24:57.248784+0000","last_clean":"2024-07-24T16:24:57.248784+0000","last_became_active":"2024-07-24T16:24:57.246677+0000","last_became_peered":"2024-07-24T16:24:57.246677+0000","last_unstale":"2024-07-24T16:24:57.248784+0000","last_undegraded":"2024-07-24T16:24:57.248784+0000","last_fullsized":"2024-07-24T16:24:57.248784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:46:07.474602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234413+0000","last_change":"2024-07-24T16:24:57.234413+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234413+0000","last_undegraded":"2024-07-24T16:24:57.234413+0000","last_fullsized":"2024-07-24T16:24:57.234413+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251566+0000","last_change":"2024-07-24T16:24:57.246148+0000","last_active":"2024-07-24T16:24:57.251566+0000","last_peered":"2024-07-24T16:24:57.251566+0000","last_clean":"2024-07-24T16:24:57.251566+0000","last_became_active":"2024-07-24T16:24:57.245850+0000","last_became_peered":"2024-07-24T16:24:57.245850+0000","last_unstale":"2024-07-24T16:24:57.251566+0000","last_undegraded":"2024-07-24T16:24:57.251566+0000","last_fullsized":"2024-07-24T16:24:57.251566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:34:36.379487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235713+0000","last_change":"2024-07-24T16:24:57.235713+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235713+0000","last_undegraded":"2024-07-24T16:24:57.235713+0000","last_fullsized":"2024-07-24T16:24:57.235713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251085+0000","last_change":"2024-07-24T16:24:57.244659+0000","last_active":"2024-07-24T16:24:57.251085+0000","last_peered":"2024-07-24T16:24:57.251085+0000","last_clean":"2024-07-24T16:24:57.251085+0000","last_became_active":"2024-07-24T16:24:57.244361+0000","last_became_peered":"2024-07-24T16:24:57.244361+0000","last_unstale":"2024-07-24T16:24:57.251085+0000","last_undegraded":"2024-07-24T16:24:57.251085+0000","last_fullsized":"2024-07-24T16:24:57.251085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:46:07.474602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232220+0000","last_change":"2024-07-24T16:24:57.232220+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232220+0000","last_undegraded":"2024-07-24T16:24:57.232220+0000","last_fullsized":"2024-07-24T16:24:57.232220+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.253915+0000","last_change":"2024-07-24T16:24:57.249844+0000","last_active":"2024-07-24T16:24:57.253915+0000","last_peered":"2024-07-24T16:24:57.253915+0000","last_clean":"2024-07-24T16:24:57.253915+0000","last_became_active":"2024-07-24T16:24:57.249555+0000","last_became_peered":"2024-07-24T16:24:57.249555+0000","last_unstale":"2024-07-24T16:24:57.253915+0000","last_undegraded":"2024-07-24T16:24:57.253915+0000","last_fullsized":"2024-07-24T16:24:57.253915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:50:55.883018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.240246+0000","last_change":"2024-07-24T16:24:57.240246+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.240246+0000","last_undegraded":"2024-07-24T16:24:57.240246+0000","last_fullsized":"2024-07-24T16:24:57.240246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251531+0000","last_change":"2024-07-24T16:24:57.247926+0000","last_active":"2024-07-24T16:24:57.251531+0000","last_peered":"2024-07-24T16:24:57.251531+0000","last_clean":"2024-07-24T16:24:57.251531+0000","last_became_active":"2024-07-24T16:24:57.247680+0000","last_became_peered":"2024-07-24T16:24:57.247680+0000","last_unstale":"2024-07-24T16:24:57.251531+0000","last_undegraded":"2024-07-24T16:24:57.251531+0000","last_fullsized":"2024-07-24T16:24:57.251531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:00:31.435044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239293+0000","last_change":"2024-07-24T16:24:57.239293+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239293+0000","last_undegraded":"2024-07-24T16:24:57.239293+0000","last_fullsized":"2024-07-24T16:24:57.239293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250249+0000","last_change":"2024-07-24T16:24:57.248109+0000","last_active":"2024-07-24T16:24:57.250249+0000","last_peered":"2024-07-24T16:24:57.250249+0000","last_clean":"2024-07-24T16:24:57.250249+0000","last_became_active":"2024-07-24T16:24:57.247809+0000","last_became_peered":"2024-07-24T16:24:57.247809+0000","last_unstale":"2024-07-24T16:24:57.250249+0000","last_undegraded":"2024-07-24T16:24:57.250249+0000","last_fullsized":"2024-07-24T16:24:57.250249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:50.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234303+0000","last_change":"2024-07-24T16:24:57.234303+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234303+0000","last_undegraded":"2024-07-24T16:24:57.234303+0000","last_fullsized":"2024-07-24T16:24:57.234303+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251540+0000","last_change":"2024-07-24T16:24:57.247519+0000","last_active":"2024-07-24T16:24:57.251540+0000","last_peered":"2024-07-24T16:24:57.251540+0000","last_clean":"2024-07-24T16:24:57.251540+0000","last_became_active":"2024-07-24T16:24:57.247224+0000","last_became_peered":"2024-07-24T16:24:57.247224+0000","last_unstale":"2024-07-24T16:24:57.251540+0000","last_undegraded":"2024-07-24T16:24:57.251540+0000","last_fullsized":"2024-07-24T16:24:57.251540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:03:31.080074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235291+0000","last_change":"2024-07-24T16:24:57.235291+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235291+0000","last_undegraded":"2024-07-24T16:24:57.235291+0000","last_fullsized":"2024-07-24T16:24:57.235291+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252625+0000","last_change":"2024-07-24T16:24:57.251681+0000","last_active":"2024-07-24T16:24:57.252625+0000","last_peered":"2024-07-24T16:24:57.252625+0000","last_clean":"2024-07-24T16:24:57.252625+0000","last_became_active":"2024-07-24T16:24:57.251383+0000","last_became_peered":"2024-07-24T16:24:57.251383+0000","last_unstale":"2024-07-24T16:24:57.252625+0000","last_undegraded":"2024-07-24T16:24:57.252625+0000","last_fullsized":"2024-07-24T16:24:57.252625+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:40.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232319+0000","last_change":"2024-07-24T16:24:57.232319+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232319+0000","last_undegraded":"2024-07-24T16:24:57.232319+0000","last_fullsized":"2024-07-24T16:24:57.232319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.253877+0000","last_change":"2024-07-24T16:24:57.249314+0000","last_active":"2024-07-24T16:24:57.253877+0000","last_peered":"2024-07-24T16:24:57.253877+0000","last_clean":"2024-07-24T16:24:57.253877+0000","last_became_active":"2024-07-24T16:24:57.249068+0000","last_became_peered":"2024-07-24T16:24:57.249068+0000","last_unstale":"2024-07-24T16:24:57.253877+0000","last_undegraded":"2024-07-24T16:24:57.253877+0000","last_fullsized":"2024-07-24T16:24:57.253877+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:49:44.981927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233764+0000","last_change":"2024-07-24T16:24:57.233764+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233764+0000","last_undegraded":"2024-07-24T16:24:57.233764+0000","last_fullsized":"2024-07-24T16:24:57.233764+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.256647+0000","last_change":"2024-07-24T16:24:57.251715+0000","last_active":"2024-07-24T16:24:57.256647+0000","last_peered":"2024-07-24T16:24:57.256647+0000","last_clean":"2024-07-24T16:24:57.256647+0000","last_became_active":"2024-07-24T16:24:57.251432+0000","last_became_peered":"2024-07-24T16:24:57.251432+0000","last_unstale":"2024-07-24T16:24:57.256647+0000","last_undegraded":"2024-07-24T16:24:57.256647+0000","last_fullsized":"2024-07-24T16:24:57.256647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241467+0000","last_change":"2024-07-24T16:24:57.241467+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241467+0000","last_undegraded":"2024-07-24T16:24:57.241467+0000","last_fullsized":"2024-07-24T16:24:57.241467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252185+0000","last_change":"2024-07-24T16:24:57.250429+0000","last_active":"2024-07-24T16:24:57.252185+0000","last_peered":"2024-07-24T16:24:57.252185+0000","last_clean":"2024-07-24T16:24:57.252185+0000","last_became_active":"2024-07-24T16:24:57.250254+0000","last_became_peered":"2024-07-24T16:24:57.250254+0000","last_unstale":"2024-07-24T16:24:57.252185+0000","last_undegraded":"2024-07-24T16:24:57.252185+0000","last_fullsized":"2024-07-24T16:24:57.252185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:51.538511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234731+0000","last_change":"2024-07-24T16:24:57.234731+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234731+0000","last_undegraded":"2024-07-24T16:24:57.234731+0000","last_fullsized":"2024-07-24T16:24:57.234731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.249775+0000","last_change":"2024-07-24T16:24:57.244665+0000","last_active":"2024-07-24T16:24:57.249775+0000","last_peered":"2024-07-24T16:24:57.249775+0000","last_clean":"2024-07-24T16:24:57.249775+0000","last_became_active":"2024-07-24T16:24:57.244293+0000","last_became_peered":"2024-07-24T16:24:57.244293+0000","last_unstale":"2024-07-24T16:24:57.249775+0000","last_undegraded":"2024-07-24T16:24:57.249775+0000","last_fullsized":"2024-07-24T16:24:57.249775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:09:53.165693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232619+0000","last_change":"2024-07-24T16:24:57.232619+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232619+0000","last_undegraded":"2024-07-24T16:24:57.232619+0000","last_fullsized":"2024-07-24T16:24:57.232619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.246943+0000","last_change":"2024-07-24T16:24:57.243037+0000","last_active":"2024-07-24T16:24:57.246943+0000","last_peered":"2024-07-24T16:24:57.246943+0000","last_clean":"2024-07-24T16:24:57.246943+0000","last_became_active":"2024-07-24T16:24:57.242776+0000","last_became_peered":"2024-07-24T16:24:57.242776+0000","last_unstale":"2024-07-24T16:24:57.246943+0000","last_undegraded":"2024-07-24T16:24:57.246943+0000","last_fullsized":"2024-07-24T16:24:57.246943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:28:36.598035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234621+0000","last_change":"2024-07-24T16:24:57.234621+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234621+0000","last_undegraded":"2024-07-24T16:24:57.234621+0000","last_fullsized":"2024-07-24T16:24:57.234621+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248424+0000","last_change":"2024-07-24T16:24:57.239764+0000","last_active":"2024-07-24T16:24:57.248424+0000","last_peered":"2024-07-24T16:24:57.248424+0000","last_clean":"2024-07-24T16:24:57.248424+0000","last_became_active":"2024-07-24T16:24:57.239454+0000","last_became_peered":"2024-07-24T16:24:57.239454+0000","last_unstale":"2024-07-24T16:24:57.248424+0000","last_undegraded":"2024-07-24T16:24:57.248424+0000","last_fullsized":"2024-07-24T16:24:57.248424+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:26:13.775005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238068+0000","last_change":"2024-07-24T16:24:57.238068+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238068+0000","last_undegraded":"2024-07-24T16:24:57.238068+0000","last_fullsized":"2024-07-24T16:24:57.238068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250284+0000","last_change":"2024-07-24T16:24:57.247349+0000","last_active":"2024-07-24T16:24:57.250284+0000","last_peered":"2024-07-24T16:24:57.250284+0000","last_clean":"2024-07-24T16:24:57.250284+0000","last_became_active":"2024-07-24T16:24:57.246965+0000","last_became_peered":"2024-07-24T16:24:57.246965+0000","last_unstale":"2024-07-24T16:24:57.250284+0000","last_undegraded":"2024-07-24T16:24:57.250284+0000","last_fullsized":"2024-07-24T16:24:57.250284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":133,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.235180+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:24:57.235180+0000","last_peered":"2024-07-24T16:24:57.235180+0000","last_clean":"2024-07-24T16:24:57.235180+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:24:57.235180+0000","last_undegraded":"2024-07-24T16:24:57.235180+0000","last_fullsized":"2024-07-24T16:24:57.235180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":751434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":154399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":154399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":154399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":744767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:25:01.613 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:25:01.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.750+0000 7f9dc6a11640 1 -- 172.21.15.159:0/1348205424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da8003a50 msgr2=0x7f9da8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.750+0000 7f9dc6a11640 1 --2- 172.21.15.159:0/1348205424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da8003a50 0x7f9da8003e70 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f9db0006fd0 tx=0x7f9da8005830 comp rx=0 tx=0).stop 2024-07-24T16:25:01.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.750+0000 7f9dc6a11640 1 -- 172.21.15.159:0/1348205424 shutdown_connections 2024-07-24T16:25:01.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.750+0000 7f9dc6a11640 1 --2- 172.21.15.159:0/1348205424 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9da8003a50 0x7f9da8003e70 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.750+0000 7f9dc6a11640 1 -- 172.21.15.159:0/1348205424 >> 172.21.15.159:0/1348205424 conn(0x7f9dc006c560 msgr2=0x7f9dc006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:01.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.750+0000 7f9dc6a11640 1 -- 172.21.15.159:0/1348205424 shutdown_connections 2024-07-24T16:25:01.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.750+0000 7f9dc6a11640 1 -- 172.21.15.159:0/1348205424 wait complete. 2024-07-24T16:25:01.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.751+0000 7f9dc6a11640 1 Processor -- start 2024-07-24T16:25:01.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.752+0000 7f9dc6a11640 1 -- start start 2024-07-24T16:25:01.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.752+0000 7f9dc6a11640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9da8003a50 0x7f9dc0153430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:01.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.752+0000 7f9dc6a11640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc00aba70 0x7f9dc00a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:01.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.752+0000 7f9dc6a11640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dc00aa3b0 0x7f9dc0156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:01.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.752+0000 7f9dc6a11640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc0159540 con 0x7f9dc00aba70 2024-07-24T16:25:01.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.752+0000 7f9dc6a11640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9dc01593c0 con 0x7f9dc00aa3b0 2024-07-24T16:25:01.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.752+0000 7f9dc6a11640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9dc00cf320 con 0x7f9da8003a50 2024-07-24T16:25:01.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.752+0000 7f9dbf7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc00aba70 0x7f9dc00a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:01.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.752+0000 7f9dbf7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc00aba70 0x7f9dc00a9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43322/0 (socket says 172.21.15.159:43322) 2024-07-24T16:25:01.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.752+0000 7f9dbf7fe640 1 -- 172.21.15.159:0/2173208029 learned_addr learned my addr 172.21.15.159:0/2173208029 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:01.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dbffff640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9da8003a50 0x7f9dc0153430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:01.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dc4fae640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dc00aa3b0 0x7f9dc0156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:01.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dbf7fe640 1 -- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9da8003a50 msgr2=0x7f9dc0153430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dbf7fe640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9da8003a50 0x7f9dc0153430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dbf7fe640 1 -- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dc00aa3b0 msgr2=0x7f9dc0156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dbf7fe640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dc00aa3b0 0x7f9dc0156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dbf7fe640 1 -- 172.21.15.159:0/2173208029 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dc0153970 con 0x7f9dc00aba70 2024-07-24T16:25:01.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dbffff640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9da8003a50 0x7f9dc0153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:25:01.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dc4fae640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dc00aa3b0 0x7f9dc0156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:25:01.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dbf7fe640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc00aba70 0x7f9dc00a9e70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9db4011ae0 tx=0x7f9db4009eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:01.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dbcff9640 1 -- 172.21.15.159:0/2173208029 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db401e070 con 0x7f9dc00aba70 2024-07-24T16:25:01.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dbcff9640 1 -- 172.21.15.159:0/2173208029 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9db400fc10 con 0x7f9dc00aba70 2024-07-24T16:25:01.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dc6a11640 1 -- 172.21.15.159:0/2173208029 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dc01f3280 con 0x7f9dc00aba70 2024-07-24T16:25:01.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dbcff9640 1 -- 172.21.15.159:0/2173208029 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db4019410 con 0x7f9dc00aba70 2024-07-24T16:25:01.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.753+0000 7f9dc6a11640 1 -- 172.21.15.159:0/2173208029 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dc01f3840 con 0x7f9dc00aba70 2024-07-24T16:25:01.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.754+0000 7f9dc6a11640 1 -- 172.21.15.159:0/2173208029 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dc006d670 con 0x7f9dc00aba70 2024-07-24T16:25:01.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.755+0000 7f9dbcff9640 1 -- 172.21.15.159:0/2173208029 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f9db4021070 con 0x7f9dc00aba70 2024-07-24T16:25:01.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.755+0000 7f9dbcff9640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9dac077010 0x7f9dac0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:01.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.755+0000 7f9dbcff9640 1 -- 172.21.15.159:0/2173208029 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f9db4099070 con 0x7f9dc00aba70 2024-07-24T16:25:01.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.755+0000 7f9dbffff640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9dac077010 0x7f9dac0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:01.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.756+0000 7f9dbffff640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9dac077010 0x7f9dac0794d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9db0033000 tx=0x7f9dc015f720 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:01.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.759+0000 7f9dbcff9640 1 -- 172.21.15.159:0/2173208029 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f9db4061b20 con 0x7f9dc00aba70 2024-07-24T16:25:01.911 INFO:tasks.ceph.mds.a.smithi159.stderr:2024-07-24T16:25:01.909+0000 7fdcee20b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-24T16:25:01.942 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.939+0000 7f9dc6a11640 1 -- 172.21.15.159:0/2173208029 --> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9dc015a600 con 0x7f9dac077010 2024-07-24T16:25:01.946 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.944+0000 7f9dbcff9640 1 -- 172.21.15.159:0/2173208029 <== mgr.4103 v2:172.21.15.193:6832/222319347 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246651 (secure 0 0 0) 0x7f9db0081390 con 0x7f9dac077010 2024-07-24T16:25:01.949 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:25:01.950 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:25:01.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.947+0000 7f9dc6a11640 1 -- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9dac077010 msgr2=0x7f9dac0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.947+0000 7f9dc6a11640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9dac077010 0x7f9dac0794d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9db0033000 tx=0x7f9dc015f720 comp rx=0 tx=0).stop 2024-07-24T16:25:01.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.947+0000 7f9dc6a11640 1 -- 172.21.15.159:0/2173208029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc00aba70 msgr2=0x7f9dc00a9e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:01.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.947+0000 7f9dc6a11640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc00aba70 0x7f9dc00a9e70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f9db4011ae0 tx=0x7f9db4009eb0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.947+0000 7f9dc6a11640 1 -- 172.21.15.159:0/2173208029 shutdown_connections 2024-07-24T16:25:01.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.947+0000 7f9dc6a11640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9dac077010 0x7f9dac0794d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.947+0000 7f9dc6a11640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dc00aa3b0 0x7f9dc0156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.947+0000 7f9dc6a11640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dc00aba70 0x7f9dc00a9e70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.947+0000 7f9dc6a11640 1 --2- 172.21.15.159:0/2173208029 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9da8003a50 0x7f9dc0153430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:01.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.947+0000 7f9dc6a11640 1 -- 172.21.15.159:0/2173208029 >> 172.21.15.159:0/2173208029 conn(0x7f9dc006c560 msgr2=0x7f9dc01596c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:01.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.947+0000 7f9dc6a11640 1 -- 172.21.15.159:0/2173208029 shutdown_connections 2024-07-24T16:25:01.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:01.947+0000 7f9dc6a11640 1 -- 172.21.15.159:0/2173208029 wait complete. 2024-07-24T16:25:01.960 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2024-07-24T16:25:00.374743+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220324,"kb_used_data":4152,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754396,"statfs":{"total":773094113280,"available":772868501504,"internally_reserved":0,"allocated":4251648,"data_stored":2442596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.151724"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238072+0000","last_change":"2024-07-24T16:24:57.238072+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238072+0000","last_undegraded":"2024-07-24T16:24:57.238072+0000","last_fullsized":"2024-07-24T16:24:57.238072+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237601+0000","last_change":"2024-07-24T16:24:57.237601+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237601+0000","last_undegraded":"2024-07-24T16:24:57.237601+0000","last_fullsized":"2024-07-24T16:24:57.237601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241140+0000","last_change":"2024-07-24T16:24:57.241140+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241140+0000","last_undegraded":"2024-07-24T16:24:57.241140+0000","last_fullsized":"2024-07-24T16:24:57.241140+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236609+0000","last_change":"2024-07-24T16:24:57.236609+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236609+0000","last_undegraded":"2024-07-24T16:24:57.236609+0000","last_fullsized":"2024-07-24T16:24:57.236609+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237318+0000","last_change":"2024-07-24T16:24:57.237318+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237318+0000","last_undegraded":"2024-07-24T16:24:57.237318+0000","last_fullsized":"2024-07-24T16:24:57.237318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235075+0000","last_change":"2024-07-24T16:24:57.235075+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235075+0000","last_undegraded":"2024-07-24T16:24:57.235075+0000","last_fullsized":"2024-07-24T16:24:57.235075+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235951+0000","last_change":"2024-07-24T16:24:57.235951+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235951+0000","last_undegraded":"2024-07-24T16:24:57.235951+0000","last_fullsized":"2024-07-24T16:24:57.235951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237138+0000","last_change":"2024-07-24T16:24:57.237138+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237138+0000","last_undegraded":"2024-07-24T16:24:57.237138+0000","last_fullsized":"2024-07-24T16:24:57.237138+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239769+0000","last_change":"2024-07-24T16:24:57.239769+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239769+0000","last_undegraded":"2024-07-24T16:24:57.239769+0000","last_fullsized":"2024-07-24T16:24:57.239769+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236925+0000","last_change":"2024-07-24T16:24:57.236925+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236925+0000","last_undegraded":"2024-07-24T16:24:57.236925+0000","last_fullsized":"2024-07-24T16:24:57.236925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239132+0000","last_change":"2024-07-24T16:24:57.239132+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239132+0000","last_undegraded":"2024-07-24T16:24:57.239132+0000","last_fullsized":"2024-07-24T16:24:57.239132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.240696+0000","last_change":"2024-07-24T16:24:57.240696+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.240696+0000","last_undegraded":"2024-07-24T16:24:57.240696+0000","last_fullsized":"2024-07-24T16:24:57.240696+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238291+0000","last_change":"2024-07-24T16:24:57.238291+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238291+0000","last_undegraded":"2024-07-24T16:24:57.238291+0000","last_fullsized":"2024-07-24T16:24:57.238291+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233515+0000","last_change":"2024-07-24T16:24:57.233515+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233515+0000","last_undegraded":"2024-07-24T16:24:57.233515+0000","last_fullsized":"2024-07-24T16:24:57.233515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235497+0000","last_change":"2024-07-24T16:24:57.235497+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235497+0000","last_undegraded":"2024-07-24T16:24:57.235497+0000","last_fullsized":"2024-07-24T16:24:57.235497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232777+0000","last_change":"2024-07-24T16:24:57.232777+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232777+0000","last_undegraded":"2024-07-24T16:24:57.232777+0000","last_fullsized":"2024-07-24T16:24:57.232777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234368+0000","last_change":"2024-07-24T16:24:57.234368+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234368+0000","last_undegraded":"2024-07-24T16:24:57.234368+0000","last_fullsized":"2024-07-24T16:24:57.234368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238629+0000","last_change":"2024-07-24T16:24:57.238629+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238629+0000","last_undegraded":"2024-07-24T16:24:57.238629+0000","last_fullsized":"2024-07-24T16:24:57.238629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238246+0000","last_change":"2024-07-24T16:24:57.238246+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238246+0000","last_undegraded":"2024-07-24T16:24:57.238246+0000","last_fullsized":"2024-07-24T16:24:57.238246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.240318+0000","last_change":"2024-07-24T16:24:57.240318+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.240318+0000","last_undegraded":"2024-07-24T16:24:57.240318+0000","last_fullsized":"2024-07-24T16:24:57.240318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237867+0000","last_change":"2024-07-24T16:24:57.237867+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237867+0000","last_undegraded":"2024-07-24T16:24:57.237867+0000","last_fullsized":"2024-07-24T16:24:57.237867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233049+0000","last_change":"2024-07-24T16:24:57.233049+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233049+0000","last_undegraded":"2024-07-24T16:24:57.233049+0000","last_fullsized":"2024-07-24T16:24:57.233049+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233898+0000","last_change":"2024-07-24T16:24:57.233898+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233898+0000","last_undegraded":"2024-07-24T16:24:57.233898+0000","last_fullsized":"2024-07-24T16:24:57.233898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238241+0000","last_change":"2024-07-24T16:24:57.238241+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238241+0000","last_undegraded":"2024-07-24T16:24:57.238241+0000","last_fullsized":"2024-07-24T16:24:57.238241+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.243721+0000","last_change":"2024-07-24T16:24:57.243721+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.243721+0000","last_undegraded":"2024-07-24T16:24:57.243721+0000","last_fullsized":"2024-07-24T16:24:57.243721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238407+0000","last_change":"2024-07-24T16:24:57.238407+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238407+0000","last_undegraded":"2024-07-24T16:24:57.238407+0000","last_fullsized":"2024-07-24T16:24:57.238407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241095+0000","last_change":"2024-07-24T16:24:57.241095+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241095+0000","last_undegraded":"2024-07-24T16:24:57.241095+0000","last_fullsized":"2024-07-24T16:24:57.241095+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237042+0000","last_change":"2024-07-24T16:24:57.237042+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237042+0000","last_undegraded":"2024-07-24T16:24:57.237042+0000","last_fullsized":"2024-07-24T16:24:57.237042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.242307+0000","last_change":"2024-07-24T16:24:57.242307+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.242307+0000","last_undegraded":"2024-07-24T16:24:57.242307+0000","last_fullsized":"2024-07-24T16:24:57.242307+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237099+0000","last_change":"2024-07-24T16:24:57.237099+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237099+0000","last_undegraded":"2024-07-24T16:24:57.237099+0000","last_fullsized":"2024-07-24T16:24:57.237099+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233235+0000","last_change":"2024-07-24T16:24:57.233235+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233235+0000","last_undegraded":"2024-07-24T16:24:57.233235+0000","last_fullsized":"2024-07-24T16:24:57.233235+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236797+0000","last_change":"2024-07-24T16:24:57.236797+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236797+0000","last_undegraded":"2024-07-24T16:24:57.236797+0000","last_fullsized":"2024-07-24T16:24:57.236797+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232989+0000","last_change":"2024-07-24T16:24:57.232989+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232989+0000","last_undegraded":"2024-07-24T16:24:57.232989+0000","last_fullsized":"2024-07-24T16:24:57.232989+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250427+0000","last_change":"2024-07-24T16:24:57.248705+0000","last_active":"2024-07-24T16:24:57.250427+0000","last_peered":"2024-07-24T16:24:57.250427+0000","last_clean":"2024-07-24T16:24:57.250427+0000","last_became_active":"2024-07-24T16:24:57.247318+0000","last_became_peered":"2024-07-24T16:24:57.247318+0000","last_unstale":"2024-07-24T16:24:57.250427+0000","last_undegraded":"2024-07-24T16:24:57.250427+0000","last_fullsized":"2024-07-24T16:24:57.250427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:41.244903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235709+0000","last_change":"2024-07-24T16:24:57.235709+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235709+0000","last_undegraded":"2024-07-24T16:24:57.235709+0000","last_fullsized":"2024-07-24T16:24:57.235709+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248881+0000","last_change":"2024-07-24T16:24:57.245395+0000","last_active":"2024-07-24T16:24:57.248881+0000","last_peered":"2024-07-24T16:24:57.248881+0000","last_clean":"2024-07-24T16:24:57.248881+0000","last_became_active":"2024-07-24T16:24:57.245020+0000","last_became_peered":"2024-07-24T16:24:57.245020+0000","last_unstale":"2024-07-24T16:24:57.248881+0000","last_undegraded":"2024-07-24T16:24:57.248881+0000","last_fullsized":"2024-07-24T16:24:57.248881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:46:07.474602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232148+0000","last_change":"2024-07-24T16:24:57.232148+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232148+0000","last_undegraded":"2024-07-24T16:24:57.232148+0000","last_fullsized":"2024-07-24T16:24:57.232148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252122+0000","last_change":"2024-07-24T16:24:57.246910+0000","last_active":"2024-07-24T16:24:57.252122+0000","last_peered":"2024-07-24T16:24:57.252122+0000","last_clean":"2024-07-24T16:24:57.252122+0000","last_became_active":"2024-07-24T16:24:57.246638+0000","last_became_peered":"2024-07-24T16:24:57.246638+0000","last_unstale":"2024-07-24T16:24:57.252122+0000","last_undegraded":"2024-07-24T16:24:57.252122+0000","last_fullsized":"2024-07-24T16:24:57.252122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:51.538511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237176+0000","last_change":"2024-07-24T16:24:57.237176+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237176+0000","last_undegraded":"2024-07-24T16:24:57.237176+0000","last_fullsized":"2024-07-24T16:24:57.237176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.246256+0000","last_change":"2024-07-24T16:24:57.242358+0000","last_active":"2024-07-24T16:24:57.246256+0000","last_peered":"2024-07-24T16:24:57.246256+0000","last_clean":"2024-07-24T16:24:57.246256+0000","last_became_active":"2024-07-24T16:24:57.242040+0000","last_became_peered":"2024-07-24T16:24:57.242040+0000","last_unstale":"2024-07-24T16:24:57.246256+0000","last_undegraded":"2024-07-24T16:24:57.246256+0000","last_fullsized":"2024-07-24T16:24:57.246256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:15:07.269777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.242278+0000","last_change":"2024-07-24T16:24:57.242278+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.242278+0000","last_undegraded":"2024-07-24T16:24:57.242278+0000","last_fullsized":"2024-07-24T16:24:57.242278+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.249387+0000","last_change":"2024-07-24T16:24:57.247796+0000","last_active":"2024-07-24T16:24:57.249387+0000","last_peered":"2024-07-24T16:24:57.249387+0000","last_clean":"2024-07-24T16:24:57.249387+0000","last_became_active":"2024-07-24T16:24:57.247526+0000","last_became_peered":"2024-07-24T16:24:57.247526+0000","last_unstale":"2024-07-24T16:24:57.249387+0000","last_undegraded":"2024-07-24T16:24:57.249387+0000","last_fullsized":"2024-07-24T16:24:57.249387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:50.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235001+0000","last_change":"2024-07-24T16:24:57.235001+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235001+0000","last_undegraded":"2024-07-24T16:24:57.235001+0000","last_fullsized":"2024-07-24T16:24:57.235001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.242229+0000","last_change":"2024-07-24T16:24:57.239638+0000","last_active":"2024-07-24T16:24:57.242229+0000","last_peered":"2024-07-24T16:24:57.242229+0000","last_clean":"2024-07-24T16:24:57.242229+0000","last_became_active":"2024-07-24T16:24:57.239216+0000","last_became_peered":"2024-07-24T16:24:57.239216+0000","last_unstale":"2024-07-24T16:24:57.242229+0000","last_undegraded":"2024-07-24T16:24:57.242229+0000","last_fullsized":"2024-07-24T16:24:57.242229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232190+0000","last_change":"2024-07-24T16:24:57.232190+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232190+0000","last_undegraded":"2024-07-24T16:24:57.232190+0000","last_fullsized":"2024-07-24T16:24:57.232190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252216+0000","last_change":"2024-07-24T16:24:57.247845+0000","last_active":"2024-07-24T16:24:57.252216+0000","last_peered":"2024-07-24T16:24:57.252216+0000","last_clean":"2024-07-24T16:24:57.252216+0000","last_became_active":"2024-07-24T16:24:57.247357+0000","last_became_peered":"2024-07-24T16:24:57.247357+0000","last_unstale":"2024-07-24T16:24:57.252216+0000","last_undegraded":"2024-07-24T16:24:57.252216+0000","last_fullsized":"2024-07-24T16:24:57.252216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235898+0000","last_change":"2024-07-24T16:24:57.235898+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235898+0000","last_undegraded":"2024-07-24T16:24:57.235898+0000","last_fullsized":"2024-07-24T16:24:57.235898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.246190+0000","last_change":"2024-07-24T16:24:57.242475+0000","last_active":"2024-07-24T16:24:57.246190+0000","last_peered":"2024-07-24T16:24:57.246190+0000","last_clean":"2024-07-24T16:24:57.246190+0000","last_became_active":"2024-07-24T16:24:57.242192+0000","last_became_peered":"2024-07-24T16:24:57.242192+0000","last_unstale":"2024-07-24T16:24:57.246190+0000","last_undegraded":"2024-07-24T16:24:57.246190+0000","last_fullsized":"2024-07-24T16:24:57.246190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:11:26.761665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236183+0000","last_change":"2024-07-24T16:24:57.236183+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236183+0000","last_undegraded":"2024-07-24T16:24:57.236183+0000","last_fullsized":"2024-07-24T16:24:57.236183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248310+0000","last_change":"2024-07-24T16:24:57.239691+0000","last_active":"2024-07-24T16:24:57.248310+0000","last_peered":"2024-07-24T16:24:57.248310+0000","last_clean":"2024-07-24T16:24:57.248310+0000","last_became_active":"2024-07-24T16:24:57.239430+0000","last_became_peered":"2024-07-24T16:24:57.239430+0000","last_unstale":"2024-07-24T16:24:57.248310+0000","last_undegraded":"2024-07-24T16:24:57.248310+0000","last_fullsized":"2024-07-24T16:24:57.248310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:36:59.542494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234227+0000","last_change":"2024-07-24T16:24:57.234227+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234227+0000","last_undegraded":"2024-07-24T16:24:57.234227+0000","last_fullsized":"2024-07-24T16:24:57.234227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.247935+0000","last_change":"2024-07-24T16:24:57.246040+0000","last_active":"2024-07-24T16:24:57.247935+0000","last_peered":"2024-07-24T16:24:57.247935+0000","last_clean":"2024-07-24T16:24:57.247935+0000","last_became_active":"2024-07-24T16:24:57.245741+0000","last_became_peered":"2024-07-24T16:24:57.245741+0000","last_unstale":"2024-07-24T16:24:57.247935+0000","last_undegraded":"2024-07-24T16:24:57.247935+0000","last_fullsized":"2024-07-24T16:24:57.247935+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239300+0000","last_change":"2024-07-24T16:24:57.239300+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239300+0000","last_undegraded":"2024-07-24T16:24:57.239300+0000","last_fullsized":"2024-07-24T16:24:57.239300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.253527+0000","last_change":"2024-07-24T16:24:57.252143+0000","last_active":"2024-07-24T16:24:57.253527+0000","last_peered":"2024-07-24T16:24:57.253527+0000","last_clean":"2024-07-24T16:24:57.253527+0000","last_became_active":"2024-07-24T16:24:57.251822+0000","last_became_peered":"2024-07-24T16:24:57.251822+0000","last_unstale":"2024-07-24T16:24:57.253527+0000","last_undegraded":"2024-07-24T16:24:57.253527+0000","last_fullsized":"2024-07-24T16:24:57.253527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:16:33.614437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.231847+0000","last_change":"2024-07-24T16:24:57.231847+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.231847+0000","last_undegraded":"2024-07-24T16:24:57.231847+0000","last_fullsized":"2024-07-24T16:24:57.231847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.240743+0000","last_change":"2024-07-24T16:24:57.237331+0000","last_active":"2024-07-24T16:24:57.240743+0000","last_peered":"2024-07-24T16:24:57.240743+0000","last_clean":"2024-07-24T16:24:57.240743+0000","last_became_active":"2024-07-24T16:24:57.237045+0000","last_became_peered":"2024-07-24T16:24:57.237045+0000","last_unstale":"2024-07-24T16:24:57.240743+0000","last_undegraded":"2024-07-24T16:24:57.240743+0000","last_fullsized":"2024-07-24T16:24:57.240743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:05:44.263080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241850+0000","last_change":"2024-07-24T16:24:57.241850+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241850+0000","last_undegraded":"2024-07-24T16:24:57.241850+0000","last_fullsized":"2024-07-24T16:24:57.241850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251261+0000","last_change":"2024-07-24T16:24:57.248002+0000","last_active":"2024-07-24T16:24:57.251261+0000","last_peered":"2024-07-24T16:24:57.251261+0000","last_clean":"2024-07-24T16:24:57.251261+0000","last_became_active":"2024-07-24T16:24:57.247736+0000","last_became_peered":"2024-07-24T16:24:57.247736+0000","last_unstale":"2024-07-24T16:24:57.251261+0000","last_undegraded":"2024-07-24T16:24:57.251261+0000","last_fullsized":"2024-07-24T16:24:57.251261+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:44:19.124214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234781+0000","last_change":"2024-07-24T16:24:57.234781+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234781+0000","last_undegraded":"2024-07-24T16:24:57.234781+0000","last_fullsized":"2024-07-24T16:24:57.234781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252154+0000","last_change":"2024-07-24T16:24:57.247616+0000","last_active":"2024-07-24T16:24:57.252154+0000","last_peered":"2024-07-24T16:24:57.252154+0000","last_clean":"2024-07-24T16:24:57.252154+0000","last_became_active":"2024-07-24T16:24:57.247334+0000","last_became_peered":"2024-07-24T16:24:57.247334+0000","last_unstale":"2024-07-24T16:24:57.252154+0000","last_undegraded":"2024-07-24T16:24:57.252154+0000","last_fullsized":"2024-07-24T16:24:57.252154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233217+0000","last_change":"2024-07-24T16:24:57.233217+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233217+0000","last_undegraded":"2024-07-24T16:24:57.233217+0000","last_fullsized":"2024-07-24T16:24:57.233217+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250982+0000","last_change":"2024-07-24T16:24:57.250024+0000","last_active":"2024-07-24T16:24:57.250982+0000","last_peered":"2024-07-24T16:24:57.250982+0000","last_clean":"2024-07-24T16:24:57.250982+0000","last_became_active":"2024-07-24T16:24:57.249723+0000","last_became_peered":"2024-07-24T16:24:57.249723+0000","last_unstale":"2024-07-24T16:24:57.250982+0000","last_undegraded":"2024-07-24T16:24:57.250982+0000","last_fullsized":"2024-07-24T16:24:57.250982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:12.087663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235430+0000","last_change":"2024-07-24T16:24:57.235430+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235430+0000","last_undegraded":"2024-07-24T16:24:57.235430+0000","last_fullsized":"2024-07-24T16:24:57.235430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.239610+0000","last_change":"2024-07-24T16:24:57.238606+0000","last_active":"2024-07-24T16:24:57.239610+0000","last_peered":"2024-07-24T16:24:57.239610+0000","last_clean":"2024-07-24T16:24:57.239610+0000","last_became_active":"2024-07-24T16:24:57.238268+0000","last_became_peered":"2024-07-24T16:24:57.238268+0000","last_unstale":"2024-07-24T16:24:57.239610+0000","last_undegraded":"2024-07-24T16:24:57.239610+0000","last_fullsized":"2024-07-24T16:24:57.239610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:51.538511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234290+0000","last_change":"2024-07-24T16:24:57.234290+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234290+0000","last_undegraded":"2024-07-24T16:24:57.234290+0000","last_fullsized":"2024-07-24T16:24:57.234290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248589+0000","last_change":"2024-07-24T16:24:57.247263+0000","last_active":"2024-07-24T16:24:57.248589+0000","last_peered":"2024-07-24T16:24:57.248589+0000","last_clean":"2024-07-24T16:24:57.248589+0000","last_became_active":"2024-07-24T16:24:57.246829+0000","last_became_peered":"2024-07-24T16:24:57.246829+0000","last_unstale":"2024-07-24T16:24:57.248589+0000","last_undegraded":"2024-07-24T16:24:57.248589+0000","last_fullsized":"2024-07-24T16:24:57.248589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238678+0000","last_change":"2024-07-24T16:24:57.238678+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238678+0000","last_undegraded":"2024-07-24T16:24:57.238678+0000","last_fullsized":"2024-07-24T16:24:57.238678+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248784+0000","last_change":"2024-07-24T16:24:57.246981+0000","last_active":"2024-07-24T16:24:57.248784+0000","last_peered":"2024-07-24T16:24:57.248784+0000","last_clean":"2024-07-24T16:24:57.248784+0000","last_became_active":"2024-07-24T16:24:57.246677+0000","last_became_peered":"2024-07-24T16:24:57.246677+0000","last_unstale":"2024-07-24T16:24:57.248784+0000","last_undegraded":"2024-07-24T16:24:57.248784+0000","last_fullsized":"2024-07-24T16:24:57.248784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:46:07.474602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234413+0000","last_change":"2024-07-24T16:24:57.234413+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234413+0000","last_undegraded":"2024-07-24T16:24:57.234413+0000","last_fullsized":"2024-07-24T16:24:57.234413+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251566+0000","last_change":"2024-07-24T16:24:57.246148+0000","last_active":"2024-07-24T16:24:57.251566+0000","last_peered":"2024-07-24T16:24:57.251566+0000","last_clean":"2024-07-24T16:24:57.251566+0000","last_became_active":"2024-07-24T16:24:57.245850+0000","last_became_peered":"2024-07-24T16:24:57.245850+0000","last_unstale":"2024-07-24T16:24:57.251566+0000","last_undegraded":"2024-07-24T16:24:57.251566+0000","last_fullsized":"2024-07-24T16:24:57.251566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:34:36.379487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235713+0000","last_change":"2024-07-24T16:24:57.235713+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235713+0000","last_undegraded":"2024-07-24T16:24:57.235713+0000","last_fullsized":"2024-07-24T16:24:57.235713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251085+0000","last_change":"2024-07-24T16:24:57.244659+0000","last_active":"2024-07-24T16:24:57.251085+0000","last_peered":"2024-07-24T16:24:57.251085+0000","last_clean":"2024-07-24T16:24:57.251085+0000","last_became_active":"2024-07-24T16:24:57.244361+0000","last_became_peered":"2024-07-24T16:24:57.244361+0000","last_unstale":"2024-07-24T16:24:57.251085+0000","last_undegraded":"2024-07-24T16:24:57.251085+0000","last_fullsized":"2024-07-24T16:24:57.251085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:46:07.474602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232220+0000","last_change":"2024-07-24T16:24:57.232220+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232220+0000","last_undegraded":"2024-07-24T16:24:57.232220+0000","last_fullsized":"2024-07-24T16:24:57.232220+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.253915+0000","last_change":"2024-07-24T16:24:57.249844+0000","last_active":"2024-07-24T16:24:57.253915+0000","last_peered":"2024-07-24T16:24:57.253915+0000","last_clean":"2024-07-24T16:24:57.253915+0000","last_became_active":"2024-07-24T16:24:57.249555+0000","last_became_peered":"2024-07-24T16:24:57.249555+0000","last_unstale":"2024-07-24T16:24:57.253915+0000","last_undegraded":"2024-07-24T16:24:57.253915+0000","last_fullsized":"2024-07-24T16:24:57.253915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:50:55.883018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.240246+0000","last_change":"2024-07-24T16:24:57.240246+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.240246+0000","last_undegraded":"2024-07-24T16:24:57.240246+0000","last_fullsized":"2024-07-24T16:24:57.240246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251531+0000","last_change":"2024-07-24T16:24:57.247926+0000","last_active":"2024-07-24T16:24:57.251531+0000","last_peered":"2024-07-24T16:24:57.251531+0000","last_clean":"2024-07-24T16:24:57.251531+0000","last_became_active":"2024-07-24T16:24:57.247680+0000","last_became_peered":"2024-07-24T16:24:57.247680+0000","last_unstale":"2024-07-24T16:24:57.251531+0000","last_undegraded":"2024-07-24T16:24:57.251531+0000","last_fullsized":"2024-07-24T16:24:57.251531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:00:31.435044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239293+0000","last_change":"2024-07-24T16:24:57.239293+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239293+0000","last_undegraded":"2024-07-24T16:24:57.239293+0000","last_fullsized":"2024-07-24T16:24:57.239293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250249+0000","last_change":"2024-07-24T16:24:57.248109+0000","last_active":"2024-07-24T16:24:57.250249+0000","last_peered":"2024-07-24T16:24:57.250249+0000","last_clean":"2024-07-24T16:24:57.250249+0000","last_became_active":"2024-07-24T16:24:57.247809+0000","last_became_peered":"2024-07-24T16:24:57.247809+0000","last_unstale":"2024-07-24T16:24:57.250249+0000","last_undegraded":"2024-07-24T16:24:57.250249+0000","last_fullsized":"2024-07-24T16:24:57.250249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:50.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234303+0000","last_change":"2024-07-24T16:24:57.234303+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234303+0000","last_undegraded":"2024-07-24T16:24:57.234303+0000","last_fullsized":"2024-07-24T16:24:57.234303+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251540+0000","last_change":"2024-07-24T16:24:57.247519+0000","last_active":"2024-07-24T16:24:57.251540+0000","last_peered":"2024-07-24T16:24:57.251540+0000","last_clean":"2024-07-24T16:24:57.251540+0000","last_became_active":"2024-07-24T16:24:57.247224+0000","last_became_peered":"2024-07-24T16:24:57.247224+0000","last_unstale":"2024-07-24T16:24:57.251540+0000","last_undegraded":"2024-07-24T16:24:57.251540+0000","last_fullsized":"2024-07-24T16:24:57.251540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:03:31.080074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235291+0000","last_change":"2024-07-24T16:24:57.235291+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235291+0000","last_undegraded":"2024-07-24T16:24:57.235291+0000","last_fullsized":"2024-07-24T16:24:57.235291+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252625+0000","last_change":"2024-07-24T16:24:57.251681+0000","last_active":"2024-07-24T16:24:57.252625+0000","last_peered":"2024-07-24T16:24:57.252625+0000","last_clean":"2024-07-24T16:24:57.252625+0000","last_became_active":"2024-07-24T16:24:57.251383+0000","last_became_peered":"2024-07-24T16:24:57.251383+0000","last_unstale":"2024-07-24T16:24:57.252625+0000","last_undegraded":"2024-07-24T16:24:57.252625+0000","last_fullsized":"2024-07-24T16:24:57.252625+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:40.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232319+0000","last_change":"2024-07-24T16:24:57.232319+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232319+0000","last_undegraded":"2024-07-24T16:24:57.232319+0000","last_fullsized":"2024-07-24T16:24:57.232319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.253877+0000","last_change":"2024-07-24T16:24:57.249314+0000","last_active":"2024-07-24T16:24:57.253877+0000","last_peered":"2024-07-24T16:24:57.253877+0000","last_clean":"2024-07-24T16:24:57.253877+0000","last_became_active":"2024-07-24T16:24:57.249068+0000","last_became_peered":"2024-07-24T16:24:57.249068+0000","last_unstale":"2024-07-24T16:24:57.253877+0000","last_undegraded":"2024-07-24T16:24:57.253877+0000","last_fullsized":"2024-07-24T16:24:57.253877+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:49:44.981927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233764+0000","last_change":"2024-07-24T16:24:57.233764+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233764+0000","last_undegraded":"2024-07-24T16:24:57.233764+0000","last_fullsized":"2024-07-24T16:24:57.233764+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.256647+0000","last_change":"2024-07-24T16:24:57.251715+0000","last_active":"2024-07-24T16:24:57.256647+0000","last_peered":"2024-07-24T16:24:57.256647+0000","last_clean":"2024-07-24T16:24:57.256647+0000","last_became_active":"2024-07-24T16:24:57.251432+0000","last_became_peered":"2024-07-24T16:24:57.251432+0000","last_unstale":"2024-07-24T16:24:57.256647+0000","last_undegraded":"2024-07-24T16:24:57.256647+0000","last_fullsized":"2024-07-24T16:24:57.256647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241467+0000","last_change":"2024-07-24T16:24:57.241467+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241467+0000","last_undegraded":"2024-07-24T16:24:57.241467+0000","last_fullsized":"2024-07-24T16:24:57.241467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252185+0000","last_change":"2024-07-24T16:24:57.250429+0000","last_active":"2024-07-24T16:24:57.252185+0000","last_peered":"2024-07-24T16:24:57.252185+0000","last_clean":"2024-07-24T16:24:57.252185+0000","last_became_active":"2024-07-24T16:24:57.250254+0000","last_became_peered":"2024-07-24T16:24:57.250254+0000","last_unstale":"2024-07-24T16:24:57.252185+0000","last_undegraded":"2024-07-24T16:24:57.252185+0000","last_fullsized":"2024-07-24T16:24:57.252185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:51.538511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234731+0000","last_change":"2024-07-24T16:24:57.234731+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234731+0000","last_undegraded":"2024-07-24T16:24:57.234731+0000","last_fullsized":"2024-07-24T16:24:57.234731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.249775+0000","last_change":"2024-07-24T16:24:57.244665+0000","last_active":"2024-07-24T16:24:57.249775+0000","last_peered":"2024-07-24T16:24:57.249775+0000","last_clean":"2024-07-24T16:24:57.249775+0000","last_became_active":"2024-07-24T16:24:57.244293+0000","last_became_peered":"2024-07-24T16:24:57.244293+0000","last_unstale":"2024-07-24T16:24:57.249775+0000","last_undegraded":"2024-07-24T16:24:57.249775+0000","last_fullsized":"2024-07-24T16:24:57.249775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:09:53.165693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232619+0000","last_change":"2024-07-24T16:24:57.232619+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232619+0000","last_undegraded":"2024-07-24T16:24:57.232619+0000","last_fullsized":"2024-07-24T16:24:57.232619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.246943+0000","last_change":"2024-07-24T16:24:57.243037+0000","last_active":"2024-07-24T16:24:57.246943+0000","last_peered":"2024-07-24T16:24:57.246943+0000","last_clean":"2024-07-24T16:24:57.246943+0000","last_became_active":"2024-07-24T16:24:57.242776+0000","last_became_peered":"2024-07-24T16:24:57.242776+0000","last_unstale":"2024-07-24T16:24:57.246943+0000","last_undegraded":"2024-07-24T16:24:57.246943+0000","last_fullsized":"2024-07-24T16:24:57.246943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:28:36.598035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234621+0000","last_change":"2024-07-24T16:24:57.234621+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234621+0000","last_undegraded":"2024-07-24T16:24:57.234621+0000","last_fullsized":"2024-07-24T16:24:57.234621+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248424+0000","last_change":"2024-07-24T16:24:57.239764+0000","last_active":"2024-07-24T16:24:57.248424+0000","last_peered":"2024-07-24T16:24:57.248424+0000","last_clean":"2024-07-24T16:24:57.248424+0000","last_became_active":"2024-07-24T16:24:57.239454+0000","last_became_peered":"2024-07-24T16:24:57.239454+0000","last_unstale":"2024-07-24T16:24:57.248424+0000","last_undegraded":"2024-07-24T16:24:57.248424+0000","last_fullsized":"2024-07-24T16:24:57.248424+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:26:13.775005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238068+0000","last_change":"2024-07-24T16:24:57.238068+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238068+0000","last_undegraded":"2024-07-24T16:24:57.238068+0000","last_fullsized":"2024-07-24T16:24:57.238068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250284+0000","last_change":"2024-07-24T16:24:57.247349+0000","last_active":"2024-07-24T16:24:57.250284+0000","last_peered":"2024-07-24T16:24:57.250284+0000","last_clean":"2024-07-24T16:24:57.250284+0000","last_became_active":"2024-07-24T16:24:57.246965+0000","last_became_peered":"2024-07-24T16:24:57.246965+0000","last_unstale":"2024-07-24T16:24:57.250284+0000","last_undegraded":"2024-07-24T16:24:57.250284+0000","last_fullsized":"2024-07-24T16:24:57.250284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":133,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.235180+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:24:57.235180+0000","last_peered":"2024-07-24T16:24:57.235180+0000","last_clean":"2024-07-24T16:24:57.235180+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:24:57.235180+0000","last_undegraded":"2024-07-24T16:24:57.235180+0000","last_fullsized":"2024-07-24T16:24:57.235180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":751434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":154399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":154399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":154399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":744767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:25:01.964 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3f is not active+clean 2024-07-24T16:25:01.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.238072+0000', 'last_change': '2024-07-24T16:24:57.238072+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.238072+0000', 'last_undegraded': '2024-07-24T16:24:57.238072+0000', 'last_fullsized': '2024-07-24T16:24:57.238072+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-24T16:25:01.964 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3e is not active+clean 2024-07-24T16:25:01.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.237601+0000', 'last_change': '2024-07-24T16:24:57.237601+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.237601+0000', 'last_undegraded': '2024-07-24T16:24:57.237601+0000', 'last_fullsized': '2024-07-24T16:24:57.237601+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-24T16:25:01.964 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3d is not active+clean 2024-07-24T16:25:01.964 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.241140+0000', 'last_change': '2024-07-24T16:24:57.241140+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.241140+0000', 'last_undegraded': '2024-07-24T16:24:57.241140+0000', 'last_fullsized': '2024-07-24T16:24:57.241140+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-24T16:25:01.965 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3c is not active+clean 2024-07-24T16:25:01.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.236609+0000', 'last_change': '2024-07-24T16:24:57.236609+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.236609+0000', 'last_undegraded': '2024-07-24T16:24:57.236609+0000', 'last_fullsized': '2024-07-24T16:24:57.236609+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-24T16:25:01.965 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3b is not active+clean 2024-07-24T16:25:01.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.237318+0000', 'last_change': '2024-07-24T16:24:57.237318+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.237318+0000', 'last_undegraded': '2024-07-24T16:24:57.237318+0000', 'last_fullsized': '2024-07-24T16:24:57.237318+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-24T16:25:01.965 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3a is not active+clean 2024-07-24T16:25:01.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.235075+0000', 'last_change': '2024-07-24T16:24:57.235075+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.235075+0000', 'last_undegraded': '2024-07-24T16:24:57.235075+0000', 'last_fullsized': '2024-07-24T16:24:57.235075+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-07-24T16:25:01.965 INFO:tasks.ceph.ceph_manager.ceph:PG 6.39 is not active+clean 2024-07-24T16:25:01.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.235951+0000', 'last_change': '2024-07-24T16:24:57.235951+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.235951+0000', 'last_undegraded': '2024-07-24T16:24:57.235951+0000', 'last_fullsized': '2024-07-24T16:24:57.235951+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-24T16:25:01.965 INFO:tasks.ceph.ceph_manager.ceph:PG 6.38 is not active+clean 2024-07-24T16:25:01.965 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.237138+0000', 'last_change': '2024-07-24T16:24:57.237138+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.237138+0000', 'last_undegraded': '2024-07-24T16:24:57.237138+0000', 'last_fullsized': '2024-07-24T16:24:57.237138+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-24T16:25:01.965 INFO:tasks.ceph.ceph_manager.ceph:PG 6.37 is not active+clean 2024-07-24T16:25:01.966 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.239769+0000', 'last_change': '2024-07-24T16:24:57.239769+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.239769+0000', 'last_undegraded': '2024-07-24T16:24:57.239769+0000', 'last_fullsized': '2024-07-24T16:24:57.239769+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-24T16:25:01.966 INFO:tasks.ceph.ceph_manager.ceph:PG 6.36 is not active+clean 2024-07-24T16:25:01.966 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.236925+0000', 'last_change': '2024-07-24T16:24:57.236925+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.236925+0000', 'last_undegraded': '2024-07-24T16:24:57.236925+0000', 'last_fullsized': '2024-07-24T16:24:57.236925+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-24T16:25:01.966 INFO:tasks.ceph.ceph_manager.ceph:PG 6.35 is not active+clean 2024-07-24T16:25:01.966 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.239132+0000', 'last_change': '2024-07-24T16:24:57.239132+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.239132+0000', 'last_undegraded': '2024-07-24T16:24:57.239132+0000', 'last_fullsized': '2024-07-24T16:24:57.239132+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-24T16:25:01.966 INFO:tasks.ceph.ceph_manager.ceph:PG 6.34 is not active+clean 2024-07-24T16:25:01.966 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.240696+0000', 'last_change': '2024-07-24T16:24:57.240696+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.240696+0000', 'last_undegraded': '2024-07-24T16:24:57.240696+0000', 'last_fullsized': '2024-07-24T16:24:57.240696+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-24T16:25:01.966 INFO:tasks.ceph.ceph_manager.ceph:PG 6.33 is not active+clean 2024-07-24T16:25:01.966 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.238291+0000', 'last_change': '2024-07-24T16:24:57.238291+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.238291+0000', 'last_undegraded': '2024-07-24T16:24:57.238291+0000', 'last_fullsized': '2024-07-24T16:24:57.238291+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-24T16:25:01.966 INFO:tasks.ceph.ceph_manager.ceph:PG 6.32 is not active+clean 2024-07-24T16:25:01.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.233515+0000', 'last_change': '2024-07-24T16:24:57.233515+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.233515+0000', 'last_undegraded': '2024-07-24T16:24:57.233515+0000', 'last_fullsized': '2024-07-24T16:24:57.233515+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-07-24T16:25:01.967 INFO:tasks.ceph.ceph_manager.ceph:PG 6.31 is not active+clean 2024-07-24T16:25:01.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.235497+0000', 'last_change': '2024-07-24T16:24:57.235497+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.235497+0000', 'last_undegraded': '2024-07-24T16:24:57.235497+0000', 'last_fullsized': '2024-07-24T16:24:57.235497+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-24T16:25:01.967 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-07-24T16:25:01.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.232777+0000', 'last_change': '2024-07-24T16:24:57.232777+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.232777+0000', 'last_undegraded': '2024-07-24T16:24:57.232777+0000', 'last_fullsized': '2024-07-24T16:24:57.232777+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-24T16:25:01.967 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-07-24T16:25:01.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.234368+0000', 'last_change': '2024-07-24T16:24:57.234368+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.234368+0000', 'last_undegraded': '2024-07-24T16:24:57.234368+0000', 'last_fullsized': '2024-07-24T16:24:57.234368+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-24T16:25:01.967 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-07-24T16:25:01.967 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.238629+0000', 'last_change': '2024-07-24T16:24:57.238629+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.238629+0000', 'last_undegraded': '2024-07-24T16:24:57.238629+0000', 'last_fullsized': '2024-07-24T16:24:57.238629+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-07-24T16:25:01.967 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-07-24T16:25:01.968 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.238246+0000', 'last_change': '2024-07-24T16:24:57.238246+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.238246+0000', 'last_undegraded': '2024-07-24T16:24:57.238246+0000', 'last_fullsized': '2024-07-24T16:24:57.238246+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-24T16:25:01.968 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-07-24T16:25:01.968 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.240318+0000', 'last_change': '2024-07-24T16:24:57.240318+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.240318+0000', 'last_undegraded': '2024-07-24T16:24:57.240318+0000', 'last_fullsized': '2024-07-24T16:24:57.240318+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-07-24T16:25:01.968 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2b is not active+clean 2024-07-24T16:25:01.968 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.237867+0000', 'last_change': '2024-07-24T16:24:57.237867+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.237867+0000', 'last_undegraded': '2024-07-24T16:24:57.237867+0000', 'last_fullsized': '2024-07-24T16:24:57.237867+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-24T16:25:01.968 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2a is not active+clean 2024-07-24T16:25:01.968 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.233049+0000', 'last_change': '2024-07-24T16:24:57.233049+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.233049+0000', 'last_undegraded': '2024-07-24T16:24:57.233049+0000', 'last_fullsized': '2024-07-24T16:24:57.233049+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-07-24T16:25:01.968 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-07-24T16:25:01.968 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.233898+0000', 'last_change': '2024-07-24T16:24:57.233898+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.233898+0000', 'last_undegraded': '2024-07-24T16:24:57.233898+0000', 'last_fullsized': '2024-07-24T16:24:57.233898+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-24T16:25:01.968 INFO:tasks.ceph.ceph_manager.ceph:PG 6.28 is not active+clean 2024-07-24T16:25:01.968 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.238241+0000', 'last_change': '2024-07-24T16:24:57.238241+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.238241+0000', 'last_undegraded': '2024-07-24T16:24:57.238241+0000', 'last_fullsized': '2024-07-24T16:24:57.238241+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-24T16:25:01.969 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-07-24T16:25:01.969 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.243721+0000', 'last_change': '2024-07-24T16:24:57.243721+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.243721+0000', 'last_undegraded': '2024-07-24T16:24:57.243721+0000', 'last_fullsized': '2024-07-24T16:24:57.243721+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-07-24T16:25:01.969 INFO:tasks.ceph.ceph_manager.ceph:PG 6.26 is not active+clean 2024-07-24T16:25:01.969 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.238407+0000', 'last_change': '2024-07-24T16:24:57.238407+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.238407+0000', 'last_undegraded': '2024-07-24T16:24:57.238407+0000', 'last_fullsized': '2024-07-24T16:24:57.238407+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-07-24T16:25:01.969 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-07-24T16:25:01.969 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.241095+0000', 'last_change': '2024-07-24T16:24:57.241095+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.241095+0000', 'last_undegraded': '2024-07-24T16:24:57.241095+0000', 'last_fullsized': '2024-07-24T16:24:57.241095+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-07-24T16:25:01.969 INFO:tasks.ceph.ceph_manager.ceph:PG 6.24 is not active+clean 2024-07-24T16:25:01.969 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.237042+0000', 'last_change': '2024-07-24T16:24:57.237042+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.237042+0000', 'last_undegraded': '2024-07-24T16:24:57.237042+0000', 'last_fullsized': '2024-07-24T16:24:57.237042+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-24T16:25:01.969 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-07-24T16:25:01.969 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.242307+0000', 'last_change': '2024-07-24T16:24:57.242307+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.242307+0000', 'last_undegraded': '2024-07-24T16:24:57.242307+0000', 'last_fullsized': '2024-07-24T16:24:57.242307+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-07-24T16:25:01.969 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-07-24T16:25:01.969 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.237099+0000', 'last_change': '2024-07-24T16:24:57.237099+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.237099+0000', 'last_undegraded': '2024-07-24T16:24:57.237099+0000', 'last_fullsized': '2024-07-24T16:24:57.237099+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-07-24T16:25:01.970 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-07-24T16:25:01.970 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.233235+0000', 'last_change': '2024-07-24T16:24:57.233235+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.233235+0000', 'last_undegraded': '2024-07-24T16:24:57.233235+0000', 'last_fullsized': '2024-07-24T16:24:57.233235+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-24T16:25:01.970 INFO:tasks.ceph.ceph_manager.ceph:PG 6.20 is not active+clean 2024-07-24T16:25:01.970 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.236797+0000', 'last_change': '2024-07-24T16:24:57.236797+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.236797+0000', 'last_undegraded': '2024-07-24T16:24:57.236797+0000', 'last_fullsized': '2024-07-24T16:24:57.236797+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-07-24T16:25:01.970 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-07-24T16:25:01.970 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.232989+0000', 'last_change': '2024-07-24T16:24:57.232989+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.232989+0000', 'last_undegraded': '2024-07-24T16:24:57.232989+0000', 'last_fullsized': '2024-07-24T16:24:57.232989+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-24T16:25:01.970 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1d is not active+clean 2024-07-24T16:25:01.970 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.235709+0000', 'last_change': '2024-07-24T16:24:57.235709+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.235709+0000', 'last_undegraded': '2024-07-24T16:24:57.235709+0000', 'last_fullsized': '2024-07-24T16:24:57.235709+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-07-24T16:25:01.972 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-07-24T16:25:01.972 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.232148+0000', 'last_change': '2024-07-24T16:24:57.232148+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.232148+0000', 'last_undegraded': '2024-07-24T16:24:57.232148+0000', 'last_fullsized': '2024-07-24T16:24:57.232148+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-07-24T16:25:01.972 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-07-24T16:25:01.972 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.237176+0000', 'last_change': '2024-07-24T16:24:57.237176+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.237176+0000', 'last_undegraded': '2024-07-24T16:24:57.237176+0000', 'last_fullsized': '2024-07-24T16:24:57.237176+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-24T16:25:01.972 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-07-24T16:25:01.972 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.242278+0000', 'last_change': '2024-07-24T16:24:57.242278+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.242278+0000', 'last_undegraded': '2024-07-24T16:24:57.242278+0000', 'last_fullsized': '2024-07-24T16:24:57.242278+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-24T16:25:01.972 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-07-24T16:25:01.972 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.235001+0000', 'last_change': '2024-07-24T16:24:57.235001+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.235001+0000', 'last_undegraded': '2024-07-24T16:24:57.235001+0000', 'last_fullsized': '2024-07-24T16:24:57.235001+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-24T16:25:01.972 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-07-24T16:25:01.972 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.232190+0000', 'last_change': '2024-07-24T16:24:57.232190+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.232190+0000', 'last_undegraded': '2024-07-24T16:24:57.232190+0000', 'last_fullsized': '2024-07-24T16:24:57.232190+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-07-24T16:25:01.973 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-07-24T16:25:01.973 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.235898+0000', 'last_change': '2024-07-24T16:24:57.235898+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.235898+0000', 'last_undegraded': '2024-07-24T16:24:57.235898+0000', 'last_fullsized': '2024-07-24T16:24:57.235898+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-24T16:25:01.973 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-07-24T16:25:01.973 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.236183+0000', 'last_change': '2024-07-24T16:24:57.236183+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.236183+0000', 'last_undegraded': '2024-07-24T16:24:57.236183+0000', 'last_fullsized': '2024-07-24T16:24:57.236183+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-24T16:25:01.973 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-07-24T16:25:01.973 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.234227+0000', 'last_change': '2024-07-24T16:24:57.234227+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.234227+0000', 'last_undegraded': '2024-07-24T16:24:57.234227+0000', 'last_fullsized': '2024-07-24T16:24:57.234227+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-24T16:25:01.973 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-07-24T16:25:01.973 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.239300+0000', 'last_change': '2024-07-24T16:24:57.239300+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.239300+0000', 'last_undegraded': '2024-07-24T16:24:57.239300+0000', 'last_fullsized': '2024-07-24T16:24:57.239300+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-24T16:25:01.973 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-07-24T16:25:01.973 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.231847+0000', 'last_change': '2024-07-24T16:24:57.231847+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.231847+0000', 'last_undegraded': '2024-07-24T16:24:57.231847+0000', 'last_fullsized': '2024-07-24T16:24:57.231847+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-07-24T16:25:01.973 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-07-24T16:25:01.974 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.241850+0000', 'last_change': '2024-07-24T16:24:57.241850+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.241850+0000', 'last_undegraded': '2024-07-24T16:24:57.241850+0000', 'last_fullsized': '2024-07-24T16:24:57.241850+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-24T16:25:01.974 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-07-24T16:25:01.974 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.234781+0000', 'last_change': '2024-07-24T16:24:57.234781+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.234781+0000', 'last_undegraded': '2024-07-24T16:24:57.234781+0000', 'last_fullsized': '2024-07-24T16:24:57.234781+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-24T16:25:01.974 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-07-24T16:25:01.974 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.233217+0000', 'last_change': '2024-07-24T16:24:57.233217+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.233217+0000', 'last_undegraded': '2024-07-24T16:24:57.233217+0000', 'last_fullsized': '2024-07-24T16:24:57.233217+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-24T16:25:01.974 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-07-24T16:25:01.974 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.235430+0000', 'last_change': '2024-07-24T16:24:57.235430+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.235430+0000', 'last_undegraded': '2024-07-24T16:24:57.235430+0000', 'last_fullsized': '2024-07-24T16:24:57.235430+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-24T16:25:01.974 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-07-24T16:25:01.974 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.234290+0000', 'last_change': '2024-07-24T16:24:57.234290+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.234290+0000', 'last_undegraded': '2024-07-24T16:24:57.234290+0000', 'last_fullsized': '2024-07-24T16:24:57.234290+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-24T16:25:01.974 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-07-24T16:25:01.975 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.238678+0000', 'last_change': '2024-07-24T16:24:57.238678+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.238678+0000', 'last_undegraded': '2024-07-24T16:24:57.238678+0000', 'last_fullsized': '2024-07-24T16:24:57.238678+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-24T16:25:01.975 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-07-24T16:25:01.975 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.234413+0000', 'last_change': '2024-07-24T16:24:57.234413+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.234413+0000', 'last_undegraded': '2024-07-24T16:24:57.234413+0000', 'last_fullsized': '2024-07-24T16:24:57.234413+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-07-24T16:25:01.975 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-07-24T16:25:01.975 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.235713+0000', 'last_change': '2024-07-24T16:24:57.235713+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.235713+0000', 'last_undegraded': '2024-07-24T16:24:57.235713+0000', 'last_fullsized': '2024-07-24T16:24:57.235713+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-07-24T16:25:01.975 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-07-24T16:25:01.975 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.232220+0000', 'last_change': '2024-07-24T16:24:57.232220+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.232220+0000', 'last_undegraded': '2024-07-24T16:24:57.232220+0000', 'last_fullsized': '2024-07-24T16:24:57.232220+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-24T16:25:01.975 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-07-24T16:25:01.975 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.240246+0000', 'last_change': '2024-07-24T16:24:57.240246+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.240246+0000', 'last_undegraded': '2024-07-24T16:24:57.240246+0000', 'last_fullsized': '2024-07-24T16:24:57.240246+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-24T16:25:01.975 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-07-24T16:25:01.975 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.239293+0000', 'last_change': '2024-07-24T16:24:57.239293+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.239293+0000', 'last_undegraded': '2024-07-24T16:24:57.239293+0000', 'last_fullsized': '2024-07-24T16:24:57.239293+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-24T16:25:01.976 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-07-24T16:25:01.976 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.234303+0000', 'last_change': '2024-07-24T16:24:57.234303+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.234303+0000', 'last_undegraded': '2024-07-24T16:24:57.234303+0000', 'last_fullsized': '2024-07-24T16:24:57.234303+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-24T16:25:01.976 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-07-24T16:25:01.976 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.235291+0000', 'last_change': '2024-07-24T16:24:57.235291+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.235291+0000', 'last_undegraded': '2024-07-24T16:24:57.235291+0000', 'last_fullsized': '2024-07-24T16:24:57.235291+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-07-24T16:25:01.976 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-07-24T16:25:01.976 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.232319+0000', 'last_change': '2024-07-24T16:24:57.232319+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.232319+0000', 'last_undegraded': '2024-07-24T16:24:57.232319+0000', 'last_fullsized': '2024-07-24T16:24:57.232319+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-24T16:25:01.976 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-07-24T16:25:01.976 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.233764+0000', 'last_change': '2024-07-24T16:24:57.233764+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.233764+0000', 'last_undegraded': '2024-07-24T16:24:57.233764+0000', 'last_fullsized': '2024-07-24T16:24:57.233764+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-07-24T16:25:01.976 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-07-24T16:25:01.976 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.241467+0000', 'last_change': '2024-07-24T16:24:57.241467+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.241467+0000', 'last_undegraded': '2024-07-24T16:24:57.241467+0000', 'last_fullsized': '2024-07-24T16:24:57.241467+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-07-24T16:25:01.977 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-07-24T16:25:01.977 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.234731+0000', 'last_change': '2024-07-24T16:24:57.234731+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.234731+0000', 'last_undegraded': '2024-07-24T16:24:57.234731+0000', 'last_fullsized': '2024-07-24T16:24:57.234731+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-07-24T16:25:01.977 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-07-24T16:25:01.977 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.232619+0000', 'last_change': '2024-07-24T16:24:57.232619+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.232619+0000', 'last_undegraded': '2024-07-24T16:24:57.232619+0000', 'last_fullsized': '2024-07-24T16:24:57.232619+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-07-24T16:25:01.977 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-07-24T16:25:01.977 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.234621+0000', 'last_change': '2024-07-24T16:24:57.234621+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.234621+0000', 'last_undegraded': '2024-07-24T16:24:57.234621+0000', 'last_fullsized': '2024-07-24T16:24:57.234621+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-07-24T16:25:01.977 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-07-24T16:25:01.977 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 34, 'state': 'creating+peering', 'last_fresh': '2024-07-24T16:24:57.238068+0000', 'last_change': '2024-07-24T16:24:57.238068+0000', 'last_active': '2024-07-24T16:24:57.221433+0000', 'last_peered': '2024-07-24T16:24:57.221433+0000', 'last_clean': '2024-07-24T16:24:57.221433+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-07-24T16:24:57.238068+0000', 'last_undegraded': '2024-07-24T16:24:57.238068+0000', 'last_fullsized': '2024-07-24T16:24:57.238068+0000', 'mapping_epoch': 34, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 34, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'last_clean_scrub_stamp': '2024-07-24T16:24:57.221433+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-07-24T16:25:01.978 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-07-24T16:25:02.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.099+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/2331037892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9d41524f0 msgr2=0x7fb9d40af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:02.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.099+0000 7fb9dc4e9640 1 --2- 172.21.15.159:0/2331037892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9d41524f0 0x7fb9d40af020 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0009900 tx=0x7fb9d002a560 comp rx=0 tx=0).stop 2024-07-24T16:25:02.102 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.099+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/2331037892 shutdown_connections 2024-07-24T16:25:02.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.099+0000 7fb9dc4e9640 1 --2- 172.21.15.159:0/2331037892 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9d40cf840 0x7fb9d40cca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.099+0000 7fb9dc4e9640 1 --2- 172.21.15.159:0/2331037892 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9d41524f0 0x7fb9d40af020 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.099+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/2331037892 >> 172.21.15.159:0/2331037892 conn(0x7fb9d406d450 msgr2=0x7fb9d406d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:02.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.100+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/2331037892 shutdown_connections 2024-07-24T16:25:02.103 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.100+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/2331037892 wait complete. 2024-07-24T16:25:02.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.101+0000 7fb9dc4e9640 1 Processor -- start 2024-07-24T16:25:02.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.101+0000 7fb9dc4e9640 1 -- start start 2024-07-24T16:25:02.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.101+0000 7fb9dc4e9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9d40ccf60 0x7fb9d41e78f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:02.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.101+0000 7fb9dc4e9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9d40cf840 0x7fb9d41e7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:02.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.101+0000 7fb9dc4e9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9d41524f0 0x7fb9d413e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:02.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.101+0000 7fb9dc4e9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d415cc60 con 0x7fb9d41524f0 2024-07-24T16:25:02.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.101+0000 7fb9dc4e9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb9d415cae0 con 0x7fb9d40cf840 2024-07-24T16:25:02.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.101+0000 7fb9dc4e9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb9d415f6d0 con 0x7fb9d40ccf60 2024-07-24T16:25:02.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9daa86640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9d41524f0 0x7fb9d413e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:02.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9daa86640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9d41524f0 0x7fb9d413e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43340/0 (socket says 172.21.15.159:43340) 2024-07-24T16:25:02.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9daa86640 1 -- 172.21.15.159:0/4128065780 learned_addr learned my addr 172.21.15.159:0/4128065780 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:02.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9da285640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9d40ccf60 0x7fb9d41e78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:02.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9d9a84640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9d40cf840 0x7fb9d41e7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:02.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9daa86640 1 -- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9d40ccf60 msgr2=0x7fb9d41e78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:02.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9daa86640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9d40ccf60 0x7fb9d41e78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9daa86640 1 -- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9d40cf840 msgr2=0x7fb9d41e7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:02.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9daa86640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9d40cf840 0x7fb9d41e7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9daa86640 1 -- 172.21.15.159:0/4128065780 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9d415e220 con 0x7fb9d41524f0 2024-07-24T16:25:02.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9d9a84640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9d40cf840 0x7fb9d41e7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:25:02.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9da285640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9d40ccf60 0x7fb9d41e78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:25:02.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9daa86640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9d41524f0 0x7fb9d413e090 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00c780 tx=0x7fb9cc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:02.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9c6ffd640 1 -- 172.21.15.159:0/4128065780 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc004b60 con 0x7fb9d41524f0 2024-07-24T16:25:02.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9c6ffd640 1 -- 172.21.15.159:0/4128065780 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9cc004df0 con 0x7fb9d41524f0 2024-07-24T16:25:02.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9c6ffd640 1 -- 172.21.15.159:0/4128065780 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc00aa70 con 0x7fb9d41524f0 2024-07-24T16:25:02.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/4128065780 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9d415e500 con 0x7fb9d41524f0 2024-07-24T16:25:02.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.102+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/4128065780 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9d414f7c0 con 0x7fb9d41524f0 2024-07-24T16:25:02.107 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.103+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/4128065780 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9d415e740 con 0x7fb9d41524f0 2024-07-24T16:25:02.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.104+0000 7fb9c6ffd640 1 -- 172.21.15.159:0/4128065780 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb9cc00ac10 con 0x7fb9d41524f0 2024-07-24T16:25:02.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.104+0000 7fb9c6ffd640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb9b8077010 0x7fb9b80794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:02.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.104+0000 7fb9c6ffd640 1 -- 172.21.15.159:0/4128065780 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fb9cc098d50 con 0x7fb9d41524f0 2024-07-24T16:25:02.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.105+0000 7fb9da285640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb9b8077010 0x7fb9b80794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:02.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.105+0000 7fb9da285640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb9b8077010 0x7fb9b80794d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0033000 tx=0x7fb9d0004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:02.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.108+0000 7fb9c6ffd640 1 -- 172.21.15.159:0/4128065780 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fb9d415e740 con 0x7fb9d41524f0 2024-07-24T16:25:02.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.364+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/4128065780 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fb9d415faa0 con 0x7fb9d41524f0 2024-07-24T16:25:02.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.364+0000 7fb9c6ffd640 1 -- 172.21.15.159:0/4128065780 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1623 (secure 0 0 0) 0x7fb9cc09c030 con 0x7fb9d41524f0 2024-07-24T16:25:02.367 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:25:02.367 INFO:teuthology.orchestra.run.smithi159.stdout:{"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":76,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":36,"num_osds":8,"num_up_osds":8,"osd_up_since":1721838237,"num_in_osds":8,"osd_in_since":1721838229,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225611776,"bytes_avail":772868501504,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":16,"btime":"2024-07-24T16:25:00:240907+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4998}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2024-07-24T16:24:58.374452+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-07-24T16:25:02.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.367+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb9b8077010 msgr2=0x7fb9b80794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:02.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.367+0000 7fb9dc4e9640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb9b8077010 0x7fb9b80794d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0033000 tx=0x7fb9d0004730 comp rx=0 tx=0).stop 2024-07-24T16:25:02.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.367+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/4128065780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9d41524f0 msgr2=0x7fb9d413e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:02.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.367+0000 7fb9dc4e9640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9d41524f0 0x7fb9d413e090 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc00c780 tx=0x7fb9cc00cc40 comp rx=0 tx=0).stop 2024-07-24T16:25:02.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.367+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/4128065780 shutdown_connections 2024-07-24T16:25:02.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.367+0000 7fb9dc4e9640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb9b8077010 0x7fb9b80794d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.367+0000 7fb9dc4e9640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9d41524f0 0x7fb9d413e090 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.367+0000 7fb9dc4e9640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9d40cf840 0x7fb9d41e7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.367+0000 7fb9dc4e9640 1 --2- 172.21.15.159:0/4128065780 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9d40ccf60 0x7fb9d41e78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.367+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/4128065780 >> 172.21.15.159:0/4128065780 conn(0x7fb9d406d450 msgr2=0x7fb9d40b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:02.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.367+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/4128065780 shutdown_connections 2024-07-24T16:25:02.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.367+0000 7fb9dc4e9640 1 -- 172.21.15.159:0/4128065780 wait complete. 2024-07-24T16:25:02.380 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-07-24T16:25:02.380 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:25:02.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.480+0000 7fa077be8640 1 -- 172.21.15.159:0/1246526186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa070070120 msgr2=0x7fa0700af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:02.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.480+0000 7fa077be8640 1 --2- 172.21.15.159:0/1246526186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa070070120 0x7fa0700af7f0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fa06c005fd0 tx=0x7fa06c02a540 comp rx=0 tx=0).stop 2024-07-24T16:25:02.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.480+0000 7fa077be8640 1 -- 172.21.15.159:0/1246526186 shutdown_connections 2024-07-24T16:25:02.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.480+0000 7fa077be8640 1 --2- 172.21.15.159:0/1246526186 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa07006c560 0x7fa07006c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.480+0000 7fa077be8640 1 --2- 172.21.15.159:0/1246526186 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa070070120 0x7fa0700af7f0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.480+0000 7fa077be8640 1 -- 172.21.15.159:0/1246526186 >> 172.21.15.159:0/1246526186 conn(0x7fa0700b2230 msgr2=0x7fa0700b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:02.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.480+0000 7fa077be8640 1 -- 172.21.15.159:0/1246526186 shutdown_connections 2024-07-24T16:25:02.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.480+0000 7fa077be8640 1 -- 172.21.15.159:0/1246526186 wait complete. 2024-07-24T16:25:02.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.481+0000 7fa077be8640 1 Processor -- start 2024-07-24T16:25:02.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.481+0000 7fa077be8640 1 -- start start 2024-07-24T16:25:02.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa077be8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa07006c560 0x7fa07015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:02.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa077be8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa070070120 0x7fa070153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:02.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa077be8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0700709a0 0x7fa070154590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:02.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa077be8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa070072cd0 con 0x7fa07006c560 2024-07-24T16:25:02.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa077be8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa070072b50 con 0x7fa070070120 2024-07-24T16:25:02.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa077be8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa070072e50 con 0x7fa0700709a0 2024-07-24T16:25:02.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa075984640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa07006c560 0x7fa07015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:02.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa075984640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa07006c560 0x7fa07015baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43366/0 (socket says 172.21.15.159:43366) 2024-07-24T16:25:02.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa075984640 1 -- 172.21.15.159:0/1605839209 learned_addr learned my addr 172.21.15.159:0/1605839209 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:02.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa075984640 1 -- 172.21.15.159:0/1605839209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0700709a0 msgr2=0x7fa070154590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:02.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa075984640 1 --2- 172.21.15.159:0/1605839209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0700709a0 0x7fa070154590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa075984640 1 -- 172.21.15.159:0/1605839209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa070070120 msgr2=0x7fa070153930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:02.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa075984640 1 --2- 172.21.15.159:0/1605839209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa070070120 0x7fa070153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa075984640 1 -- 172.21.15.159:0/1605839209 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0701f4410 con 0x7fa07006c560 2024-07-24T16:25:02.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa075984640 1 --2- 172.21.15.159:0/1605839209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa07006c560 0x7fa07015baa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa06c009850 tx=0x7fa06c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:02.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa0667fc640 1 -- 172.21.15.159:0/1605839209 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c03f070 con 0x7fa07006c560 2024-07-24T16:25:02.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa0667fc640 1 -- 172.21.15.159:0/1605839209 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa06c004890 con 0x7fa07006c560 2024-07-24T16:25:02.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa0667fc640 1 -- 172.21.15.159:0/1605839209 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa06c035030 con 0x7fa07006c560 2024-07-24T16:25:02.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa077be8640 1 -- 172.21.15.159:0/1605839209 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0701f4750 con 0x7fa07006c560 2024-07-24T16:25:02.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.482+0000 7fa077be8640 1 -- 172.21.15.159:0/1605839209 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa070153e70 con 0x7fa07006c560 2024-07-24T16:25:02.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.484+0000 7fa077be8640 1 -- 172.21.15.159:0/1605839209 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0700733e0 con 0x7fa07006c560 2024-07-24T16:25:02.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.484+0000 7fa0667fc640 1 -- 172.21.15.159:0/1605839209 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fa06c042070 con 0x7fa07006c560 2024-07-24T16:25:02.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.484+0000 7fa0667fc640 1 --2- 172.21.15.159:0/1605839209 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa054077010 0x7fa0540794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:02.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.485+0000 7fa0667fc640 1 -- 172.21.15.159:0/1605839209 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fa06c0b98e0 con 0x7fa07006c560 2024-07-24T16:25:02.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.485+0000 7fa075183640 1 --2- 172.21.15.159:0/1605839209 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa054077010 0x7fa0540794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:02.488 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.485+0000 7fa075183640 1 --2- 172.21.15.159:0/1605839209 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa054077010 0x7fa0540794d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa07015da80 tx=0x7fa060007970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:02.491 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.488+0000 7fa0667fc640 1 -- 172.21.15.159:0/1605839209 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa0701f4750 con 0x7fa07006c560 2024-07-24T16:25:02.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.668+0000 7fa077be8640 1 -- 172.21.15.159:0/1605839209 --> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa0701608a0 con 0x7fa054077010 2024-07-24T16:25:02.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.673+0000 7fa0667fc640 1 -- 172.21.15.159:0/1605839209 <== mgr.4103 v2:172.21.15.193:6832/222319347 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246651 (secure 0 0 0) 0x7fa0701608a0 con 0x7fa054077010 2024-07-24T16:25:02.678 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:25:02.679 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:25:02.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.676+0000 7fa077be8640 1 -- 172.21.15.159:0/1605839209 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa054077010 msgr2=0x7fa0540794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:02.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.676+0000 7fa077be8640 1 --2- 172.21.15.159:0/1605839209 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa054077010 0x7fa0540794d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa07015da80 tx=0x7fa060007970 comp rx=0 tx=0).stop 2024-07-24T16:25:02.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.676+0000 7fa077be8640 1 -- 172.21.15.159:0/1605839209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa07006c560 msgr2=0x7fa07015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:02.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.676+0000 7fa077be8640 1 --2- 172.21.15.159:0/1605839209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa07006c560 0x7fa07015baa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa06c009850 tx=0x7fa06c0039e0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.676+0000 7fa077be8640 1 -- 172.21.15.159:0/1605839209 shutdown_connections 2024-07-24T16:25:02.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.676+0000 7fa077be8640 1 --2- 172.21.15.159:0/1605839209 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa054077010 0x7fa0540794d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.676+0000 7fa077be8640 1 --2- 172.21.15.159:0/1605839209 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0700709a0 0x7fa070154590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.676+0000 7fa077be8640 1 --2- 172.21.15.159:0/1605839209 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa070070120 0x7fa070153930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.676+0000 7fa077be8640 1 --2- 172.21.15.159:0/1605839209 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa07006c560 0x7fa07015baa0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:02.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.676+0000 7fa077be8640 1 -- 172.21.15.159:0/1605839209 >> 172.21.15.159:0/1605839209 conn(0x7fa0700b2230 msgr2=0x7fa0701611c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:02.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.676+0000 7fa077be8640 1 -- 172.21.15.159:0/1605839209 shutdown_connections 2024-07-24T16:25:02.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:02.676+0000 7fa077be8640 1 -- 172.21.15.159:0/1605839209 wait complete. 2024-07-24T16:25:02.689 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-07-24T16:25:02.375128+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220324,"kb_used_data":4152,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754396,"statfs":{"total":773094113280,"available":772868501504,"internally_reserved":0,"allocated":4251648,"data_stored":2442596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001012"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238072+0000","last_change":"2024-07-24T16:24:57.238072+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238072+0000","last_undegraded":"2024-07-24T16:24:57.238072+0000","last_fullsized":"2024-07-24T16:24:57.238072+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237601+0000","last_change":"2024-07-24T16:24:57.237601+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237601+0000","last_undegraded":"2024-07-24T16:24:57.237601+0000","last_fullsized":"2024-07-24T16:24:57.237601+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241140+0000","last_change":"2024-07-24T16:24:57.241140+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241140+0000","last_undegraded":"2024-07-24T16:24:57.241140+0000","last_fullsized":"2024-07-24T16:24:57.241140+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236609+0000","last_change":"2024-07-24T16:24:57.236609+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236609+0000","last_undegraded":"2024-07-24T16:24:57.236609+0000","last_fullsized":"2024-07-24T16:24:57.236609+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237318+0000","last_change":"2024-07-24T16:24:57.237318+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237318+0000","last_undegraded":"2024-07-24T16:24:57.237318+0000","last_fullsized":"2024-07-24T16:24:57.237318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235075+0000","last_change":"2024-07-24T16:24:57.235075+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235075+0000","last_undegraded":"2024-07-24T16:24:57.235075+0000","last_fullsized":"2024-07-24T16:24:57.235075+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235951+0000","last_change":"2024-07-24T16:24:57.235951+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235951+0000","last_undegraded":"2024-07-24T16:24:57.235951+0000","last_fullsized":"2024-07-24T16:24:57.235951+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237138+0000","last_change":"2024-07-24T16:24:57.237138+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237138+0000","last_undegraded":"2024-07-24T16:24:57.237138+0000","last_fullsized":"2024-07-24T16:24:57.237138+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239769+0000","last_change":"2024-07-24T16:24:57.239769+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239769+0000","last_undegraded":"2024-07-24T16:24:57.239769+0000","last_fullsized":"2024-07-24T16:24:57.239769+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236925+0000","last_change":"2024-07-24T16:24:57.236925+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236925+0000","last_undegraded":"2024-07-24T16:24:57.236925+0000","last_fullsized":"2024-07-24T16:24:57.236925+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239132+0000","last_change":"2024-07-24T16:24:57.239132+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239132+0000","last_undegraded":"2024-07-24T16:24:57.239132+0000","last_fullsized":"2024-07-24T16:24:57.239132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.240696+0000","last_change":"2024-07-24T16:24:57.240696+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.240696+0000","last_undegraded":"2024-07-24T16:24:57.240696+0000","last_fullsized":"2024-07-24T16:24:57.240696+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238291+0000","last_change":"2024-07-24T16:24:57.238291+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238291+0000","last_undegraded":"2024-07-24T16:24:57.238291+0000","last_fullsized":"2024-07-24T16:24:57.238291+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233515+0000","last_change":"2024-07-24T16:24:57.233515+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233515+0000","last_undegraded":"2024-07-24T16:24:57.233515+0000","last_fullsized":"2024-07-24T16:24:57.233515+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235497+0000","last_change":"2024-07-24T16:24:57.235497+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235497+0000","last_undegraded":"2024-07-24T16:24:57.235497+0000","last_fullsized":"2024-07-24T16:24:57.235497+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232777+0000","last_change":"2024-07-24T16:24:57.232777+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232777+0000","last_undegraded":"2024-07-24T16:24:57.232777+0000","last_fullsized":"2024-07-24T16:24:57.232777+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234368+0000","last_change":"2024-07-24T16:24:57.234368+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234368+0000","last_undegraded":"2024-07-24T16:24:57.234368+0000","last_fullsized":"2024-07-24T16:24:57.234368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238629+0000","last_change":"2024-07-24T16:24:57.238629+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238629+0000","last_undegraded":"2024-07-24T16:24:57.238629+0000","last_fullsized":"2024-07-24T16:24:57.238629+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238246+0000","last_change":"2024-07-24T16:24:57.238246+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238246+0000","last_undegraded":"2024-07-24T16:24:57.238246+0000","last_fullsized":"2024-07-24T16:24:57.238246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.240318+0000","last_change":"2024-07-24T16:24:57.240318+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.240318+0000","last_undegraded":"2024-07-24T16:24:57.240318+0000","last_fullsized":"2024-07-24T16:24:57.240318+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237867+0000","last_change":"2024-07-24T16:24:57.237867+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237867+0000","last_undegraded":"2024-07-24T16:24:57.237867+0000","last_fullsized":"2024-07-24T16:24:57.237867+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233049+0000","last_change":"2024-07-24T16:24:57.233049+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233049+0000","last_undegraded":"2024-07-24T16:24:57.233049+0000","last_fullsized":"2024-07-24T16:24:57.233049+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233898+0000","last_change":"2024-07-24T16:24:57.233898+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233898+0000","last_undegraded":"2024-07-24T16:24:57.233898+0000","last_fullsized":"2024-07-24T16:24:57.233898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238241+0000","last_change":"2024-07-24T16:24:57.238241+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238241+0000","last_undegraded":"2024-07-24T16:24:57.238241+0000","last_fullsized":"2024-07-24T16:24:57.238241+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.243721+0000","last_change":"2024-07-24T16:24:57.243721+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.243721+0000","last_undegraded":"2024-07-24T16:24:57.243721+0000","last_fullsized":"2024-07-24T16:24:57.243721+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238407+0000","last_change":"2024-07-24T16:24:57.238407+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238407+0000","last_undegraded":"2024-07-24T16:24:57.238407+0000","last_fullsized":"2024-07-24T16:24:57.238407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241095+0000","last_change":"2024-07-24T16:24:57.241095+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241095+0000","last_undegraded":"2024-07-24T16:24:57.241095+0000","last_fullsized":"2024-07-24T16:24:57.241095+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237042+0000","last_change":"2024-07-24T16:24:57.237042+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237042+0000","last_undegraded":"2024-07-24T16:24:57.237042+0000","last_fullsized":"2024-07-24T16:24:57.237042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.242307+0000","last_change":"2024-07-24T16:24:57.242307+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.242307+0000","last_undegraded":"2024-07-24T16:24:57.242307+0000","last_fullsized":"2024-07-24T16:24:57.242307+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237099+0000","last_change":"2024-07-24T16:24:57.237099+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237099+0000","last_undegraded":"2024-07-24T16:24:57.237099+0000","last_fullsized":"2024-07-24T16:24:57.237099+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233235+0000","last_change":"2024-07-24T16:24:57.233235+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233235+0000","last_undegraded":"2024-07-24T16:24:57.233235+0000","last_fullsized":"2024-07-24T16:24:57.233235+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236797+0000","last_change":"2024-07-24T16:24:57.236797+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236797+0000","last_undegraded":"2024-07-24T16:24:57.236797+0000","last_fullsized":"2024-07-24T16:24:57.236797+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232989+0000","last_change":"2024-07-24T16:24:57.232989+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232989+0000","last_undegraded":"2024-07-24T16:24:57.232989+0000","last_fullsized":"2024-07-24T16:24:57.232989+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250427+0000","last_change":"2024-07-24T16:24:57.248705+0000","last_active":"2024-07-24T16:24:57.250427+0000","last_peered":"2024-07-24T16:24:57.250427+0000","last_clean":"2024-07-24T16:24:57.250427+0000","last_became_active":"2024-07-24T16:24:57.247318+0000","last_became_peered":"2024-07-24T16:24:57.247318+0000","last_unstale":"2024-07-24T16:24:57.250427+0000","last_undegraded":"2024-07-24T16:24:57.250427+0000","last_fullsized":"2024-07-24T16:24:57.250427+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:57:41.244903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235709+0000","last_change":"2024-07-24T16:24:57.235709+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235709+0000","last_undegraded":"2024-07-24T16:24:57.235709+0000","last_fullsized":"2024-07-24T16:24:57.235709+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248881+0000","last_change":"2024-07-24T16:24:57.245395+0000","last_active":"2024-07-24T16:24:57.248881+0000","last_peered":"2024-07-24T16:24:57.248881+0000","last_clean":"2024-07-24T16:24:57.248881+0000","last_became_active":"2024-07-24T16:24:57.245020+0000","last_became_peered":"2024-07-24T16:24:57.245020+0000","last_unstale":"2024-07-24T16:24:57.248881+0000","last_undegraded":"2024-07-24T16:24:57.248881+0000","last_fullsized":"2024-07-24T16:24:57.248881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:46:07.474602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232148+0000","last_change":"2024-07-24T16:24:57.232148+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232148+0000","last_undegraded":"2024-07-24T16:24:57.232148+0000","last_fullsized":"2024-07-24T16:24:57.232148+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252122+0000","last_change":"2024-07-24T16:24:57.246910+0000","last_active":"2024-07-24T16:24:57.252122+0000","last_peered":"2024-07-24T16:24:57.252122+0000","last_clean":"2024-07-24T16:24:57.252122+0000","last_became_active":"2024-07-24T16:24:57.246638+0000","last_became_peered":"2024-07-24T16:24:57.246638+0000","last_unstale":"2024-07-24T16:24:57.252122+0000","last_undegraded":"2024-07-24T16:24:57.252122+0000","last_fullsized":"2024-07-24T16:24:57.252122+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:51.538511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.237176+0000","last_change":"2024-07-24T16:24:57.237176+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.237176+0000","last_undegraded":"2024-07-24T16:24:57.237176+0000","last_fullsized":"2024-07-24T16:24:57.237176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.246256+0000","last_change":"2024-07-24T16:24:57.242358+0000","last_active":"2024-07-24T16:24:57.246256+0000","last_peered":"2024-07-24T16:24:57.246256+0000","last_clean":"2024-07-24T16:24:57.246256+0000","last_became_active":"2024-07-24T16:24:57.242040+0000","last_became_peered":"2024-07-24T16:24:57.242040+0000","last_unstale":"2024-07-24T16:24:57.246256+0000","last_undegraded":"2024-07-24T16:24:57.246256+0000","last_fullsized":"2024-07-24T16:24:57.246256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:15:07.269777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.242278+0000","last_change":"2024-07-24T16:24:57.242278+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.242278+0000","last_undegraded":"2024-07-24T16:24:57.242278+0000","last_fullsized":"2024-07-24T16:24:57.242278+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.249387+0000","last_change":"2024-07-24T16:24:57.247796+0000","last_active":"2024-07-24T16:24:57.249387+0000","last_peered":"2024-07-24T16:24:57.249387+0000","last_clean":"2024-07-24T16:24:57.249387+0000","last_became_active":"2024-07-24T16:24:57.247526+0000","last_became_peered":"2024-07-24T16:24:57.247526+0000","last_unstale":"2024-07-24T16:24:57.249387+0000","last_undegraded":"2024-07-24T16:24:57.249387+0000","last_fullsized":"2024-07-24T16:24:57.249387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:50.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235001+0000","last_change":"2024-07-24T16:24:57.235001+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235001+0000","last_undegraded":"2024-07-24T16:24:57.235001+0000","last_fullsized":"2024-07-24T16:24:57.235001+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.242229+0000","last_change":"2024-07-24T16:24:57.239638+0000","last_active":"2024-07-24T16:24:57.242229+0000","last_peered":"2024-07-24T16:24:57.242229+0000","last_clean":"2024-07-24T16:24:57.242229+0000","last_became_active":"2024-07-24T16:24:57.239216+0000","last_became_peered":"2024-07-24T16:24:57.239216+0000","last_unstale":"2024-07-24T16:24:57.242229+0000","last_undegraded":"2024-07-24T16:24:57.242229+0000","last_fullsized":"2024-07-24T16:24:57.242229+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232190+0000","last_change":"2024-07-24T16:24:57.232190+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232190+0000","last_undegraded":"2024-07-24T16:24:57.232190+0000","last_fullsized":"2024-07-24T16:24:57.232190+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252216+0000","last_change":"2024-07-24T16:24:57.247845+0000","last_active":"2024-07-24T16:24:57.252216+0000","last_peered":"2024-07-24T16:24:57.252216+0000","last_clean":"2024-07-24T16:24:57.252216+0000","last_became_active":"2024-07-24T16:24:57.247357+0000","last_became_peered":"2024-07-24T16:24:57.247357+0000","last_unstale":"2024-07-24T16:24:57.252216+0000","last_undegraded":"2024-07-24T16:24:57.252216+0000","last_fullsized":"2024-07-24T16:24:57.252216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235898+0000","last_change":"2024-07-24T16:24:57.235898+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235898+0000","last_undegraded":"2024-07-24T16:24:57.235898+0000","last_fullsized":"2024-07-24T16:24:57.235898+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.246190+0000","last_change":"2024-07-24T16:24:57.242475+0000","last_active":"2024-07-24T16:24:57.246190+0000","last_peered":"2024-07-24T16:24:57.246190+0000","last_clean":"2024-07-24T16:24:57.246190+0000","last_became_active":"2024-07-24T16:24:57.242192+0000","last_became_peered":"2024-07-24T16:24:57.242192+0000","last_unstale":"2024-07-24T16:24:57.246190+0000","last_undegraded":"2024-07-24T16:24:57.246190+0000","last_fullsized":"2024-07-24T16:24:57.246190+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:11:26.761665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.236183+0000","last_change":"2024-07-24T16:24:57.236183+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.236183+0000","last_undegraded":"2024-07-24T16:24:57.236183+0000","last_fullsized":"2024-07-24T16:24:57.236183+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248310+0000","last_change":"2024-07-24T16:24:57.239691+0000","last_active":"2024-07-24T16:24:57.248310+0000","last_peered":"2024-07-24T16:24:57.248310+0000","last_clean":"2024-07-24T16:24:57.248310+0000","last_became_active":"2024-07-24T16:24:57.239430+0000","last_became_peered":"2024-07-24T16:24:57.239430+0000","last_unstale":"2024-07-24T16:24:57.248310+0000","last_undegraded":"2024-07-24T16:24:57.248310+0000","last_fullsized":"2024-07-24T16:24:57.248310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:36:59.542494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234227+0000","last_change":"2024-07-24T16:24:57.234227+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234227+0000","last_undegraded":"2024-07-24T16:24:57.234227+0000","last_fullsized":"2024-07-24T16:24:57.234227+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.247935+0000","last_change":"2024-07-24T16:24:57.246040+0000","last_active":"2024-07-24T16:24:57.247935+0000","last_peered":"2024-07-24T16:24:57.247935+0000","last_clean":"2024-07-24T16:24:57.247935+0000","last_became_active":"2024-07-24T16:24:57.245741+0000","last_became_peered":"2024-07-24T16:24:57.245741+0000","last_unstale":"2024-07-24T16:24:57.247935+0000","last_undegraded":"2024-07-24T16:24:57.247935+0000","last_fullsized":"2024-07-24T16:24:57.247935+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239300+0000","last_change":"2024-07-24T16:24:57.239300+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239300+0000","last_undegraded":"2024-07-24T16:24:57.239300+0000","last_fullsized":"2024-07-24T16:24:57.239300+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.253527+0000","last_change":"2024-07-24T16:24:57.252143+0000","last_active":"2024-07-24T16:24:57.253527+0000","last_peered":"2024-07-24T16:24:57.253527+0000","last_clean":"2024-07-24T16:24:57.253527+0000","last_became_active":"2024-07-24T16:24:57.251822+0000","last_became_peered":"2024-07-24T16:24:57.251822+0000","last_unstale":"2024-07-24T16:24:57.253527+0000","last_undegraded":"2024-07-24T16:24:57.253527+0000","last_fullsized":"2024-07-24T16:24:57.253527+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:16:33.614437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.231847+0000","last_change":"2024-07-24T16:24:57.231847+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.231847+0000","last_undegraded":"2024-07-24T16:24:57.231847+0000","last_fullsized":"2024-07-24T16:24:57.231847+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.240743+0000","last_change":"2024-07-24T16:24:57.237331+0000","last_active":"2024-07-24T16:24:57.240743+0000","last_peered":"2024-07-24T16:24:57.240743+0000","last_clean":"2024-07-24T16:24:57.240743+0000","last_became_active":"2024-07-24T16:24:57.237045+0000","last_became_peered":"2024-07-24T16:24:57.237045+0000","last_unstale":"2024-07-24T16:24:57.240743+0000","last_undegraded":"2024-07-24T16:24:57.240743+0000","last_fullsized":"2024-07-24T16:24:57.240743+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:05:44.263080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241850+0000","last_change":"2024-07-24T16:24:57.241850+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241850+0000","last_undegraded":"2024-07-24T16:24:57.241850+0000","last_fullsized":"2024-07-24T16:24:57.241850+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251261+0000","last_change":"2024-07-24T16:24:57.248002+0000","last_active":"2024-07-24T16:24:57.251261+0000","last_peered":"2024-07-24T16:24:57.251261+0000","last_clean":"2024-07-24T16:24:57.251261+0000","last_became_active":"2024-07-24T16:24:57.247736+0000","last_became_peered":"2024-07-24T16:24:57.247736+0000","last_unstale":"2024-07-24T16:24:57.251261+0000","last_undegraded":"2024-07-24T16:24:57.251261+0000","last_fullsized":"2024-07-24T16:24:57.251261+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:44:19.124214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234781+0000","last_change":"2024-07-24T16:24:57.234781+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234781+0000","last_undegraded":"2024-07-24T16:24:57.234781+0000","last_fullsized":"2024-07-24T16:24:57.234781+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252154+0000","last_change":"2024-07-24T16:24:57.247616+0000","last_active":"2024-07-24T16:24:57.252154+0000","last_peered":"2024-07-24T16:24:57.252154+0000","last_clean":"2024-07-24T16:24:57.252154+0000","last_became_active":"2024-07-24T16:24:57.247334+0000","last_became_peered":"2024-07-24T16:24:57.247334+0000","last_unstale":"2024-07-24T16:24:57.252154+0000","last_undegraded":"2024-07-24T16:24:57.252154+0000","last_fullsized":"2024-07-24T16:24:57.252154+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233217+0000","last_change":"2024-07-24T16:24:57.233217+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233217+0000","last_undegraded":"2024-07-24T16:24:57.233217+0000","last_fullsized":"2024-07-24T16:24:57.233217+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250982+0000","last_change":"2024-07-24T16:24:57.250024+0000","last_active":"2024-07-24T16:24:57.250982+0000","last_peered":"2024-07-24T16:24:57.250982+0000","last_clean":"2024-07-24T16:24:57.250982+0000","last_became_active":"2024-07-24T16:24:57.249723+0000","last_became_peered":"2024-07-24T16:24:57.249723+0000","last_unstale":"2024-07-24T16:24:57.250982+0000","last_undegraded":"2024-07-24T16:24:57.250982+0000","last_fullsized":"2024-07-24T16:24:57.250982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:12.087663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235430+0000","last_change":"2024-07-24T16:24:57.235430+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235430+0000","last_undegraded":"2024-07-24T16:24:57.235430+0000","last_fullsized":"2024-07-24T16:24:57.235430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.239610+0000","last_change":"2024-07-24T16:24:57.238606+0000","last_active":"2024-07-24T16:24:57.239610+0000","last_peered":"2024-07-24T16:24:57.239610+0000","last_clean":"2024-07-24T16:24:57.239610+0000","last_became_active":"2024-07-24T16:24:57.238268+0000","last_became_peered":"2024-07-24T16:24:57.238268+0000","last_unstale":"2024-07-24T16:24:57.239610+0000","last_undegraded":"2024-07-24T16:24:57.239610+0000","last_fullsized":"2024-07-24T16:24:57.239610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:51.538511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234290+0000","last_change":"2024-07-24T16:24:57.234290+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234290+0000","last_undegraded":"2024-07-24T16:24:57.234290+0000","last_fullsized":"2024-07-24T16:24:57.234290+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248589+0000","last_change":"2024-07-24T16:24:57.247263+0000","last_active":"2024-07-24T16:24:57.248589+0000","last_peered":"2024-07-24T16:24:57.248589+0000","last_clean":"2024-07-24T16:24:57.248589+0000","last_became_active":"2024-07-24T16:24:57.246829+0000","last_became_peered":"2024-07-24T16:24:57.246829+0000","last_unstale":"2024-07-24T16:24:57.248589+0000","last_undegraded":"2024-07-24T16:24:57.248589+0000","last_fullsized":"2024-07-24T16:24:57.248589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238678+0000","last_change":"2024-07-24T16:24:57.238678+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238678+0000","last_undegraded":"2024-07-24T16:24:57.238678+0000","last_fullsized":"2024-07-24T16:24:57.238678+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248784+0000","last_change":"2024-07-24T16:24:57.246981+0000","last_active":"2024-07-24T16:24:57.248784+0000","last_peered":"2024-07-24T16:24:57.248784+0000","last_clean":"2024-07-24T16:24:57.248784+0000","last_became_active":"2024-07-24T16:24:57.246677+0000","last_became_peered":"2024-07-24T16:24:57.246677+0000","last_unstale":"2024-07-24T16:24:57.248784+0000","last_undegraded":"2024-07-24T16:24:57.248784+0000","last_fullsized":"2024-07-24T16:24:57.248784+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:46:07.474602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234413+0000","last_change":"2024-07-24T16:24:57.234413+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234413+0000","last_undegraded":"2024-07-24T16:24:57.234413+0000","last_fullsized":"2024-07-24T16:24:57.234413+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251566+0000","last_change":"2024-07-24T16:24:57.246148+0000","last_active":"2024-07-24T16:24:57.251566+0000","last_peered":"2024-07-24T16:24:57.251566+0000","last_clean":"2024-07-24T16:24:57.251566+0000","last_became_active":"2024-07-24T16:24:57.245850+0000","last_became_peered":"2024-07-24T16:24:57.245850+0000","last_unstale":"2024-07-24T16:24:57.251566+0000","last_undegraded":"2024-07-24T16:24:57.251566+0000","last_fullsized":"2024-07-24T16:24:57.251566+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:34:36.379487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235713+0000","last_change":"2024-07-24T16:24:57.235713+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235713+0000","last_undegraded":"2024-07-24T16:24:57.235713+0000","last_fullsized":"2024-07-24T16:24:57.235713+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251085+0000","last_change":"2024-07-24T16:24:57.244659+0000","last_active":"2024-07-24T16:24:57.251085+0000","last_peered":"2024-07-24T16:24:57.251085+0000","last_clean":"2024-07-24T16:24:57.251085+0000","last_became_active":"2024-07-24T16:24:57.244361+0000","last_became_peered":"2024-07-24T16:24:57.244361+0000","last_unstale":"2024-07-24T16:24:57.251085+0000","last_undegraded":"2024-07-24T16:24:57.251085+0000","last_fullsized":"2024-07-24T16:24:57.251085+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:46:07.474602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232220+0000","last_change":"2024-07-24T16:24:57.232220+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232220+0000","last_undegraded":"2024-07-24T16:24:57.232220+0000","last_fullsized":"2024-07-24T16:24:57.232220+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.253915+0000","last_change":"2024-07-24T16:24:57.249844+0000","last_active":"2024-07-24T16:24:57.253915+0000","last_peered":"2024-07-24T16:24:57.253915+0000","last_clean":"2024-07-24T16:24:57.253915+0000","last_became_active":"2024-07-24T16:24:57.249555+0000","last_became_peered":"2024-07-24T16:24:57.249555+0000","last_unstale":"2024-07-24T16:24:57.253915+0000","last_undegraded":"2024-07-24T16:24:57.253915+0000","last_fullsized":"2024-07-24T16:24:57.253915+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:50:55.883018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.240246+0000","last_change":"2024-07-24T16:24:57.240246+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.240246+0000","last_undegraded":"2024-07-24T16:24:57.240246+0000","last_fullsized":"2024-07-24T16:24:57.240246+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251531+0000","last_change":"2024-07-24T16:24:57.247926+0000","last_active":"2024-07-24T16:24:57.251531+0000","last_peered":"2024-07-24T16:24:57.251531+0000","last_clean":"2024-07-24T16:24:57.251531+0000","last_became_active":"2024-07-24T16:24:57.247680+0000","last_became_peered":"2024-07-24T16:24:57.247680+0000","last_unstale":"2024-07-24T16:24:57.251531+0000","last_undegraded":"2024-07-24T16:24:57.251531+0000","last_fullsized":"2024-07-24T16:24:57.251531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:00:31.435044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.239293+0000","last_change":"2024-07-24T16:24:57.239293+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.239293+0000","last_undegraded":"2024-07-24T16:24:57.239293+0000","last_fullsized":"2024-07-24T16:24:57.239293+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250249+0000","last_change":"2024-07-24T16:24:57.248109+0000","last_active":"2024-07-24T16:24:57.250249+0000","last_peered":"2024-07-24T16:24:57.250249+0000","last_clean":"2024-07-24T16:24:57.250249+0000","last_became_active":"2024-07-24T16:24:57.247809+0000","last_became_peered":"2024-07-24T16:24:57.247809+0000","last_unstale":"2024-07-24T16:24:57.250249+0000","last_undegraded":"2024-07-24T16:24:57.250249+0000","last_fullsized":"2024-07-24T16:24:57.250249+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:50.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234303+0000","last_change":"2024-07-24T16:24:57.234303+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234303+0000","last_undegraded":"2024-07-24T16:24:57.234303+0000","last_fullsized":"2024-07-24T16:24:57.234303+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.251540+0000","last_change":"2024-07-24T16:24:57.247519+0000","last_active":"2024-07-24T16:24:57.251540+0000","last_peered":"2024-07-24T16:24:57.251540+0000","last_clean":"2024-07-24T16:24:57.251540+0000","last_became_active":"2024-07-24T16:24:57.247224+0000","last_became_peered":"2024-07-24T16:24:57.247224+0000","last_unstale":"2024-07-24T16:24:57.251540+0000","last_undegraded":"2024-07-24T16:24:57.251540+0000","last_fullsized":"2024-07-24T16:24:57.251540+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:03:31.080074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.235291+0000","last_change":"2024-07-24T16:24:57.235291+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.235291+0000","last_undegraded":"2024-07-24T16:24:57.235291+0000","last_fullsized":"2024-07-24T16:24:57.235291+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252625+0000","last_change":"2024-07-24T16:24:57.251681+0000","last_active":"2024-07-24T16:24:57.252625+0000","last_peered":"2024-07-24T16:24:57.252625+0000","last_clean":"2024-07-24T16:24:57.252625+0000","last_became_active":"2024-07-24T16:24:57.251383+0000","last_became_peered":"2024-07-24T16:24:57.251383+0000","last_unstale":"2024-07-24T16:24:57.252625+0000","last_undegraded":"2024-07-24T16:24:57.252625+0000","last_fullsized":"2024-07-24T16:24:57.252625+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:40.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232319+0000","last_change":"2024-07-24T16:24:57.232319+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232319+0000","last_undegraded":"2024-07-24T16:24:57.232319+0000","last_fullsized":"2024-07-24T16:24:57.232319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.253877+0000","last_change":"2024-07-24T16:24:57.249314+0000","last_active":"2024-07-24T16:24:57.253877+0000","last_peered":"2024-07-24T16:24:57.253877+0000","last_clean":"2024-07-24T16:24:57.253877+0000","last_became_active":"2024-07-24T16:24:57.249068+0000","last_became_peered":"2024-07-24T16:24:57.249068+0000","last_unstale":"2024-07-24T16:24:57.253877+0000","last_undegraded":"2024-07-24T16:24:57.253877+0000","last_fullsized":"2024-07-24T16:24:57.253877+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:49:44.981927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.233764+0000","last_change":"2024-07-24T16:24:57.233764+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.233764+0000","last_undegraded":"2024-07-24T16:24:57.233764+0000","last_fullsized":"2024-07-24T16:24:57.233764+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.256647+0000","last_change":"2024-07-24T16:24:57.251715+0000","last_active":"2024-07-24T16:24:57.256647+0000","last_peered":"2024-07-24T16:24:57.256647+0000","last_clean":"2024-07-24T16:24:57.256647+0000","last_became_active":"2024-07-24T16:24:57.251432+0000","last_became_peered":"2024-07-24T16:24:57.251432+0000","last_unstale":"2024-07-24T16:24:57.256647+0000","last_undegraded":"2024-07-24T16:24:57.256647+0000","last_fullsized":"2024-07-24T16:24:57.256647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.241467+0000","last_change":"2024-07-24T16:24:57.241467+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.241467+0000","last_undegraded":"2024-07-24T16:24:57.241467+0000","last_fullsized":"2024-07-24T16:24:57.241467+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.252185+0000","last_change":"2024-07-24T16:24:57.250429+0000","last_active":"2024-07-24T16:24:57.252185+0000","last_peered":"2024-07-24T16:24:57.252185+0000","last_clean":"2024-07-24T16:24:57.252185+0000","last_became_active":"2024-07-24T16:24:57.250254+0000","last_became_peered":"2024-07-24T16:24:57.250254+0000","last_unstale":"2024-07-24T16:24:57.252185+0000","last_undegraded":"2024-07-24T16:24:57.252185+0000","last_fullsized":"2024-07-24T16:24:57.252185+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:51.538511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234731+0000","last_change":"2024-07-24T16:24:57.234731+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234731+0000","last_undegraded":"2024-07-24T16:24:57.234731+0000","last_fullsized":"2024-07-24T16:24:57.234731+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.249775+0000","last_change":"2024-07-24T16:24:57.244665+0000","last_active":"2024-07-24T16:24:57.249775+0000","last_peered":"2024-07-24T16:24:57.249775+0000","last_clean":"2024-07-24T16:24:57.249775+0000","last_became_active":"2024-07-24T16:24:57.244293+0000","last_became_peered":"2024-07-24T16:24:57.244293+0000","last_unstale":"2024-07-24T16:24:57.249775+0000","last_undegraded":"2024-07-24T16:24:57.249775+0000","last_fullsized":"2024-07-24T16:24:57.249775+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:09:53.165693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.232619+0000","last_change":"2024-07-24T16:24:57.232619+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.232619+0000","last_undegraded":"2024-07-24T16:24:57.232619+0000","last_fullsized":"2024-07-24T16:24:57.232619+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.246943+0000","last_change":"2024-07-24T16:24:57.243037+0000","last_active":"2024-07-24T16:24:57.246943+0000","last_peered":"2024-07-24T16:24:57.246943+0000","last_clean":"2024-07-24T16:24:57.246943+0000","last_became_active":"2024-07-24T16:24:57.242776+0000","last_became_peered":"2024-07-24T16:24:57.242776+0000","last_unstale":"2024-07-24T16:24:57.246943+0000","last_undegraded":"2024-07-24T16:24:57.246943+0000","last_fullsized":"2024-07-24T16:24:57.246943+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:28:36.598035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.234621+0000","last_change":"2024-07-24T16:24:57.234621+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.234621+0000","last_undegraded":"2024-07-24T16:24:57.234621+0000","last_fullsized":"2024-07-24T16:24:57.234621+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.248424+0000","last_change":"2024-07-24T16:24:57.239764+0000","last_active":"2024-07-24T16:24:57.248424+0000","last_peered":"2024-07-24T16:24:57.248424+0000","last_clean":"2024-07-24T16:24:57.248424+0000","last_became_active":"2024-07-24T16:24:57.239454+0000","last_became_peered":"2024-07-24T16:24:57.239454+0000","last_unstale":"2024-07-24T16:24:57.248424+0000","last_undegraded":"2024-07-24T16:24:57.248424+0000","last_fullsized":"2024-07-24T16:24:57.248424+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:26:13.775005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":34,"state":"creating+peering","last_fresh":"2024-07-24T16:24:57.238068+0000","last_change":"2024-07-24T16:24:57.238068+0000","last_active":"2024-07-24T16:24:57.221433+0000","last_peered":"2024-07-24T16:24:57.221433+0000","last_clean":"2024-07-24T16:24:57.221433+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-07-24T16:24:57.238068+0000","last_undegraded":"2024-07-24T16:24:57.238068+0000","last_fullsized":"2024-07-24T16:24:57.238068+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.250284+0000","last_change":"2024-07-24T16:24:57.247349+0000","last_active":"2024-07-24T16:24:57.250284+0000","last_peered":"2024-07-24T16:24:57.250284+0000","last_clean":"2024-07-24T16:24:57.250284+0000","last_became_active":"2024-07-24T16:24:57.246965+0000","last_became_peered":"2024-07-24T16:24:57.246965+0000","last_unstale":"2024-07-24T16:24:57.250284+0000","last_undegraded":"2024-07-24T16:24:57.250284+0000","last_fullsized":"2024-07-24T16:24:57.250284+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":133,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-07-24T16:24:57.235180+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:24:57.235180+0000","last_peered":"2024-07-24T16:24:57.235180+0000","last_clean":"2024-07-24T16:24:57.235180+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:24:57.235180+0000","last_undegraded":"2024-07-24T16:24:57.235180+0000","last_fullsized":"2024-07-24T16:24:57.235180+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27980,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343860,"statfs":{"total":96636764160,"available":96608112640,"internally_reserved":0,"allocated":983040,"data_stored":751434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":154399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":154399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":376832,"data_stored":154399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":380,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":389120,"data_stored":161066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27968,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343872,"statfs":{"total":96636764160,"available":96608124928,"internally_reserved":0,"allocated":970752,"data_stored":744767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:25:05.693 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:25:05.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.807+0000 7fb8b4339640 1 -- 172.21.15.159:0/387830182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb894004800 msgr2=0x7fb894004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:05.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.807+0000 7fb8b4339640 1 --2- 172.21.15.159:0/387830182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb894004800 0x7fb894004c80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009b20 tx=0x7fb894005830 comp rx=0 tx=0).stop 2024-07-24T16:25:05.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.807+0000 7fb8b4339640 1 -- 172.21.15.159:0/387830182 shutdown_connections 2024-07-24T16:25:05.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.807+0000 7fb8b4339640 1 --2- 172.21.15.159:0/387830182 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb894004800 0x7fb894004c80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:05.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.807+0000 7fb8b4339640 1 -- 172.21.15.159:0/387830182 >> 172.21.15.159:0/387830182 conn(0x7fb8ac09aa20 msgr2=0x7fb8ac0d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:05.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.807+0000 7fb8b4339640 1 -- 172.21.15.159:0/387830182 shutdown_connections 2024-07-24T16:25:05.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.807+0000 7fb8b4339640 1 -- 172.21.15.159:0/387830182 wait complete. 2024-07-24T16:25:05.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.808+0000 7fb8b4339640 1 Processor -- start 2024-07-24T16:25:05.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.808+0000 7fb8b4339640 1 -- start start 2024-07-24T16:25:05.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b4339640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb894004800 0x7fb8ac157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:05.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b4339640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8ac15e100 0x7fb8ac15e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:05.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b4339640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb8ac06d6e0 0x7fb8ac06db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:05.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b4339640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ac15f410 con 0x7fb894004800 2024-07-24T16:25:05.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b4339640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb8ac15f290 con 0x7fb8ac15e100 2024-07-24T16:25:05.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b4339640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb8ac15f590 con 0x7fb8ac06d6e0 2024-07-24T16:25:05.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b20d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb894004800 0x7fb8ac157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:05.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b20d5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb894004800 0x7fb8ac157c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43398/0 (socket says 172.21.15.159:43398) 2024-07-24T16:25:05.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b20d5640 1 -- 172.21.15.159:0/2396286233 learned_addr learned my addr 172.21.15.159:0/2396286233 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:05.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b18d4640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8ac15e100 0x7fb8ac15e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:05.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b28d6640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb8ac06d6e0 0x7fb8ac06db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:05.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b20d5640 1 -- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb8ac06d6e0 msgr2=0x7fb8ac06db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:05.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b20d5640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb8ac06d6e0 0x7fb8ac06db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:05.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.809+0000 7fb8b20d5640 1 -- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8ac15e100 msgr2=0x7fb8ac15e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:05.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.810+0000 7fb8b20d5640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8ac15e100 0x7fb8ac15e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:05.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.810+0000 7fb8b20d5640 1 -- 172.21.15.159:0/2396286233 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8ac158170 con 0x7fb894004800 2024-07-24T16:25:05.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.810+0000 7fb8b20d5640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb894004800 0x7fb8ac157c30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0017e0 tx=0x7fb89c001ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:05.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.810+0000 7fb8aaffd640 1 -- 172.21.15.159:0/2396286233 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c015070 con 0x7fb894004800 2024-07-24T16:25:05.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.810+0000 7fb8aaffd640 1 -- 172.21.15.159:0/2396286233 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb89c00ea00 con 0x7fb894004800 2024-07-24T16:25:05.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.810+0000 7fb8aaffd640 1 -- 172.21.15.159:0/2396286233 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c00ee10 con 0x7fb894004800 2024-07-24T16:25:05.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.810+0000 7fb8b4339640 1 -- 172.21.15.159:0/2396286233 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8ac06e450 con 0x7fb894004800 2024-07-24T16:25:05.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.810+0000 7fb8b4339640 1 -- 172.21.15.159:0/2396286233 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8ac06ea10 con 0x7fb894004800 2024-07-24T16:25:05.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.811+0000 7fb8b4339640 1 -- 172.21.15.159:0/2396286233 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8ac15faf0 con 0x7fb894004800 2024-07-24T16:25:05.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.811+0000 7fb8aaffd640 1 -- 172.21.15.159:0/2396286233 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fb89c018070 con 0x7fb894004800 2024-07-24T16:25:05.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.812+0000 7fb8aaffd640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb898077040 0x7fb898079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:05.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.812+0000 7fb8aaffd640 1 -- 172.21.15.159:0/2396286233 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fb89c099150 con 0x7fb894004800 2024-07-24T16:25:05.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.812+0000 7fb8b18d4640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb898077040 0x7fb898079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:05.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.813+0000 7fb8b18d4640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb898077040 0x7fb898079500 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0035000 tx=0x7fb8a00046c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:05.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.816+0000 7fb8aaffd640 1 -- 172.21.15.159:0/2396286233 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fb89c061c10 con 0x7fb894004800 2024-07-24T16:25:05.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.994+0000 7fb8b4339640 1 -- 172.21.15.159:0/2396286233 --> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb8ac06f060 con 0x7fb898077040 2024-07-24T16:25:06.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:05.998+0000 7fb8aaffd640 1 -- 172.21.15.159:0/2396286233 <== mgr.4103 v2:172.21.15.193:6832/222319347 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7fb8ac06f060 con 0x7fb898077040 2024-07-24T16:25:06.003 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:25:06.005 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:25:06.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.001+0000 7fb8b4339640 1 -- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb898077040 msgr2=0x7fb898079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:06.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.001+0000 7fb8b4339640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb898077040 0x7fb898079500 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0035000 tx=0x7fb8a00046c0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.001+0000 7fb8b4339640 1 -- 172.21.15.159:0/2396286233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb894004800 msgr2=0x7fb8ac157c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:06.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.001+0000 7fb8b4339640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb894004800 0x7fb8ac157c30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb89c0017e0 tx=0x7fb89c001ca0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.001+0000 7fb8b4339640 1 -- 172.21.15.159:0/2396286233 shutdown_connections 2024-07-24T16:25:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.001+0000 7fb8b4339640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fb898077040 0x7fb898079500 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.002+0000 7fb8b4339640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb8ac06d6e0 0x7fb8ac06db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.002+0000 7fb8b4339640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb8ac15e100 0x7fb8ac15e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.002+0000 7fb8b4339640 1 --2- 172.21.15.159:0/2396286233 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb894004800 0x7fb8ac157c30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.002+0000 7fb8b4339640 1 -- 172.21.15.159:0/2396286233 >> 172.21.15.159:0/2396286233 conn(0x7fb8ac09aa20 msgr2=0x7fb8ac0d1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.002+0000 7fb8b4339640 1 -- 172.21.15.159:0/2396286233 shutdown_connections 2024-07-24T16:25:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.002+0000 7fb8b4339640 1 -- 172.21.15.159:0/2396286233 wait complete. 2024-07-24T16:25:06.015 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2024-07-24T16:25:04.375439+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":187,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220624,"kb_used_data":4456,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754096,"statfs":{"total":773094113280,"available":772868194304,"internally_reserved":0,"allocated":4562944,"data_stored":2584956,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.146178"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531703+0000","last_change":"2024-07-24T16:24:58.253501+0000","last_active":"2024-07-24T16:24:59.531703+0000","last_peered":"2024-07-24T16:24:59.531703+0000","last_clean":"2024-07-24T16:24:59.531703+0000","last_became_active":"2024-07-24T16:24:58.252499+0000","last_became_peered":"2024-07-24T16:24:58.252499+0000","last_unstale":"2024-07-24T16:24:59.531703+0000","last_undegraded":"2024-07-24T16:24:59.531703+0000","last_fullsized":"2024-07-24T16:24:59.531703+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:25:22.752571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531684+0000","last_change":"2024-07-24T16:24:58.257754+0000","last_active":"2024-07-24T16:24:59.531684+0000","last_peered":"2024-07-24T16:24:59.531684+0000","last_clean":"2024-07-24T16:24:59.531684+0000","last_became_active":"2024-07-24T16:24:58.257302+0000","last_became_peered":"2024-07-24T16:24:58.257302+0000","last_unstale":"2024-07-24T16:24:59.531684+0000","last_undegraded":"2024-07-24T16:24:59.531684+0000","last_fullsized":"2024-07-24T16:24:59.531684+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:37:09.520707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530479+0000","last_change":"2024-07-24T16:24:58.247241+0000","last_active":"2024-07-24T16:24:59.530479+0000","last_peered":"2024-07-24T16:24:59.530479+0000","last_clean":"2024-07-24T16:24:59.530479+0000","last_became_active":"2024-07-24T16:24:58.246981+0000","last_became_peered":"2024-07-24T16:24:58.246981+0000","last_unstale":"2024-07-24T16:24:59.530479+0000","last_undegraded":"2024-07-24T16:24:59.530479+0000","last_fullsized":"2024-07-24T16:24:59.530479+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:39:14.832825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.242793+0000","last_change":"2024-07-24T16:24:58.256512+0000","last_active":"2024-07-24T16:24:59.242793+0000","last_peered":"2024-07-24T16:24:59.242793+0000","last_clean":"2024-07-24T16:24:59.242793+0000","last_became_active":"2024-07-24T16:24:58.256290+0000","last_became_peered":"2024-07-24T16:24:58.256290+0000","last_unstale":"2024-07-24T16:24:59.242793+0000","last_undegraded":"2024-07-24T16:24:59.242793+0000","last_fullsized":"2024-07-24T16:24:59.242793+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:13.090157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.242892+0000","last_change":"2024-07-24T16:24:58.255328+0000","last_active":"2024-07-24T16:24:59.242892+0000","last_peered":"2024-07-24T16:24:59.242892+0000","last_clean":"2024-07-24T16:24:59.242892+0000","last_became_active":"2024-07-24T16:24:58.255035+0000","last_became_peered":"2024-07-24T16:24:58.255035+0000","last_unstale":"2024-07-24T16:24:59.242892+0000","last_undegraded":"2024-07-24T16:24:59.242892+0000","last_fullsized":"2024-07-24T16:24:59.242892+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:16.459808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530693+0000","last_change":"2024-07-24T16:24:58.248866+0000","last_active":"2024-07-24T16:24:59.530693+0000","last_peered":"2024-07-24T16:24:59.530693+0000","last_clean":"2024-07-24T16:24:59.530693+0000","last_became_active":"2024-07-24T16:24:58.248617+0000","last_became_peered":"2024-07-24T16:24:58.248617+0000","last_unstale":"2024-07-24T16:24:59.530693+0000","last_undegraded":"2024-07-24T16:24:59.530693+0000","last_fullsized":"2024-07-24T16:24:59.530693+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:29:56.780913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530288+0000","last_change":"2024-07-24T16:24:58.249915+0000","last_active":"2024-07-24T16:24:59.530288+0000","last_peered":"2024-07-24T16:24:59.530288+0000","last_clean":"2024-07-24T16:24:59.530288+0000","last_became_active":"2024-07-24T16:24:58.248182+0000","last_became_peered":"2024-07-24T16:24:58.248182+0000","last_unstale":"2024-07-24T16:24:59.530288+0000","last_undegraded":"2024-07-24T16:24:59.530288+0000","last_fullsized":"2024-07-24T16:24:59.530288+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:20:23.135100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531389+0000","last_change":"2024-07-24T16:24:58.253839+0000","last_active":"2024-07-24T16:24:59.531389+0000","last_peered":"2024-07-24T16:24:59.531389+0000","last_clean":"2024-07-24T16:24:59.531389+0000","last_became_active":"2024-07-24T16:24:58.253562+0000","last_became_peered":"2024-07-24T16:24:58.253562+0000","last_unstale":"2024-07-24T16:24:59.531389+0000","last_undegraded":"2024-07-24T16:24:59.531389+0000","last_fullsized":"2024-07-24T16:24:59.531389+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:34:47.325399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531088+0000","last_change":"2024-07-24T16:24:58.256791+0000","last_active":"2024-07-24T16:24:59.531088+0000","last_peered":"2024-07-24T16:24:59.531088+0000","last_clean":"2024-07-24T16:24:59.531088+0000","last_became_active":"2024-07-24T16:24:58.256532+0000","last_became_peered":"2024-07-24T16:24:58.256532+0000","last_unstale":"2024-07-24T16:24:59.531088+0000","last_undegraded":"2024-07-24T16:24:59.531088+0000","last_fullsized":"2024-07-24T16:24:59.531088+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:47:38.109117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530795+0000","last_change":"2024-07-24T16:24:58.248632+0000","last_active":"2024-07-24T16:24:59.530795+0000","last_peered":"2024-07-24T16:24:59.530795+0000","last_clean":"2024-07-24T16:24:59.530795+0000","last_became_active":"2024-07-24T16:24:58.248377+0000","last_became_peered":"2024-07-24T16:24:58.248377+0000","last_unstale":"2024-07-24T16:24:59.530795+0000","last_undegraded":"2024-07-24T16:24:59.530795+0000","last_fullsized":"2024-07-24T16:24:59.530795+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:23:13.187696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530736+0000","last_change":"2024-07-24T16:24:58.256057+0000","last_active":"2024-07-24T16:24:59.530736+0000","last_peered":"2024-07-24T16:24:59.530736+0000","last_clean":"2024-07-24T16:24:59.530736+0000","last_became_active":"2024-07-24T16:24:58.255754+0000","last_became_peered":"2024-07-24T16:24:58.255754+0000","last_unstale":"2024-07-24T16:24:59.530736+0000","last_undegraded":"2024-07-24T16:24:59.530736+0000","last_fullsized":"2024-07-24T16:24:59.530736+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:37:09.520707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530557+0000","last_change":"2024-07-24T16:24:58.254218+0000","last_active":"2024-07-24T16:24:59.530557+0000","last_peered":"2024-07-24T16:24:59.530557+0000","last_clean":"2024-07-24T16:24:59.530557+0000","last_became_active":"2024-07-24T16:24:58.253703+0000","last_became_peered":"2024-07-24T16:24:58.253703+0000","last_unstale":"2024-07-24T16:24:59.530557+0000","last_undegraded":"2024-07-24T16:24:59.530557+0000","last_fullsized":"2024-07-24T16:24:59.530557+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:39:42.287606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530407+0000","last_change":"2024-07-24T16:24:58.249338+0000","last_active":"2024-07-24T16:24:59.530407+0000","last_peered":"2024-07-24T16:24:59.530407+0000","last_clean":"2024-07-24T16:24:59.530407+0000","last_became_active":"2024-07-24T16:24:58.249078+0000","last_became_peered":"2024-07-24T16:24:58.249078+0000","last_unstale":"2024-07-24T16:24:59.530407+0000","last_undegraded":"2024-07-24T16:24:59.530407+0000","last_fullsized":"2024-07-24T16:24:59.530407+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:34:47.325399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.246595+0000","last_change":"2024-07-24T16:24:58.249938+0000","last_active":"2024-07-24T16:24:59.246595+0000","last_peered":"2024-07-24T16:24:59.246595+0000","last_clean":"2024-07-24T16:24:59.246595+0000","last_became_active":"2024-07-24T16:24:58.249677+0000","last_became_peered":"2024-07-24T16:24:58.249677+0000","last_unstale":"2024-07-24T16:24:59.246595+0000","last_undegraded":"2024-07-24T16:24:59.246595+0000","last_fullsized":"2024-07-24T16:24:59.246595+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:40:42.218205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530365+0000","last_change":"2024-07-24T16:24:58.246403+0000","last_active":"2024-07-24T16:24:59.530365+0000","last_peered":"2024-07-24T16:24:59.530365+0000","last_clean":"2024-07-24T16:24:59.530365+0000","last_became_active":"2024-07-24T16:24:58.246128+0000","last_became_peered":"2024-07-24T16:24:58.246128+0000","last_unstale":"2024-07-24T16:24:59.530365+0000","last_undegraded":"2024-07-24T16:24:59.530365+0000","last_fullsized":"2024-07-24T16:24:59.530365+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:25:47.214226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291099+0000","last_change":"2024-07-24T16:24:58.259193+0000","last_active":"2024-07-24T16:24:59.291099+0000","last_peered":"2024-07-24T16:24:59.291099+0000","last_clean":"2024-07-24T16:24:59.291099+0000","last_became_active":"2024-07-24T16:24:58.258775+0000","last_became_peered":"2024-07-24T16:24:58.258775+0000","last_unstale":"2024-07-24T16:24:59.291099+0000","last_undegraded":"2024-07-24T16:24:59.291099+0000","last_fullsized":"2024-07-24T16:24:59.291099+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:39.116186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291672+0000","last_change":"2024-07-24T16:24:58.258282+0000","last_active":"2024-07-24T16:24:59.291672+0000","last_peered":"2024-07-24T16:24:59.291672+0000","last_clean":"2024-07-24T16:24:59.291672+0000","last_became_active":"2024-07-24T16:24:58.258011+0000","last_became_peered":"2024-07-24T16:24:58.258011+0000","last_unstale":"2024-07-24T16:24:59.291672+0000","last_undegraded":"2024-07-24T16:24:59.291672+0000","last_fullsized":"2024-07-24T16:24:59.291672+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:21:17.868125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.245431+0000","last_change":"2024-07-24T16:24:58.256056+0000","last_active":"2024-07-24T16:24:59.245431+0000","last_peered":"2024-07-24T16:24:59.245431+0000","last_clean":"2024-07-24T16:24:59.245431+0000","last_became_active":"2024-07-24T16:24:58.255668+0000","last_became_peered":"2024-07-24T16:24:58.255668+0000","last_unstale":"2024-07-24T16:24:59.245431+0000","last_undegraded":"2024-07-24T16:24:59.245431+0000","last_fullsized":"2024-07-24T16:24:59.245431+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:26:14.777498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.242990+0000","last_change":"2024-07-24T16:24:58.246301+0000","last_active":"2024-07-24T16:24:59.242990+0000","last_peered":"2024-07-24T16:24:59.242990+0000","last_clean":"2024-07-24T16:24:59.242990+0000","last_became_active":"2024-07-24T16:24:58.245987+0000","last_became_peered":"2024-07-24T16:24:58.245987+0000","last_unstale":"2024-07-24T16:24:59.242990+0000","last_undegraded":"2024-07-24T16:24:59.242990+0000","last_fullsized":"2024-07-24T16:24:59.242990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:28:37.600528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.245208+0000","last_change":"2024-07-24T16:24:58.254884+0000","last_active":"2024-07-24T16:24:59.245208+0000","last_peered":"2024-07-24T16:24:59.245208+0000","last_clean":"2024-07-24T16:24:59.245208+0000","last_became_active":"2024-07-24T16:24:58.254627+0000","last_became_peered":"2024-07-24T16:24:58.254627+0000","last_unstale":"2024-07-24T16:24:59.245208+0000","last_undegraded":"2024-07-24T16:24:59.245208+0000","last_fullsized":"2024-07-24T16:24:59.245208+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:37:00.544988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530434+0000","last_change":"2024-07-24T16:24:58.243280+0000","last_active":"2024-07-24T16:24:59.530434+0000","last_peered":"2024-07-24T16:24:59.530434+0000","last_clean":"2024-07-24T16:24:59.530434+0000","last_became_active":"2024-07-24T16:24:58.243028+0000","last_became_peered":"2024-07-24T16:24:58.243028+0000","last_unstale":"2024-07-24T16:24:59.530434+0000","last_undegraded":"2024-07-24T16:24:59.530434+0000","last_fullsized":"2024-07-24T16:24:59.530434+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:21:42.373475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.246586+0000","last_change":"2024-07-24T16:24:58.253725+0000","last_active":"2024-07-24T16:24:59.246586+0000","last_peered":"2024-07-24T16:24:59.246586+0000","last_clean":"2024-07-24T16:24:59.246586+0000","last_became_active":"2024-07-24T16:24:58.253444+0000","last_became_peered":"2024-07-24T16:24:58.253444+0000","last_unstale":"2024-07-24T16:24:59.246586+0000","last_undegraded":"2024-07-24T16:24:59.246586+0000","last_fullsized":"2024-07-24T16:24:59.246586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:10:19.790806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291176+0000","last_change":"2024-07-24T16:24:58.259074+0000","last_active":"2024-07-24T16:24:59.291176+0000","last_peered":"2024-07-24T16:24:59.291176+0000","last_clean":"2024-07-24T16:24:59.291176+0000","last_became_active":"2024-07-24T16:24:58.258818+0000","last_became_peered":"2024-07-24T16:24:58.258818+0000","last_unstale":"2024-07-24T16:24:59.291176+0000","last_undegraded":"2024-07-24T16:24:59.291176+0000","last_fullsized":"2024-07-24T16:24:59.291176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:47:38.109117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.242943+0000","last_change":"2024-07-24T16:24:58.251068+0000","last_active":"2024-07-24T16:24:59.242943+0000","last_peered":"2024-07-24T16:24:59.242943+0000","last_clean":"2024-07-24T16:24:59.242943+0000","last_became_active":"2024-07-24T16:24:58.250786+0000","last_became_peered":"2024-07-24T16:24:58.250786+0000","last_unstale":"2024-07-24T16:24:59.242943+0000","last_undegraded":"2024-07-24T16:24:59.242943+0000","last_fullsized":"2024-07-24T16:24:59.242943+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:15:08.272270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.245732+0000","last_change":"2024-07-24T16:24:58.249790+0000","last_active":"2024-07-24T16:24:59.245732+0000","last_peered":"2024-07-24T16:24:59.245732+0000","last_clean":"2024-07-24T16:24:59.245732+0000","last_became_active":"2024-07-24T16:24:58.249160+0000","last_became_peered":"2024-07-24T16:24:58.249160+0000","last_unstale":"2024-07-24T16:24:59.245732+0000","last_undegraded":"2024-07-24T16:24:59.245732+0000","last_fullsized":"2024-07-24T16:24:59.245732+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:44:20.126708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530893+0000","last_change":"2024-07-24T16:24:58.237305+0000","last_active":"2024-07-24T16:24:59.530893+0000","last_peered":"2024-07-24T16:24:59.530893+0000","last_clean":"2024-07-24T16:24:59.530893+0000","last_became_active":"2024-07-24T16:24:58.237026+0000","last_became_peered":"2024-07-24T16:24:58.237026+0000","last_unstale":"2024-07-24T16:24:59.530893+0000","last_undegraded":"2024-07-24T16:24:59.530893+0000","last_fullsized":"2024-07-24T16:24:59.530893+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:39.116186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.245149+0000","last_change":"2024-07-24T16:24:58.243826+0000","last_active":"2024-07-24T16:24:59.245149+0000","last_peered":"2024-07-24T16:24:59.245149+0000","last_clean":"2024-07-24T16:24:59.245149+0000","last_became_active":"2024-07-24T16:24:58.243575+0000","last_became_peered":"2024-07-24T16:24:58.243575+0000","last_unstale":"2024-07-24T16:24:59.245149+0000","last_undegraded":"2024-07-24T16:24:59.245149+0000","last_fullsized":"2024-07-24T16:24:59.245149+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:05:45.265574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530616+0000","last_change":"2024-07-24T16:24:58.253007+0000","last_active":"2024-07-24T16:24:59.530616+0000","last_peered":"2024-07-24T16:24:59.530616+0000","last_clean":"2024-07-24T16:24:59.530616+0000","last_became_active":"2024-07-24T16:24:58.252718+0000","last_became_peered":"2024-07-24T16:24:58.252718+0000","last_unstale":"2024-07-24T16:24:59.530616+0000","last_undegraded":"2024-07-24T16:24:59.530616+0000","last_fullsized":"2024-07-24T16:24:59.530616+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:25:22.752571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.245176+0000","last_change":"2024-07-24T16:24:58.248154+0000","last_active":"2024-07-24T16:24:59.245176+0000","last_peered":"2024-07-24T16:24:59.245176+0000","last_clean":"2024-07-24T16:24:59.245176+0000","last_became_active":"2024-07-24T16:24:58.247578+0000","last_became_peered":"2024-07-24T16:24:58.247578+0000","last_unstale":"2024-07-24T16:24:59.245176+0000","last_undegraded":"2024-07-24T16:24:59.245176+0000","last_fullsized":"2024-07-24T16:24:59.245176+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:16:34.616930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.245123+0000","last_change":"2024-07-24T16:24:58.251634+0000","last_active":"2024-07-24T16:24:59.245123+0000","last_peered":"2024-07-24T16:24:59.245123+0000","last_clean":"2024-07-24T16:24:59.245123+0000","last_became_active":"2024-07-24T16:24:58.251389+0000","last_became_peered":"2024-07-24T16:24:58.251389+0000","last_unstale":"2024-07-24T16:24:59.245123+0000","last_undegraded":"2024-07-24T16:24:59.245123+0000","last_fullsized":"2024-07-24T16:24:59.245123+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:41.675355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291364+0000","last_change":"2024-07-24T16:24:58.259308+0000","last_active":"2024-07-24T16:24:59.291364+0000","last_peered":"2024-07-24T16:24:59.291364+0000","last_clean":"2024-07-24T16:24:59.291364+0000","last_became_active":"2024-07-24T16:24:58.259041+0000","last_became_peered":"2024-07-24T16:24:58.259041+0000","last_unstale":"2024-07-24T16:24:59.291364+0000","last_undegraded":"2024-07-24T16:24:59.291364+0000","last_fullsized":"2024-07-24T16:24:59.291364+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:54:31.345483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530234+0000","last_change":"2024-07-24T16:24:58.243267+0000","last_active":"2024-07-24T16:24:59.530234+0000","last_peered":"2024-07-24T16:24:59.530234+0000","last_clean":"2024-07-24T16:24:59.530234+0000","last_became_active":"2024-07-24T16:24:58.242945+0000","last_became_peered":"2024-07-24T16:24:58.242945+0000","last_unstale":"2024-07-24T16:24:59.530234+0000","last_undegraded":"2024-07-24T16:24:59.530234+0000","last_fullsized":"2024-07-24T16:24:59.530234+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:39:14.832825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291458+0000","last_change":"2024-07-24T16:24:58.257543+0000","last_active":"2024-07-24T16:24:59.291458+0000","last_peered":"2024-07-24T16:24:59.291458+0000","last_clean":"2024-07-24T16:24:59.291458+0000","last_became_active":"2024-07-24T16:24:58.257247+0000","last_became_peered":"2024-07-24T16:24:58.257247+0000","last_unstale":"2024-07-24T16:24:59.291458+0000","last_undegraded":"2024-07-24T16:24:59.291458+0000","last_fullsized":"2024-07-24T16:24:59.291458+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:20:23.135100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"35'4","reported_seq":19,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.245800+0000","last_change":"2024-07-24T16:24:57.248705+0000","last_active":"2024-07-24T16:24:59.245800+0000","last_peered":"2024-07-24T16:24:59.245800+0000","last_clean":"2024-07-24T16:24:59.245800+0000","last_became_active":"2024-07-24T16:24:57.247318+0000","last_became_peered":"2024-07-24T16:24:57.247318+0000","last_unstale":"2024-07-24T16:24:59.245800+0000","last_undegraded":"2024-07-24T16:24:59.245800+0000","last_fullsized":"2024-07-24T16:24:59.245800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:26:15.457315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531150+0000","last_change":"2024-07-24T16:24:58.238031+0000","last_active":"2024-07-24T16:24:59.531150+0000","last_peered":"2024-07-24T16:24:59.531150+0000","last_clean":"2024-07-24T16:24:59.531150+0000","last_became_active":"2024-07-24T16:24:58.237759+0000","last_became_peered":"2024-07-24T16:24:58.237759+0000","last_unstale":"2024-07-24T16:24:59.531150+0000","last_undegraded":"2024-07-24T16:24:59.531150+0000","last_fullsized":"2024-07-24T16:24:59.531150+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:47:38.109117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"35'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530914+0000","last_change":"2024-07-24T16:24:57.245395+0000","last_active":"2024-07-24T16:24:59.530914+0000","last_peered":"2024-07-24T16:24:59.530914+0000","last_clean":"2024-07-24T16:24:59.530914+0000","last_became_active":"2024-07-24T16:24:57.245020+0000","last_became_peered":"2024-07-24T16:24:57.245020+0000","last_unstale":"2024-07-24T16:24:59.530914+0000","last_undegraded":"2024-07-24T16:24:59.530914+0000","last_fullsized":"2024-07-24T16:24:59.530914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:40.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.246885+0000","last_change":"2024-07-24T16:24:58.249523+0000","last_active":"2024-07-24T16:24:59.246885+0000","last_peered":"2024-07-24T16:24:59.246885+0000","last_clean":"2024-07-24T16:24:59.246885+0000","last_became_active":"2024-07-24T16:24:58.248990+0000","last_became_peered":"2024-07-24T16:24:58.248990+0000","last_unstale":"2024-07-24T16:24:59.246885+0000","last_undegraded":"2024-07-24T16:24:59.246885+0000","last_fullsized":"2024-07-24T16:24:59.246885+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:09:53.795239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"35'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531206+0000","last_change":"2024-07-24T16:24:57.246910+0000","last_active":"2024-07-24T16:24:59.531206+0000","last_peered":"2024-07-24T16:24:59.531206+0000","last_clean":"2024-07-24T16:24:59.531206+0000","last_became_active":"2024-07-24T16:24:57.246638+0000","last_became_peered":"2024-07-24T16:24:57.246638+0000","last_unstale":"2024-07-24T16:24:59.531206+0000","last_undegraded":"2024-07-24T16:24:59.531206+0000","last_fullsized":"2024-07-24T16:24:59.531206+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:36:59.542494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531644+0000","last_change":"2024-07-24T16:24:58.256743+0000","last_active":"2024-07-24T16:24:59.531644+0000","last_peered":"2024-07-24T16:24:59.531644+0000","last_clean":"2024-07-24T16:24:59.531644+0000","last_became_active":"2024-07-24T16:24:58.256253+0000","last_became_peered":"2024-07-24T16:24:58.256253+0000","last_unstale":"2024-07-24T16:24:59.531644+0000","last_undegraded":"2024-07-24T16:24:59.531644+0000","last_fullsized":"2024-07-24T16:24:59.531644+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:15:58.265064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"35'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.247181+0000","last_change":"2024-07-24T16:24:57.242358+0000","last_active":"2024-07-24T16:24:59.247181+0000","last_peered":"2024-07-24T16:24:59.247181+0000","last_clean":"2024-07-24T16:24:59.247181+0000","last_became_active":"2024-07-24T16:24:57.242040+0000","last_became_peered":"2024-07-24T16:24:57.242040+0000","last_unstale":"2024-07-24T16:24:59.247181+0000","last_undegraded":"2024-07-24T16:24:59.247181+0000","last_fullsized":"2024-07-24T16:24:59.247181+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:50.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530264+0000","last_change":"2024-07-24T16:24:58.245531+0000","last_active":"2024-07-24T16:24:59.530264+0000","last_peered":"2024-07-24T16:24:59.530264+0000","last_clean":"2024-07-24T16:24:59.530264+0000","last_became_active":"2024-07-24T16:24:58.245236+0000","last_became_peered":"2024-07-24T16:24:58.245236+0000","last_unstale":"2024-07-24T16:24:59.530264+0000","last_undegraded":"2024-07-24T16:24:59.530264+0000","last_fullsized":"2024-07-24T16:24:59.530264+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:40:42.218205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"35'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530568+0000","last_change":"2024-07-24T16:24:57.247796+0000","last_active":"2024-07-24T16:24:59.530568+0000","last_peered":"2024-07-24T16:24:59.530568+0000","last_clean":"2024-07-24T16:24:59.530568+0000","last_became_active":"2024-07-24T16:24:57.247526+0000","last_became_peered":"2024-07-24T16:24:57.247526+0000","last_unstale":"2024-07-24T16:24:59.530568+0000","last_undegraded":"2024-07-24T16:24:59.530568+0000","last_fullsized":"2024-07-24T16:24:59.530568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:12:34.758599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530558+0000","last_change":"2024-07-24T16:24:58.245607+0000","last_active":"2024-07-24T16:24:59.530558+0000","last_peered":"2024-07-24T16:24:59.530558+0000","last_clean":"2024-07-24T16:24:59.530558+0000","last_became_active":"2024-07-24T16:24:58.245108+0000","last_became_peered":"2024-07-24T16:24:58.245108+0000","last_unstale":"2024-07-24T16:24:59.530558+0000","last_undegraded":"2024-07-24T16:24:59.530558+0000","last_fullsized":"2024-07-24T16:24:59.530558+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:21:17.868125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"35'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291179+0000","last_change":"2024-07-24T16:24:57.239638+0000","last_active":"2024-07-24T16:24:59.291179+0000","last_peered":"2024-07-24T16:24:59.291179+0000","last_clean":"2024-07-24T16:24:59.291179+0000","last_became_active":"2024-07-24T16:24:57.239216+0000","last_became_peered":"2024-07-24T16:24:57.239216+0000","last_unstale":"2024-07-24T16:24:59.291179+0000","last_undegraded":"2024-07-24T16:24:59.291179+0000","last_fullsized":"2024-07-24T16:24:59.291179+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:16:33.614437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.246903+0000","last_change":"2024-07-24T16:24:58.246274+0000","last_active":"2024-07-24T16:24:59.246903+0000","last_peered":"2024-07-24T16:24:59.246903+0000","last_clean":"2024-07-24T16:24:59.246903+0000","last_became_active":"2024-07-24T16:24:58.245984+0000","last_became_peered":"2024-07-24T16:24:58.245984+0000","last_unstale":"2024-07-24T16:24:59.246903+0000","last_undegraded":"2024-07-24T16:24:59.246903+0000","last_fullsized":"2024-07-24T16:24:59.246903+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:39:42.287606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530899+0000","last_change":"2024-07-24T16:24:57.247845+0000","last_active":"2024-07-24T16:24:59.530899+0000","last_peered":"2024-07-24T16:24:59.530899+0000","last_clean":"2024-07-24T16:24:59.530899+0000","last_became_active":"2024-07-24T16:24:57.247357+0000","last_became_peered":"2024-07-24T16:24:57.247357+0000","last_unstale":"2024-07-24T16:24:59.530899+0000","last_undegraded":"2024-07-24T16:24:59.530899+0000","last_fullsized":"2024-07-24T16:24:59.530899+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:40.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531586+0000","last_change":"2024-07-24T16:24:58.251338+0000","last_active":"2024-07-24T16:24:59.531586+0000","last_peered":"2024-07-24T16:24:59.531586+0000","last_clean":"2024-07-24T16:24:59.531586+0000","last_became_active":"2024-07-24T16:24:58.250904+0000","last_became_peered":"2024-07-24T16:24:58.250904+0000","last_unstale":"2024-07-24T16:24:59.531586+0000","last_undegraded":"2024-07-24T16:24:59.531586+0000","last_fullsized":"2024-07-24T16:24:59.531586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:21:42.373475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.246277+0000","last_change":"2024-07-24T16:24:57.242475+0000","last_active":"2024-07-24T16:24:59.246277+0000","last_peered":"2024-07-24T16:24:59.246277+0000","last_clean":"2024-07-24T16:24:59.246277+0000","last_became_active":"2024-07-24T16:24:57.242192+0000","last_became_peered":"2024-07-24T16:24:57.242192+0000","last_unstale":"2024-07-24T16:24:59.246277+0000","last_undegraded":"2024-07-24T16:24:59.246277+0000","last_fullsized":"2024-07-24T16:24:59.246277+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:01:46.138088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.242833+0000","last_change":"2024-07-24T16:24:58.255919+0000","last_active":"2024-07-24T16:24:59.242833+0000","last_peered":"2024-07-24T16:24:59.242833+0000","last_clean":"2024-07-24T16:24:59.242833+0000","last_became_active":"2024-07-24T16:24:58.255656+0000","last_became_peered":"2024-07-24T16:24:58.255656+0000","last_unstale":"2024-07-24T16:24:59.242833+0000","last_undegraded":"2024-07-24T16:24:59.242833+0000","last_fullsized":"2024-07-24T16:24:59.242833+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:03:08.483912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531755+0000","last_change":"2024-07-24T16:24:57.239691+0000","last_active":"2024-07-24T16:24:59.531755+0000","last_peered":"2024-07-24T16:24:59.531755+0000","last_clean":"2024-07-24T16:24:59.531755+0000","last_became_active":"2024-07-24T16:24:57.239430+0000","last_became_peered":"2024-07-24T16:24:57.239430+0000","last_unstale":"2024-07-24T16:24:59.531755+0000","last_undegraded":"2024-07-24T16:24:59.531755+0000","last_fullsized":"2024-07-24T16:24:59.531755+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:43:14.534590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291638+0000","last_change":"2024-07-24T16:24:58.250699+0000","last_active":"2024-07-24T16:24:59.291638+0000","last_peered":"2024-07-24T16:24:59.291638+0000","last_clean":"2024-07-24T16:24:59.291638+0000","last_became_active":"2024-07-24T16:24:58.250458+0000","last_became_peered":"2024-07-24T16:24:58.250458+0000","last_unstale":"2024-07-24T16:24:59.291638+0000","last_undegraded":"2024-07-24T16:24:59.291638+0000","last_fullsized":"2024-07-24T16:24:59.291638+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:15:58.265064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530900+0000","last_change":"2024-07-24T16:24:57.246040+0000","last_active":"2024-07-24T16:24:59.530900+0000","last_peered":"2024-07-24T16:24:59.530900+0000","last_clean":"2024-07-24T16:24:59.530900+0000","last_became_active":"2024-07-24T16:24:57.245741+0000","last_became_peered":"2024-07-24T16:24:57.245741+0000","last_unstale":"2024-07-24T16:24:59.530900+0000","last_undegraded":"2024-07-24T16:24:59.530900+0000","last_fullsized":"2024-07-24T16:24:59.530900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:26:13.775005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530807+0000","last_change":"2024-07-24T16:24:58.248028+0000","last_active":"2024-07-24T16:24:59.530807+0000","last_peered":"2024-07-24T16:24:59.530807+0000","last_clean":"2024-07-24T16:24:59.530807+0000","last_became_active":"2024-07-24T16:24:58.247768+0000","last_became_peered":"2024-07-24T16:24:58.247768+0000","last_unstale":"2024-07-24T16:24:59.530807+0000","last_undegraded":"2024-07-24T16:24:59.530807+0000","last_fullsized":"2024-07-24T16:24:59.530807+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:39.116186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"35'3","reported_seq":18,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530871+0000","last_change":"2024-07-24T16:24:57.252143+0000","last_active":"2024-07-24T16:24:59.530871+0000","last_peered":"2024-07-24T16:24:59.530871+0000","last_clean":"2024-07-24T16:24:59.530871+0000","last_became_active":"2024-07-24T16:24:57.251822+0000","last_became_peered":"2024-07-24T16:24:57.251822+0000","last_unstale":"2024-07-24T16:24:59.530871+0000","last_undegraded":"2024-07-24T16:24:59.530871+0000","last_fullsized":"2024-07-24T16:24:59.530871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:36:59.542494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.246973+0000","last_change":"2024-07-24T16:24:58.243650+0000","last_active":"2024-07-24T16:24:59.246973+0000","last_peered":"2024-07-24T16:24:59.246973+0000","last_clean":"2024-07-24T16:24:59.246973+0000","last_became_active":"2024-07-24T16:24:58.243381+0000","last_became_peered":"2024-07-24T16:24:58.243381+0000","last_unstale":"2024-07-24T16:24:59.246973+0000","last_undegraded":"2024-07-24T16:24:59.246973+0000","last_fullsized":"2024-07-24T16:24:59.246973+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:29:56.780913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"35'6","reported_seq":21,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531822+0000","last_change":"2024-07-24T16:24:57.237331+0000","last_active":"2024-07-24T16:24:59.531822+0000","last_peered":"2024-07-24T16:24:59.531822+0000","last_clean":"2024-07-24T16:24:59.531822+0000","last_became_active":"2024-07-24T16:24:57.237045+0000","last_became_peered":"2024-07-24T16:24:57.237045+0000","last_unstale":"2024-07-24T16:24:59.531822+0000","last_undegraded":"2024-07-24T16:24:59.531822+0000","last_fullsized":"2024-07-24T16:24:59.531822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:10:18.788313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530430+0000","last_change":"2024-07-24T16:24:58.246591+0000","last_active":"2024-07-24T16:24:59.530430+0000","last_peered":"2024-07-24T16:24:59.530430+0000","last_clean":"2024-07-24T16:24:59.530430+0000","last_became_active":"2024-07-24T16:24:58.246327+0000","last_became_peered":"2024-07-24T16:24:58.246327+0000","last_unstale":"2024-07-24T16:24:59.530430+0000","last_undegraded":"2024-07-24T16:24:59.530430+0000","last_fullsized":"2024-07-24T16:24:59.530430+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:43:15.537083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"35'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531881+0000","last_change":"2024-07-24T16:24:57.248002+0000","last_active":"2024-07-24T16:24:59.531881+0000","last_peered":"2024-07-24T16:24:59.531881+0000","last_clean":"2024-07-24T16:24:59.531881+0000","last_became_active":"2024-07-24T16:24:57.247736+0000","last_became_peered":"2024-07-24T16:24:57.247736+0000","last_unstale":"2024-07-24T16:24:59.531881+0000","last_undegraded":"2024-07-24T16:24:59.531881+0000","last_fullsized":"2024-07-24T16:24:59.531881+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:51:02.537972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531587+0000","last_change":"2024-07-24T16:24:58.251963+0000","last_active":"2024-07-24T16:24:59.531587+0000","last_peered":"2024-07-24T16:24:59.531587+0000","last_clean":"2024-07-24T16:24:59.531587+0000","last_became_active":"2024-07-24T16:24:58.251686+0000","last_became_peered":"2024-07-24T16:24:58.251686+0000","last_unstale":"2024-07-24T16:24:59.531587+0000","last_undegraded":"2024-07-24T16:24:59.531587+0000","last_fullsized":"2024-07-24T16:24:59.531587+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:02:12.671719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530803+0000","last_change":"2024-07-24T16:24:57.247616+0000","last_active":"2024-07-24T16:24:59.530803+0000","last_peered":"2024-07-24T16:24:59.530803+0000","last_clean":"2024-07-24T16:24:59.530803+0000","last_became_active":"2024-07-24T16:24:57.247334+0000","last_became_peered":"2024-07-24T16:24:57.247334+0000","last_unstale":"2024-07-24T16:24:59.530803+0000","last_undegraded":"2024-07-24T16:24:59.530803+0000","last_fullsized":"2024-07-24T16:24:59.530803+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:16:33.614437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291347+0000","last_change":"2024-07-24T16:24:58.259334+0000","last_active":"2024-07-24T16:24:59.291347+0000","last_peered":"2024-07-24T16:24:59.291347+0000","last_clean":"2024-07-24T16:24:59.291347+0000","last_became_active":"2024-07-24T16:24:58.259058+0000","last_became_peered":"2024-07-24T16:24:58.259058+0000","last_unstale":"2024-07-24T16:24:59.291347+0000","last_undegraded":"2024-07-24T16:24:59.291347+0000","last_fullsized":"2024-07-24T16:24:59.291347+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:56:36.062920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.244867+0000","last_change":"2024-07-24T16:24:57.250024+0000","last_active":"2024-07-24T16:24:59.244867+0000","last_peered":"2024-07-24T16:24:59.244867+0000","last_clean":"2024-07-24T16:24:59.244867+0000","last_became_active":"2024-07-24T16:24:57.249723+0000","last_became_peered":"2024-07-24T16:24:57.249723+0000","last_unstale":"2024-07-24T16:24:59.244867+0000","last_undegraded":"2024-07-24T16:24:59.244867+0000","last_fullsized":"2024-07-24T16:24:59.244867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:03:07.481419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531908+0000","last_change":"2024-07-24T16:24:58.251233+0000","last_active":"2024-07-24T16:24:59.531908+0000","last_peered":"2024-07-24T16:24:59.531908+0000","last_clean":"2024-07-24T16:24:59.531908+0000","last_became_active":"2024-07-24T16:24:58.250683+0000","last_became_peered":"2024-07-24T16:24:58.250683+0000","last_unstale":"2024-07-24T16:24:59.531908+0000","last_undegraded":"2024-07-24T16:24:59.531908+0000","last_fullsized":"2024-07-24T16:24:59.531908+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:55:07.617688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"35'8","reported_seq":23,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291112+0000","last_change":"2024-07-24T16:24:57.238606+0000","last_active":"2024-07-24T16:24:59.291112+0000","last_peered":"2024-07-24T16:24:59.291112+0000","last_clean":"2024-07-24T16:24:59.291112+0000","last_became_active":"2024-07-24T16:24:57.238268+0000","last_became_peered":"2024-07-24T16:24:57.238268+0000","last_unstale":"2024-07-24T16:24:59.291112+0000","last_undegraded":"2024-07-24T16:24:59.291112+0000","last_fullsized":"2024-07-24T16:24:59.291112+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:40.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531655+0000","last_change":"2024-07-24T16:24:58.252868+0000","last_active":"2024-07-24T16:24:59.531655+0000","last_peered":"2024-07-24T16:24:59.531655+0000","last_clean":"2024-07-24T16:24:59.531655+0000","last_became_active":"2024-07-24T16:24:58.252274+0000","last_became_peered":"2024-07-24T16:24:58.252274+0000","last_unstale":"2024-07-24T16:24:59.531655+0000","last_undegraded":"2024-07-24T16:24:59.531655+0000","last_fullsized":"2024-07-24T16:24:59.531655+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:23:13.187696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"35'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530890+0000","last_change":"2024-07-24T16:24:57.247263+0000","last_active":"2024-07-24T16:24:59.530890+0000","last_peered":"2024-07-24T16:24:59.530890+0000","last_clean":"2024-07-24T16:24:59.530890+0000","last_became_active":"2024-07-24T16:24:57.246829+0000","last_became_peered":"2024-07-24T16:24:57.246829+0000","last_unstale":"2024-07-24T16:24:59.530890+0000","last_undegraded":"2024-07-24T16:24:59.530890+0000","last_fullsized":"2024-07-24T16:24:59.530890+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:44:19.124214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530806+0000","last_change":"2024-07-24T16:24:58.242526+0000","last_active":"2024-07-24T16:24:59.530806+0000","last_peered":"2024-07-24T16:24:59.530806+0000","last_clean":"2024-07-24T16:24:59.530806+0000","last_became_active":"2024-07-24T16:24:58.242257+0000","last_became_peered":"2024-07-24T16:24:58.242257+0000","last_unstale":"2024-07-24T16:24:59.530806+0000","last_undegraded":"2024-07-24T16:24:59.530806+0000","last_fullsized":"2024-07-24T16:24:59.530806+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:02:12.671719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"35'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.246933+0000","last_change":"2024-07-24T16:24:57.246981+0000","last_active":"2024-07-24T16:24:59.246933+0000","last_peered":"2024-07-24T16:24:59.246933+0000","last_clean":"2024-07-24T16:24:59.246933+0000","last_became_active":"2024-07-24T16:24:57.246677+0000","last_became_peered":"2024-07-24T16:24:57.246677+0000","last_unstale":"2024-07-24T16:24:59.246933+0000","last_undegraded":"2024-07-24T16:24:59.246933+0000","last_fullsized":"2024-07-24T16:24:59.246933+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:40.672862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.246760+0000","last_change":"2024-07-24T16:24:58.254935+0000","last_active":"2024-07-24T16:24:59.246760+0000","last_peered":"2024-07-24T16:24:59.246760+0000","last_clean":"2024-07-24T16:24:59.246760+0000","last_became_active":"2024-07-24T16:24:58.254580+0000","last_became_peered":"2024-07-24T16:24:58.254580+0000","last_unstale":"2024-07-24T16:24:59.246760+0000","last_undegraded":"2024-07-24T16:24:59.246760+0000","last_fullsized":"2024-07-24T16:24:59.246760+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:43:15.537083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"35'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.242880+0000","last_change":"2024-07-24T16:24:57.246148+0000","last_active":"2024-07-24T16:24:59.242880+0000","last_peered":"2024-07-24T16:24:59.242880+0000","last_clean":"2024-07-24T16:24:59.242880+0000","last_became_active":"2024-07-24T16:24:57.245850+0000","last_became_peered":"2024-07-24T16:24:57.245850+0000","last_unstale":"2024-07-24T16:24:59.242880+0000","last_undegraded":"2024-07-24T16:24:59.242880+0000","last_fullsized":"2024-07-24T16:24:59.242880+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:53:51.260978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.242941+0000","last_change":"2024-07-24T16:24:58.257530+0000","last_active":"2024-07-24T16:24:59.242941+0000","last_peered":"2024-07-24T16:24:59.242941+0000","last_clean":"2024-07-24T16:24:59.242941+0000","last_became_active":"2024-07-24T16:24:58.257271+0000","last_became_peered":"2024-07-24T16:24:58.257271+0000","last_unstale":"2024-07-24T16:24:59.242941+0000","last_undegraded":"2024-07-24T16:24:59.242941+0000","last_fullsized":"2024-07-24T16:24:59.242941+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:11:27.764159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530793+0000","last_change":"2024-07-24T16:24:57.244659+0000","last_active":"2024-07-24T16:24:59.530793+0000","last_peered":"2024-07-24T16:24:59.530793+0000","last_clean":"2024-07-24T16:24:59.530793+0000","last_became_active":"2024-07-24T16:24:57.244361+0000","last_became_peered":"2024-07-24T16:24:57.244361+0000","last_unstale":"2024-07-24T16:24:59.530793+0000","last_undegraded":"2024-07-24T16:24:59.530793+0000","last_fullsized":"2024-07-24T16:24:59.530793+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:05:44.263080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291350+0000","last_change":"2024-07-24T16:24:58.260056+0000","last_active":"2024-07-24T16:24:59.291350+0000","last_peered":"2024-07-24T16:24:59.291350+0000","last_clean":"2024-07-24T16:24:59.291350+0000","last_became_active":"2024-07-24T16:24:58.259665+0000","last_became_peered":"2024-07-24T16:24:58.259665+0000","last_unstale":"2024-07-24T16:24:59.291350+0000","last_undegraded":"2024-07-24T16:24:59.291350+0000","last_fullsized":"2024-07-24T16:24:59.291350+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:34:47.325399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"35'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.242745+0000","last_change":"2024-07-24T16:24:57.249844+0000","last_active":"2024-07-24T16:24:59.242745+0000","last_peered":"2024-07-24T16:24:59.242745+0000","last_clean":"2024-07-24T16:24:59.242745+0000","last_became_active":"2024-07-24T16:24:57.249555+0000","last_became_peered":"2024-07-24T16:24:57.249555+0000","last_unstale":"2024-07-24T16:24:59.242745+0000","last_undegraded":"2024-07-24T16:24:59.242745+0000","last_fullsized":"2024-07-24T16:24:59.242745+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:17:08.215537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530498+0000","last_change":"2024-07-24T16:24:58.252841+0000","last_active":"2024-07-24T16:24:59.530498+0000","last_peered":"2024-07-24T16:24:59.530498+0000","last_clean":"2024-07-24T16:24:59.530498+0000","last_became_active":"2024-07-24T16:24:58.248596+0000","last_became_peered":"2024-07-24T16:24:58.248596+0000","last_unstale":"2024-07-24T16:24:59.530498+0000","last_undegraded":"2024-07-24T16:24:59.530498+0000","last_fullsized":"2024-07-24T16:24:59.530498+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:09:53.795239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.242661+0000","last_change":"2024-07-24T16:24:57.247926+0000","last_active":"2024-07-24T16:24:59.242661+0000","last_peered":"2024-07-24T16:24:59.242661+0000","last_clean":"2024-07-24T16:24:59.242661+0000","last_became_active":"2024-07-24T16:24:57.247680+0000","last_became_peered":"2024-07-24T16:24:57.247680+0000","last_unstale":"2024-07-24T16:24:59.242661+0000","last_undegraded":"2024-07-24T16:24:59.242661+0000","last_fullsized":"2024-07-24T16:24:59.242661+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:21:22.969482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530471+0000","last_change":"2024-07-24T16:24:58.253171+0000","last_active":"2024-07-24T16:24:59.530471+0000","last_peered":"2024-07-24T16:24:59.530471+0000","last_clean":"2024-07-24T16:24:59.530471+0000","last_became_active":"2024-07-24T16:24:58.252802+0000","last_became_peered":"2024-07-24T16:24:58.252802+0000","last_unstale":"2024-07-24T16:24:59.530471+0000","last_undegraded":"2024-07-24T16:24:59.530471+0000","last_fullsized":"2024-07-24T16:24:59.530471+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:15:58.265064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291404+0000","last_change":"2024-07-24T16:24:57.248109+0000","last_active":"2024-07-24T16:24:59.291404+0000","last_peered":"2024-07-24T16:24:59.291404+0000","last_clean":"2024-07-24T16:24:59.291404+0000","last_became_active":"2024-07-24T16:24:57.247809+0000","last_became_peered":"2024-07-24T16:24:57.247809+0000","last_unstale":"2024-07-24T16:24:59.291404+0000","last_undegraded":"2024-07-24T16:24:59.291404+0000","last_fullsized":"2024-07-24T16:24:59.291404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:05:44.263080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531791+0000","last_change":"2024-07-24T16:24:58.251479+0000","last_active":"2024-07-24T16:24:59.531791+0000","last_peered":"2024-07-24T16:24:59.531791+0000","last_clean":"2024-07-24T16:24:59.531791+0000","last_became_active":"2024-07-24T16:24:58.251023+0000","last_became_peered":"2024-07-24T16:24:58.251023+0000","last_unstale":"2024-07-24T16:24:59.531791+0000","last_undegraded":"2024-07-24T16:24:59.531791+0000","last_fullsized":"2024-07-24T16:24:59.531791+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:38:24.196063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.242589+0000","last_change":"2024-07-24T16:24:57.247519+0000","last_active":"2024-07-24T16:24:59.242589+0000","last_peered":"2024-07-24T16:24:59.242589+0000","last_clean":"2024-07-24T16:24:59.242589+0000","last_became_active":"2024-07-24T16:24:57.247224+0000","last_became_peered":"2024-07-24T16:24:57.247224+0000","last_unstale":"2024-07-24T16:24:59.242589+0000","last_undegraded":"2024-07-24T16:24:59.242589+0000","last_fullsized":"2024-07-24T16:24:59.242589+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:53:02.676052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530688+0000","last_change":"2024-07-24T16:24:58.237457+0000","last_active":"2024-07-24T16:24:59.530688+0000","last_peered":"2024-07-24T16:24:59.530688+0000","last_clean":"2024-07-24T16:24:59.530688+0000","last_became_active":"2024-07-24T16:24:58.236447+0000","last_became_peered":"2024-07-24T16:24:58.236447+0000","last_unstale":"2024-07-24T16:24:59.530688+0000","last_undegraded":"2024-07-24T16:24:59.530688+0000","last_fullsized":"2024-07-24T16:24:59.530688+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:39:42.287606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"35'2","reported_seq":17,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531010+0000","last_change":"2024-07-24T16:24:57.251681+0000","last_active":"2024-07-24T16:24:59.531010+0000","last_peered":"2024-07-24T16:24:59.531010+0000","last_clean":"2024-07-24T16:24:59.531010+0000","last_became_active":"2024-07-24T16:24:57.251383+0000","last_became_peered":"2024-07-24T16:24:57.251383+0000","last_unstale":"2024-07-24T16:24:59.531010+0000","last_undegraded":"2024-07-24T16:24:59.531010+0000","last_fullsized":"2024-07-24T16:24:59.531010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:51:02.537972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291624+0000","last_change":"2024-07-24T16:24:58.252082+0000","last_active":"2024-07-24T16:24:59.291624+0000","last_peered":"2024-07-24T16:24:59.291624+0000","last_clean":"2024-07-24T16:24:59.291624+0000","last_became_active":"2024-07-24T16:24:58.251752+0000","last_became_peered":"2024-07-24T16:24:58.251752+0000","last_unstale":"2024-07-24T16:24:59.291624+0000","last_undegraded":"2024-07-24T16:24:59.291624+0000","last_fullsized":"2024-07-24T16:24:59.291624+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:21:42.373475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"36'1","reported_seq":16,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.242806+0000","last_change":"2024-07-24T16:24:57.249314+0000","last_active":"2024-07-24T16:24:59.242806+0000","last_peered":"2024-07-24T16:24:59.242806+0000","last_clean":"2024-07-24T16:24:59.242806+0000","last_became_active":"2024-07-24T16:24:57.249068+0000","last_became_peered":"2024-07-24T16:24:57.249068+0000","last_unstale":"2024-07-24T16:24:59.242806+0000","last_undegraded":"2024-07-24T16:24:59.242806+0000","last_fullsized":"2024-07-24T16:24:59.242806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:54:07.795993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531698+0000","last_change":"2024-07-24T16:24:58.256818+0000","last_active":"2024-07-24T16:24:59.531698+0000","last_peered":"2024-07-24T16:24:59.531698+0000","last_clean":"2024-07-24T16:24:59.531698+0000","last_became_active":"2024-07-24T16:24:58.256416+0000","last_became_peered":"2024-07-24T16:24:58.256416+0000","last_unstale":"2024-07-24T16:24:59.531698+0000","last_undegraded":"2024-07-24T16:24:59.531698+0000","last_fullsized":"2024-07-24T16:24:59.531698+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:21:17.868125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531041+0000","last_change":"2024-07-24T16:24:57.251715+0000","last_active":"2024-07-24T16:24:59.531041+0000","last_peered":"2024-07-24T16:24:59.531041+0000","last_clean":"2024-07-24T16:24:59.531041+0000","last_became_active":"2024-07-24T16:24:57.251432+0000","last_became_peered":"2024-07-24T16:24:57.251432+0000","last_unstale":"2024-07-24T16:24:59.531041+0000","last_undegraded":"2024-07-24T16:24:59.531041+0000","last_fullsized":"2024-07-24T16:24:59.531041+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:56:50.648930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530569+0000","last_change":"2024-07-24T16:24:58.253953+0000","last_active":"2024-07-24T16:24:59.530569+0000","last_peered":"2024-07-24T16:24:59.530569+0000","last_clean":"2024-07-24T16:24:59.530569+0000","last_became_active":"2024-07-24T16:24:58.253685+0000","last_became_peered":"2024-07-24T16:24:58.253685+0000","last_unstale":"2024-07-24T16:24:59.530569+0000","last_undegraded":"2024-07-24T16:24:59.530569+0000","last_fullsized":"2024-07-24T16:24:59.530569+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:29:56.780913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530945+0000","last_change":"2024-07-24T16:24:57.250429+0000","last_active":"2024-07-24T16:24:59.530945+0000","last_peered":"2024-07-24T16:24:59.530945+0000","last_clean":"2024-07-24T16:24:59.530945+0000","last_became_active":"2024-07-24T16:24:57.250254+0000","last_became_peered":"2024-07-24T16:24:57.250254+0000","last_unstale":"2024-07-24T16:24:59.530945+0000","last_undegraded":"2024-07-24T16:24:59.530945+0000","last_fullsized":"2024-07-24T16:24:59.530945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530406+0000","last_change":"2024-07-24T16:24:58.250343+0000","last_active":"2024-07-24T16:24:59.530406+0000","last_peered":"2024-07-24T16:24:59.530406+0000","last_clean":"2024-07-24T16:24:59.530406+0000","last_became_active":"2024-07-24T16:24:58.250057+0000","last_became_peered":"2024-07-24T16:24:58.250057+0000","last_unstale":"2024-07-24T16:24:59.530406+0000","last_undegraded":"2024-07-24T16:24:59.530406+0000","last_fullsized":"2024-07-24T16:24:59.530406+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:09:53.795239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.245270+0000","last_change":"2024-07-24T16:24:57.244665+0000","last_active":"2024-07-24T16:24:59.245270+0000","last_peered":"2024-07-24T16:24:59.245270+0000","last_clean":"2024-07-24T16:24:59.245270+0000","last_became_active":"2024-07-24T16:24:57.244293+0000","last_became_peered":"2024-07-24T16:24:57.244293+0000","last_unstale":"2024-07-24T16:24:59.245270+0000","last_undegraded":"2024-07-24T16:24:59.245270+0000","last_fullsized":"2024-07-24T16:24:59.245270+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:15:07.269777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.246786+0000","last_change":"2024-07-24T16:24:58.251232+0000","last_active":"2024-07-24T16:24:59.246786+0000","last_peered":"2024-07-24T16:24:59.246786+0000","last_clean":"2024-07-24T16:24:59.246786+0000","last_became_active":"2024-07-24T16:24:58.250929+0000","last_became_peered":"2024-07-24T16:24:58.250929+0000","last_unstale":"2024-07-24T16:24:59.246786+0000","last_undegraded":"2024-07-24T16:24:59.246786+0000","last_fullsized":"2024-07-24T16:24:59.246786+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:39:14.832825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.246462+0000","last_change":"2024-07-24T16:24:57.243037+0000","last_active":"2024-07-24T16:24:59.246462+0000","last_peered":"2024-07-24T16:24:59.246462+0000","last_clean":"2024-07-24T16:24:59.246462+0000","last_became_active":"2024-07-24T16:24:57.242776+0000","last_became_peered":"2024-07-24T16:24:57.242776+0000","last_unstale":"2024-07-24T16:24:59.246462+0000","last_undegraded":"2024-07-24T16:24:59.246462+0000","last_fullsized":"2024-07-24T16:24:59.246462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:26:10.894295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291465+0000","last_change":"2024-07-24T16:24:58.251464+0000","last_active":"2024-07-24T16:24:59.291465+0000","last_peered":"2024-07-24T16:24:59.291465+0000","last_clean":"2024-07-24T16:24:59.291465+0000","last_became_active":"2024-07-24T16:24:58.251192+0000","last_became_peered":"2024-07-24T16:24:58.251192+0000","last_unstale":"2024-07-24T16:24:59.291465+0000","last_undegraded":"2024-07-24T16:24:59.291465+0000","last_fullsized":"2024-07-24T16:24:59.291465+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:25:47.214226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.531405+0000","last_change":"2024-07-24T16:24:57.239764+0000","last_active":"2024-07-24T16:24:59.531405+0000","last_peered":"2024-07-24T16:24:59.531405+0000","last_clean":"2024-07-24T16:24:59.531405+0000","last_became_active":"2024-07-24T16:24:57.239454+0000","last_became_peered":"2024-07-24T16:24:57.239454+0000","last_unstale":"2024-07-24T16:24:59.531405+0000","last_undegraded":"2024-07-24T16:24:59.531405+0000","last_fullsized":"2024-07-24T16:24:59.531405+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:40:41.215712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":13,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.530865+0000","last_change":"2024-07-24T16:24:58.255172+0000","last_active":"2024-07-24T16:24:59.530865+0000","last_peered":"2024-07-24T16:24:59.530865+0000","last_clean":"2024-07-24T16:24:59.530865+0000","last_became_active":"2024-07-24T16:24:58.254874+0000","last_became_peered":"2024-07-24T16:24:58.254874+0000","last_unstale":"2024-07-24T16:24:59.530865+0000","last_undegraded":"2024-07-24T16:24:59.530865+0000","last_fullsized":"2024-07-24T16:24:59.530865+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:57.221433+0000","last_clean_scrub_stamp":"2024-07-24T16:24:57.221433+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:38:24.196063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":15,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291600+0000","last_change":"2024-07-24T16:24:57.247349+0000","last_active":"2024-07-24T16:24:59.291600+0000","last_peered":"2024-07-24T16:24:59.291600+0000","last_clean":"2024-07-24T16:24:59.291600+0000","last_became_active":"2024-07-24T16:24:57.246965+0000","last_became_peered":"2024-07-24T16:24:57.246965+0000","last_unstale":"2024-07-24T16:24:59.291600+0000","last_undegraded":"2024-07-24T16:24:59.291600+0000","last_fullsized":"2024-07-24T16:24:59.291600+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:24:56.218939+0000","last_clean_scrub_stamp":"2024-07-24T16:24:56.218939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:36:59.542494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":137,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-07-24T16:24:59.291277+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:24:59.291277+0000","last_peered":"2024-07-24T16:24:59.291277+0000","last_clean":"2024-07-24T16:24:59.291277+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:24:59.291277+0000","last_undegraded":"2024-07-24T16:24:59.291277+0000","last_fullsized":"2024-07-24T16:24:59.291277+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1024000,"data_stored":766975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":175507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":175037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27432,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344408,"statfs":{"total":96636764160,"available":96608673792,"internally_reserved":0,"allocated":421888,"data_stored":175529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27440,"kb_used_data":420,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344400,"statfs":{"total":96636764160,"available":96608665600,"internally_reserved":0,"allocated":430080,"data_stored":176571,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":174995,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":417792,"data_stored":175015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343832,"statfs":{"total":96636764160,"available":96608083968,"internally_reserved":0,"allocated":1011712,"data_stored":765327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:25:06.019 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-07-24T16:25:06.019 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-07-24T16:25:06.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.163+0000 7f69f2465640 1 -- 172.21.15.159:0/1513752842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec0cd130 msgr2=0x7f69ec166140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:06.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.163+0000 7f69f2465640 1 --2- 172.21.15.159:0/1513752842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec0cd130 0x7f69ec166140 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f69e4005fd0 tx=0x7f69e402a940 comp rx=0 tx=0).stop 2024-07-24T16:25:06.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.163+0000 7f69f2465640 1 -- 172.21.15.159:0/1513752842 shutdown_connections 2024-07-24T16:25:06.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.163+0000 7f69f2465640 1 --2- 172.21.15.159:0/1513752842 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec0cd130 0x7f69ec166140 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.163+0000 7f69f2465640 1 -- 172.21.15.159:0/1513752842 >> 172.21.15.159:0/1513752842 conn(0x7f69ec06d450 msgr2=0x7f69ec06d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:06.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.163+0000 7f69f2465640 1 -- 172.21.15.159:0/1513752842 shutdown_connections 2024-07-24T16:25:06.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.163+0000 7f69f2465640 1 -- 172.21.15.159:0/1513752842 wait complete. 2024-07-24T16:25:06.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.164+0000 7f69f2465640 1 Processor -- start 2024-07-24T16:25:06.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.165+0000 7f69f2465640 1 -- start start 2024-07-24T16:25:06.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.165+0000 7f69f2465640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69ec0cd130 0x7f69ec137700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:06.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.165+0000 7f69f2465640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69ec0cf840 0x7f69ec0a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:06.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.165+0000 7f69f2465640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec1524f0 0x7f69ec0afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:06.172 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.165+0000 7f69f2465640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec166890 con 0x7f69ec1524f0 2024-07-24T16:25:06.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.165+0000 7f69f2465640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f69ec15cc80 con 0x7f69ec0cf840 2024-07-24T16:25:06.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.165+0000 7f69f2465640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f69ec166a10 con 0x7f69ec0cd130 2024-07-24T16:25:06.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.165+0000 7f69f0a02640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec1524f0 0x7f69ec0afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:06.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.165+0000 7f69f0a02640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec1524f0 0x7f69ec0afa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43416/0 (socket says 172.21.15.159:43416) 2024-07-24T16:25:06.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.165+0000 7f69f0a02640 1 -- 172.21.15.159:0/1366317714 learned_addr learned my addr 172.21.15.159:0/1366317714 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:06.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.166+0000 7f69f0a02640 1 -- 172.21.15.159:0/1366317714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69ec0cd130 msgr2=0x7f69ec137700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:06.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.166+0000 7f69f0a02640 1 --2- 172.21.15.159:0/1366317714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69ec0cd130 0x7f69ec137700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.166+0000 7f69eb7fe640 1 --2- 172.21.15.159:0/1366317714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69ec0cf840 0x7f69ec0a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:06.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.166+0000 7f69f0a02640 1 -- 172.21.15.159:0/1366317714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69ec0cf840 msgr2=0x7f69ec0a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:06.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.166+0000 7f69f0a02640 1 --2- 172.21.15.159:0/1366317714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69ec0cf840 0x7f69ec0a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.174 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.166+0000 7f69f0a02640 1 -- 172.21.15.159:0/1366317714 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ec0a9f20 con 0x7f69ec1524f0 2024-07-24T16:25:06.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.166+0000 7f69f0a02640 1 --2- 172.21.15.159:0/1366317714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec1524f0 0x7f69ec0afa10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f69e402af30 tx=0x7f69e4031e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:06.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.166+0000 7f69e8ff9640 1 -- 172.21.15.159:0/1366317714 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4030430 con 0x7f69ec1524f0 2024-07-24T16:25:06.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.166+0000 7f69e8ff9640 1 -- 172.21.15.159:0/1366317714 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69e4004240 con 0x7f69ec1524f0 2024-07-24T16:25:06.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.166+0000 7f69e8ff9640 1 -- 172.21.15.159:0/1366317714 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e4003e60 con 0x7f69ec1524f0 2024-07-24T16:25:06.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.166+0000 7f69f2465640 1 -- 172.21.15.159:0/1366317714 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ec0aa200 con 0x7f69ec1524f0 2024-07-24T16:25:06.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.166+0000 7f69f2465640 1 -- 172.21.15.159:0/1366317714 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ec138440 con 0x7f69ec1524f0 2024-07-24T16:25:06.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.167+0000 7f69f2465640 1 -- 172.21.15.159:0/1366317714 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69ec0aa440 con 0x7f69ec1524f0 2024-07-24T16:25:06.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.168+0000 7f69e8ff9640 1 -- 172.21.15.159:0/1366317714 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f69e4004650 con 0x7f69ec1524f0 2024-07-24T16:25:06.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.168+0000 7f69e8ff9640 1 --2- 172.21.15.159:0/1366317714 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69d8077010 0x7f69d80794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:06.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.169+0000 7f69e8ff9640 1 -- 172.21.15.159:0/1366317714 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f69e40ba2f0 con 0x7f69ec1524f0 2024-07-24T16:25:06.176 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.169+0000 7f69ebfff640 1 --2- 172.21.15.159:0/1366317714 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69d8077010 0x7f69d80794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:06.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.169+0000 7f69ebfff640 1 --2- 172.21.15.159:0/1366317714 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69d8077010 0x7f69d80794d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0ae9d0 tx=0x7f69dc0079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:06.177 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.173+0000 7f69e8ff9640 1 -- 172.21.15.159:0/1366317714 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f69ec0aa440 con 0x7f69ec1524f0 2024-07-24T16:25:06.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.430+0000 7f69f2465640 1 -- 172.21.15.159:0/1366317714 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f69ec0cca20 con 0x7f69ec1524f0 2024-07-24T16:25:06.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.437+0000 7f69e8ff9640 1 -- 172.21.15.159:0/1366317714 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f69e4083480 con 0x7f69ec1524f0 2024-07-24T16:25:06.439 INFO:teuthology.orchestra.run.smithi159.stdout:[client.0] 2024-07-24T16:25:06.439 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBwKqFmSByWLRAAlc1hHDXFceGP9BYk8GpZJA== 2024-07-24T16:25:06.439 INFO:teuthology.orchestra.run.smithi159.stdout: caps mds = "allow" 2024-07-24T16:25:06.440 INFO:teuthology.orchestra.run.smithi159.stdout: caps mon = "allow r" 2024-07-24T16:25:06.440 INFO:teuthology.orchestra.run.smithi159.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-07-24T16:25:06.440 INFO:teuthology.orchestra.run.smithi159.stderr:updated caps for client.0 2024-07-24T16:25:06.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.439+0000 7f69f2465640 1 -- 172.21.15.159:0/1366317714 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69d8077010 msgr2=0x7f69d80794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:06.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.439+0000 7f69f2465640 1 --2- 172.21.15.159:0/1366317714 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69d8077010 0x7f69d80794d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f69ec0ae9d0 tx=0x7f69dc0079d0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.439+0000 7f69f2465640 1 -- 172.21.15.159:0/1366317714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec1524f0 msgr2=0x7f69ec0afa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:06.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.439+0000 7f69f2465640 1 --2- 172.21.15.159:0/1366317714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec1524f0 0x7f69ec0afa10 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f69e402af30 tx=0x7f69e4031e20 comp rx=0 tx=0).stop 2024-07-24T16:25:06.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.439+0000 7f69f2465640 1 -- 172.21.15.159:0/1366317714 shutdown_connections 2024-07-24T16:25:06.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.439+0000 7f69f2465640 1 --2- 172.21.15.159:0/1366317714 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f69d8077010 0x7f69d80794d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.439+0000 7f69f2465640 1 --2- 172.21.15.159:0/1366317714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f69ec1524f0 0x7f69ec0afa10 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.439+0000 7f69f2465640 1 --2- 172.21.15.159:0/1366317714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f69ec0cf840 0x7f69ec0a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.439+0000 7f69f2465640 1 --2- 172.21.15.159:0/1366317714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f69ec0cd130 0x7f69ec137700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.439+0000 7f69f2465640 1 -- 172.21.15.159:0/1366317714 >> 172.21.15.159:0/1366317714 conn(0x7f69ec06d450 msgr2=0x7f69ec06d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:06.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.439+0000 7f69f2465640 1 -- 172.21.15.159:0/1366317714 shutdown_connections 2024-07-24T16:25:06.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.439+0000 7f69f2465640 1 -- 172.21.15.159:0/1366317714 wait complete. 2024-07-24T16:25:06.453 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:25:06.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.553+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/3170618017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5b0150cc0 msgr2=0x7fc5b015ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:06.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.553+0000 7fc5b7a8d640 1 --2- 172.21.15.159:0/3170618017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5b0150cc0 0x7fc5b015ad80 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc5b00d0430 tx=0x7fc5a002b7b0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.553+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/3170618017 shutdown_connections 2024-07-24T16:25:06.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.553+0000 7fc5b7a8d640 1 --2- 172.21.15.159:0/3170618017 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5b006d670 0x7fc5b006dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.553+0000 7fc5b7a8d640 1 --2- 172.21.15.159:0/3170618017 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5b0150cc0 0x7fc5b015ad80 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.553+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/3170618017 >> 172.21.15.159:0/3170618017 conn(0x7fc5b006c560 msgr2=0x7fc5b006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:06.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.553+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/3170618017 shutdown_connections 2024-07-24T16:25:06.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.553+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/3170618017 wait complete. 2024-07-24T16:25:06.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.554+0000 7fc5b7a8d640 1 Processor -- start 2024-07-24T16:25:06.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.554+0000 7fc5b7a8d640 1 -- start start 2024-07-24T16:25:06.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b7a8d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5b006d670 0x7fc5b01f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:06.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b7a8d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5b00b41d0 0x7fc5b01f0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:06.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b7a8d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5b0150cc0 0x7fc5b00acca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:06.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b7a8d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b00cf840 con 0x7fc5b0150cc0 2024-07-24T16:25:06.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b7a8d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc5b00cf6c0 con 0x7fc5b006d670 2024-07-24T16:25:06.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b7a8d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b00cf9c0 con 0x7fc5b00b41d0 2024-07-24T16:25:06.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b602a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5b0150cc0 0x7fc5b00acca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:06.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b602a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5b0150cc0 0x7fc5b00acca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43432/0 (socket says 172.21.15.159:43432) 2024-07-24T16:25:06.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b602a640 1 -- 172.21.15.159:0/2631523190 learned_addr learned my addr 172.21.15.159:0/2631523190 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:06.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b5829640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5b006d670 0x7fc5b01f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b5028640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5b00b41d0 0x7fc5b01f0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b602a640 1 -- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5b00b41d0 msgr2=0x7fc5b01f0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b602a640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5b00b41d0 0x7fc5b01f0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b602a640 1 -- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5b006d670 msgr2=0x7fc5b01f2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b602a640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5b006d670 0x7fc5b01f2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.555+0000 7fc5b602a640 1 -- 172.21.15.159:0/2631523190 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b01f34c0 con 0x7fc5b0150cc0 2024-07-24T16:25:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.556+0000 7fc5b602a640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5b0150cc0 0x7fc5b00acca0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009fd0 tx=0x7fc5a800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.556+0000 7fc5ae7fc640 1 -- 172.21.15.159:0/2631523190 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8011830 con 0x7fc5b0150cc0 2024-07-24T16:25:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.556+0000 7fc5ae7fc640 1 -- 172.21.15.159:0/2631523190 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc5a8016070 con 0x7fc5b0150cc0 2024-07-24T16:25:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.556+0000 7fc5ae7fc640 1 -- 172.21.15.159:0/2631523190 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5a8011d40 con 0x7fc5b0150cc0 2024-07-24T16:25:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.556+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/2631523190 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5b01f3c80 con 0x7fc5b0150cc0 2024-07-24T16:25:06.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.556+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/2631523190 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b01f4240 con 0x7fc5b0150cc0 2024-07-24T16:25:06.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.557+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/2631523190 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b006dae0 con 0x7fc5b0150cc0 2024-07-24T16:25:06.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.557+0000 7fc5ae7fc640 1 -- 172.21.15.159:0/2631523190 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7fc5a801b460 con 0x7fc5b0150cc0 2024-07-24T16:25:06.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.558+0000 7fc5ae7fc640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fc59c077010 0x7fc59c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:06.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.558+0000 7fc5ae7fc640 1 -- 172.21.15.159:0/2631523190 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fc5a8098850 con 0x7fc5b0150cc0 2024-07-24T16:25:06.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.558+0000 7fc5b5829640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fc59c077010 0x7fc59c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:06.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.559+0000 7fc5b5829640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fc59c077010 0x7fc59c0794d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0073aa0 tx=0x7fc5a0004ab0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:06.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.562+0000 7fc5ae7fc640 1 -- 172.21.15.159:0/2631523190 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fc5b01f34c0 con 0x7fc5b0150cc0 2024-07-24T16:25:06.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.782+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/2631523190 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc5b01f0680 con 0x7fc5b0150cc0 2024-07-24T16:25:06.785 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.783+0000 7fc5ae7fc640 1 -- 172.21.15.159:0/2631523190 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7fc5a80618d0 con 0x7fc5b0150cc0 2024-07-24T16:25:06.786 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:25:06.786 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":16,"btime":"2024-07-24T16:25:00:240907+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2383254131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2383254131},{"type":"v1","addr":"172.21.15.159:6835","nonce":2383254131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1682765472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1682765472},{"type":"v1","addr":"172.21.15.193:6836","nonce":1682765472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4840,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/306853489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":306853489},{"type":"v1","addr":"172.21.15.193:6837","nonce":306853489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:57.601499+0000","modified":"2024-07-24T16:24:59.597468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/279171348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":279171348},{"type":"v1","addr":"172.21.15.159:6834","nonce":279171348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":2}]} 2024-07-24T16:25:06.786 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 16 2024-07-24T16:25:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.785+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fc59c077010 msgr2=0x7fc59c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.785+0000 7fc5b7a8d640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fc59c077010 0x7fc59c0794d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc5b0073aa0 tx=0x7fc5a0004ab0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.785+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/2631523190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5b0150cc0 msgr2=0x7fc5b00acca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.785+0000 7fc5b7a8d640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5b0150cc0 0x7fc5b00acca0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc5a8009fd0 tx=0x7fc5a800b8e0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.785+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/2631523190 shutdown_connections 2024-07-24T16:25:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.785+0000 7fc5b7a8d640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fc59c077010 0x7fc59c0794d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.785+0000 7fc5b7a8d640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc5b0150cc0 0x7fc5b00acca0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.785+0000 7fc5b7a8d640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc5b00b41d0 0x7fc5b01f0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.785+0000 7fc5b7a8d640 1 --2- 172.21.15.159:0/2631523190 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc5b006d670 0x7fc5b01f2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:06.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.785+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/2631523190 >> 172.21.15.159:0/2631523190 conn(0x7fc5b006c560 msgr2=0x7fc5b014fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:06.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.785+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/2631523190 shutdown_connections 2024-07-24T16:25:06.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:06.785+0000 7fc5b7a8d640 1 -- 172.21.15.159:0/2631523190 wait complete. 2024-07-24T16:25:07.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-24T16:24:57.601499+0000', 'modified': '2024-07-24T16:24:59.597468+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4998}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4998': {'gid': 4998, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.159:6834/279171348', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6832', 'nonce': 279171348}, {'type': 'v1', 'addr': '172.21.15.159:6834', 'nonce': 279171348}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4998, 'qdb_cluster': [4998]} 2024-07-24T16:25:07.201 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-07-24T16:25:07.201 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-07-24T16:25:07.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.304+0000 7f7b84dcb640 1 -- 172.21.15.159:0/2696350066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c004d40 msgr2=0x7f7b6c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.304+0000 7f7b84dcb640 1 --2- 172.21.15.159:0/2696350066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c004d40 0x7f7b6c0051c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f7b8015e510 tx=0x7f7b6c005830 comp rx=0 tx=0).stop 2024-07-24T16:25:07.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.304+0000 7f7b7ed9d640 1 -- 172.21.15.159:0/2696350066 reap_dead start 2024-07-24T16:25:07.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.305+0000 7f7b84dcb640 1 -- 172.21.15.159:0/2696350066 shutdown_connections 2024-07-24T16:25:07.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.305+0000 7f7b84dcb640 1 -- 172.21.15.159:0/2696350066 >> 172.21.15.159:0/2696350066 conn(0x7f7b8006c560 msgr2=0x7f7b8006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:07.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.305+0000 7f7b84dcb640 1 -- 172.21.15.159:0/2696350066 shutdown_connections 2024-07-24T16:25:07.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.305+0000 7f7b84dcb640 1 -- 172.21.15.159:0/2696350066 wait complete. 2024-07-24T16:25:07.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.306+0000 7f7b84dcb640 1 Processor -- start 2024-07-24T16:25:07.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.306+0000 7f7b84dcb640 1 -- start start 2024-07-24T16:25:07.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b84dcb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c004d40 0x7f7b8014fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b84dcb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b801f4df0 0x7f7b800ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b84dcb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b800addd0 0x7f7b801f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b84dcb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7b800ae4d0 con 0x7f7b6c004d40 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b84dcb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7b800ae650 con 0x7f7b800addd0 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b84dcb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7b800ae7d0 con 0x7f7b801f4df0 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b7e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c004d40 0x7f7b8014fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b7e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c004d40 0x7f7b8014fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43452/0 (socket says 172.21.15.159:43452) 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b7e59c640 1 -- 172.21.15.159:0/1845372356 learned_addr learned my addr 172.21.15.159:0/1845372356 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b7dd9b640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b801f4df0 0x7f7b800ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b7ed9d640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b800addd0 0x7f7b801f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b7e59c640 1 -- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b801f4df0 msgr2=0x7f7b800ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b7e59c640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b801f4df0 0x7f7b800ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b7e59c640 1 -- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b800addd0 msgr2=0x7f7b801f76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b7e59c640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b800addd0 0x7f7b801f76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b7e59c640 1 -- 172.21.15.159:0/1845372356 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b801f83b0 con 0x7f7b6c004d40 2024-07-24T16:25:07.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b7e59c640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c004d40 0x7f7b8014fb90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7b70010bf0 tx=0x7f7b7000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:07.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b76ffd640 1 -- 172.21.15.159:0/1845372356 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70016070 con 0x7f7b6c004d40 2024-07-24T16:25:07.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b76ffd640 1 -- 172.21.15.159:0/1845372356 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b70003b70 con 0x7f7b6c004d40 2024-07-24T16:25:07.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b84dcb640 1 -- 172.21.15.159:0/1845372356 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b801f4310 con 0x7f7b6c004d40 2024-07-24T16:25:07.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.307+0000 7f7b76ffd640 1 -- 172.21.15.159:0/1845372356 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70004050 con 0x7f7b6c004d40 2024-07-24T16:25:07.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.308+0000 7f7b84dcb640 1 -- 172.21.15.159:0/1845372356 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b801f48d0 con 0x7f7b6c004d40 2024-07-24T16:25:07.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.309+0000 7f7b76ffd640 1 -- 172.21.15.159:0/1845372356 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f7b700041f0 con 0x7f7b6c004d40 2024-07-24T16:25:07.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.310+0000 7f7b76ffd640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7b60077010 0x7f7b600794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.310+0000 7f7b76ffd640 1 -- 172.21.15.159:0/1845372356 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f7b70099c90 con 0x7f7b6c004d40 2024-07-24T16:25:07.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.310+0000 7f7b7dd9b640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7b60077010 0x7f7b600794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.310+0000 7f7b87c00740 1 Processor -- start 2024-07-24T16:25:07.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.311+0000 7f7b7dd9b640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7b60077010 0x7f7b600794d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7b801f87f0 tx=0x7f7b6800b260 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:07.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.311+0000 7f7b87c00740 1 -- start start 2024-07-24T16:25:07.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.311+0000 7f7b87c00740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e24ffcb0 0x5575e2500090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.311+0000 7f7b87c00740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24bae20 0x5575e24fe790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.311+0000 7f7b87c00740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24fecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.311+0000 7f7b87c00740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5575e242c270 con 0x5575e24bb3a0 2024-07-24T16:25:07.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.311+0000 7f7b87c00740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5575e241b770 con 0x5575e24bae20 2024-07-24T16:25:07.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.311+0000 7f7b87c00740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5575e241f7b0 con 0x5575e24ffcb0 2024-07-24T16:25:07.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.311+0000 7f7b7ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24fecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.312+0000 7f7b7ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24fecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43462/0 (socket says 172.21.15.159:43462) 2024-07-24T16:25:07.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.312+0000 7f7b7ed9d640 1 -- 172.21.15.159:0/1382677668 learned_addr learned my addr 172.21.15.159:0/1382677668 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.312+0000 7f7b7dd9b640 1 --2- 172.21.15.159:0/1382677668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24bae20 0x5575e24fe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.312+0000 7f7b7e59c640 1 --2- 172.21.15.159:0/1382677668 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e24ffcb0 0x5575e2500090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.312+0000 7f7b7ed9d640 1 -- 172.21.15.159:0/1382677668 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e24ffcb0 msgr2=0x5575e2500090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:25:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.312+0000 7f7b7ed9d640 1 --2- 172.21.15.159:0/1382677668 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e24ffcb0 0x5575e2500090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.312+0000 7f7b7ed9d640 1 -- 172.21.15.159:0/1382677668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24bae20 msgr2=0x5575e24fe790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:25:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.312+0000 7f7b7ed9d640 1 --2- 172.21.15.159:0/1382677668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24bae20 0x5575e24fe790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.312+0000 7f7b7ed9d640 1 -- 172.21.15.159:0/1382677668 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e23c8e20 con 0x5575e24bb3a0 2024-07-24T16:25:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.312+0000 7f7b7ed9d640 1 --2- 172.21.15.159:0/1382677668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24fecd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7b7802b0f0 tx=0x7f7b8006e250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614071b116d01c2a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.312+0000 7f7b5ffff640 1 -- 172.21.15.159:0/1382677668 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78031040 con 0x5575e24bb3a0 2024-07-24T16:25:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.312+0000 7f7b5ffff640 1 -- 172.21.15.159:0/1382677668 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b780016d0 con 0x5575e24bb3a0 2024-07-24T16:25:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.312+0000 7f7b5ffff640 1 -- 172.21.15.159:0/1382677668 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78006270 con 0x5575e24bb3a0 2024-07-24T16:25:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.313+0000 7f7b87c00740 1 -- 172.21.15.159:0/1382677668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 msgr2=0x5575e24fecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.313+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1382677668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24fecd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f7b7802b0f0 tx=0x7f7b8006e250 comp rx=0 tx=0).stop 2024-07-24T16:25:07.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.313+0000 7f7b87c00740 1 -- 172.21.15.159:0/1382677668 shutdown_connections 2024-07-24T16:25:07.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.313+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1382677668 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24fecd0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.313+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1382677668 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24bae20 0x5575e24fe790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.313+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1382677668 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e24ffcb0 0x5575e2500090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.313+0000 7f7b87c00740 1 -- 172.21.15.159:0/1382677668 >> 172.21.15.159:0/1382677668 conn(0x5575e24b63f0 msgr2=0x5575e24b9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:07.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.313+0000 7f7b87c00740 1 -- 172.21.15.159:0/1382677668 shutdown_connections 2024-07-24T16:25:07.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.313+0000 7f7b87c00740 1 -- 172.21.15.159:0/1382677668 wait complete. 2024-07-24T16:25:07.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.313+0000 7f7b87c00740 1 -- start start 2024-07-24T16:25:07.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.313+0000 7f7b87c00740 1 Processor -- start 2024-07-24T16:25:07.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.314+0000 7f7b87c00740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24fef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.314+0000 7f7b87c00740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 0x5575e250e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.314+0000 7f7b87c00740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 0x5575e24f7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.314+0000 7f7b87c00740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5575e218e620 con 0x5575e24bb3a0 2024-07-24T16:25:07.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.314+0000 7f7b87c00740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5575e23a3840 con 0x5575e24ffcb0 2024-07-24T16:25:07.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.314+0000 7f7b87c00740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5575e24b4e10 con 0x5575e250eae0 2024-07-24T16:25:07.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.314+0000 7f7b87c00740 10 client.0 _ll_register_callbacks cb 0x5575e24147a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T16:25:07.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.314+0000 7f7b7e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24fef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b7e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24fef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43470/0 (socket says 172.21.15.159:43470) 2024-07-24T16:25:07.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b7e59c640 1 -- 172.21.15.159:0/140470908 learned_addr learned my addr 172.21.15.159:0/140470908 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:07.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b7dd9b640 1 --2- 172.21.15.159:0/140470908 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 0x5575e250e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b7ed9d640 1 --2- 172.21.15.159:0/140470908 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 0x5575e24f7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b7e59c640 1 -- 172.21.15.159:0/140470908 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 msgr2=0x5575e24f7230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:25:07.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b7e59c640 1 --2- 172.21.15.159:0/140470908 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 0x5575e24f7230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b7e59c640 1 -- 172.21.15.159:0/140470908 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 msgr2=0x5575e250e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:25:07.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b7e59c640 1 --2- 172.21.15.159:0/140470908 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 0x5575e250e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b7e59c640 1 -- 172.21.15.159:0/140470908 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e217f850 con 0x5575e24bb3a0 2024-07-24T16:25:07.323 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b7e59c640 1 --2- 172.21.15.159:0/140470908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24fef70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7b70011010 tx=0x7f7b70062be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90152d157c33680d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:07.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-07-24T16:25:07.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b5d7fa640 1 -- 172.21.15.159:0/140470908 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7007b020 con 0x5575e24bb3a0 2024-07-24T16:25:07.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b87c00740 1 -- 172.21.15.159:0/140470908 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b780016d0 con 0x5575e24bb3a0 2024-07-24T16:25:07.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b5d7fa640 1 -- 172.21.15.159:0/140470908 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f7b70061a70 con 0x5575e24bb3a0 2024-07-24T16:25:07.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b5d7fa640 1 -- 172.21.15.159:0/140470908 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f7b70020040 con 0x5575e24bb3a0 2024-07-24T16:25:07.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b87c00740 10 client.5175 fetch_fsmap learned FSMap version 16 2024-07-24T16:25:07.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b87c00740 1 -- 172.21.15.159:0/140470908 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5575e21f66b0 con 0x5575e24bb3a0 2024-07-24T16:25:07.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b5d7fa640 1 -- 172.21.15.159:0/140470908 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b780016d0 con 0x5575e24bb3a0 2024-07-24T16:25:07.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.315+0000 7f7b5d7fa640 1 -- 172.21.15.159:0/140470908 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f7b7000f040 con 0x5575e24bb3a0 2024-07-24T16:25:07.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.316+0000 7f7b87c00740 10 client.5175 fetch_fsmap finished waiting for FSMap version 16 2024-07-24T16:25:07.324 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.316+0000 7f7b87c00740 10 client.5175 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-24T16:25:07.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.316+0000 7f7b87c00740 20 client.5175 populate_metadata read hostname 'smithi159' 2024-07-24T16:25:07.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.316+0000 7f7b87c00740 1 --2- 172.21.15.159:0/140470908 >> [v2:172.21.15.159:6832/279171348,v1:172.21.15.159:6834/279171348] conn(0x5575e24fce00 0x5575e24cf0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.316+0000 7f7b87c00740 4 client.5175 mds_command: new command op to 4998 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T16:25:07.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.316+0000 7f7b87c00740 1 -- 172.21.15.159:0/140470908 --> [v2:172.21.15.159:6832/279171348,v1:172.21.15.159:6834/279171348] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575e242e1c0 con 0x5575e24fce00 2024-07-24T16:25:07.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.316+0000 7f7b7dd9b640 1 --2- 172.21.15.159:0/140470908 >> [v2:172.21.15.159:6832/279171348,v1:172.21.15.159:6834/279171348] conn(0x5575e24fce00 0x5575e24cf0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.316+0000 7f7b7dd9b640 1 --2- 172.21.15.159:0/140470908 >> [v2:172.21.15.159:6832/279171348,v1:172.21.15.159:6834/279171348] conn(0x5575e24fce00 0x5575e24cf0c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79294b26a76672cd server_cookie=a0b075d6bf518585 in_seq=0 out_seq=0 2024-07-24T16:25:07.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.316+0000 7f7b5d7fa640 10 client.5175 ms_handle_connect on v2:172.21.15.159:6832/279171348 2024-07-24T16:25:07.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b5d7fa640 1 -- 172.21.15.159:0/140470908 <== mds.0 v2:172.21.15.159:6832/279171348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5575e242e1c0 con 0x5575e24fce00 2024-07-24T16:25:07.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b5d7fa640 10 client.5175 handle_command_reply: tid=0 2024-07-24T16:25:07.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b87c00740 1 client.5175 shutdown 2024-07-24T16:25:07.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b87c00740 1 -- 172.21.15.159:0/140470908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 msgr2=0x5575e24fef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b87c00740 1 --2- 172.21.15.159:0/140470908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24fef70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f7b70011010 tx=0x7f7b70062be0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b87c00740 1 -- 172.21.15.159:0/140470908 shutdown_connections 2024-07-24T16:25:07.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b87c00740 1 --2- 172.21.15.159:0/140470908 >> [v2:172.21.15.159:6832/279171348,v1:172.21.15.159:6834/279171348] conn(0x5575e24fce00 0x5575e24cf0c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b87c00740 1 --2- 172.21.15.159:0/140470908 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 0x5575e24f7230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b87c00740 1 --2- 172.21.15.159:0/140470908 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 0x5575e250e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b5d7fa640 0 client.5175 ms_handle_reset on v2:172.21.15.159:6832/279171348 2024-07-24T16:25:07.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b87c00740 1 --2- 172.21.15.159:0/140470908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24fef70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b87c00740 1 -- 172.21.15.159:0/140470908 >> 172.21.15.159:0/140470908 conn(0x5575e24bae20 msgr2=0x5575e24e36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:07.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b87c00740 1 -- 172.21.15.159:0/140470908 shutdown_connections 2024-07-24T16:25:07.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b87c00740 1 -- 172.21.15.159:0/140470908 wait complete. 2024-07-24T16:25:07.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.317+0000 7f7b87c00740 20 client.5175 trim_cache size 0 max 16384 2024-07-24T16:25:07.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.335+0000 7f7b87c00740 1 Processor -- start 2024-07-24T16:25:07.338 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.336+0000 7f7b87c00740 1 -- start start 2024-07-24T16:25:07.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.336+0000 7f7b87c00740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24b9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.336+0000 7f7b87c00740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 0x5575e24b5240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.336+0000 7f7b87c00740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 0x5575e24f8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.336+0000 7f7b87c00740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7b802007e0 con 0x5575e24bb3a0 2024-07-24T16:25:07.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.336+0000 7f7b87c00740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7b801ffb70 con 0x5575e24ffcb0 2024-07-24T16:25:07.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.336+0000 7f7b87c00740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7b80200190 con 0x5575e250eae0 2024-07-24T16:25:07.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.336+0000 7f7b7e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24b9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.336+0000 7f7b7e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24b9a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43474/0 (socket says 172.21.15.159:43474) 2024-07-24T16:25:07.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.336+0000 7f7b7e59c640 1 -- 172.21.15.159:0/1976419959 learned_addr learned my addr 172.21.15.159:0/1976419959 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b7e59c640 1 -- 172.21.15.159:0/1976419959 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 msgr2=0x5575e24f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:25:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b7dd9b640 1 --2- 172.21.15.159:0/1976419959 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 0x5575e24b5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b7ed9d640 1 --2- 172.21.15.159:0/1976419959 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 0x5575e24f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b7e59c640 1 --2- 172.21.15.159:0/1976419959 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 0x5575e24f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b7e59c640 1 -- 172.21.15.159:0/1976419959 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 msgr2=0x5575e24b5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:25:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b7e59c640 1 --2- 172.21.15.159:0/1976419959 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 0x5575e24b5240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b7e59c640 1 -- 172.21.15.159:0/1976419959 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575e24b9f80 con 0x5575e24bb3a0 2024-07-24T16:25:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b7dd9b640 1 --2- 172.21.15.159:0/1976419959 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 0x5575e24b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:25:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b7ed9d640 1 --2- 172.21.15.159:0/1976419959 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 0x5575e24f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:25:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b7e59c640 1 --2- 172.21.15.159:0/1976419959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24b9a40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7b700098b0 tx=0x7f7b70062a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8314dea491f8db0d server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b5f7fe640 1 -- 172.21.15.159:0/1976419959 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7007b030 con 0x5575e24bb3a0 2024-07-24T16:25:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b5f7fe640 1 -- 172.21.15.159:0/1976419959 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b7006b630 con 0x5575e24bb3a0 2024-07-24T16:25:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b5f7fe640 1 -- 172.21.15.159:0/1976419959 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70066c10 con 0x5575e24bb3a0 2024-07-24T16:25:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b87c00740 1 -- 172.21.15.159:0/1976419959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 msgr2=0x5575e24b9a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1976419959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24b9a40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7b700098b0 tx=0x7f7b70062a80 comp rx=0 tx=0).stop 2024-07-24T16:25:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b87c00740 1 -- 172.21.15.159:0/1976419959 shutdown_connections 2024-07-24T16:25:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1976419959 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 0x5575e24f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1976419959 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 0x5575e24b5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1976419959 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e24b9a40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b87c00740 1 -- 172.21.15.159:0/1976419959 >> 172.21.15.159:0/1976419959 conn(0x5575e24bae20 msgr2=0x5575e24e0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.337+0000 7f7b87c00740 1 -- 172.21.15.159:0/1976419959 shutdown_connections 2024-07-24T16:25:07.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.338+0000 7f7b87c00740 1 -- 172.21.15.159:0/1976419959 wait complete. 2024-07-24T16:25:07.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.338+0000 7f7b87c00740 1 -- start start 2024-07-24T16:25:07.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.338+0000 7f7b87c00740 1 Processor -- start 2024-07-24T16:25:07.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b87c00740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e257d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b87c00740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 0x5575e24e36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b87c00740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 0x5575e24e3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b87c00740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x5575e24fcc80 con 0x5575e24bb3a0 2024-07-24T16:25:07.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b87c00740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x5575e24d2860 con 0x5575e24ffcb0 2024-07-24T16:25:07.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b87c00740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x5575e24fd240 con 0x5575e250eae0 2024-07-24T16:25:07.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b87c00740 10 client.0 _ll_register_callbacks cb 0x7f7b7005e5a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T16:25:07.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b7e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e257d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b7e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e257d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43482/0 (socket says 172.21.15.159:43482) 2024-07-24T16:25:07.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b7e59c640 1 -- 172.21.15.159:0/1339282709 learned_addr learned my addr 172.21.15.159:0/1339282709 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:07.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b7dd9b640 1 --2- 172.21.15.159:0/1339282709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 0x5575e24e36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b7ed9d640 1 --2- 172.21.15.159:0/1339282709 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 0x5575e24e3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b7e59c640 1 -- 172.21.15.159:0/1339282709 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 msgr2=0x5575e24e3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:25:07.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b7e59c640 1 --2- 172.21.15.159:0/1339282709 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 0x5575e24e3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b7e59c640 1 -- 172.21.15.159:0/1339282709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 msgr2=0x5575e24e36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:25:07.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b7e59c640 1 --2- 172.21.15.159:0/1339282709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 0x5575e24e36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.339+0000 7f7b7e59c640 1 -- 172.21.15.159:0/1339282709 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575e250e8f0 con 0x5575e24bb3a0 2024-07-24T16:25:07.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b7e59c640 1 --2- 172.21.15.159:0/1339282709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e257d040 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7b700625a0 tx=0x7f7b700102e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e6f6ac8efe4efa server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:07.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b5d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-07-24T16:25:07.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b5d7fa640 1 -- 172.21.15.159:0/1339282709 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b70061d80 con 0x5575e24bb3a0 2024-07-24T16:25:07.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b5d7fa640 1 -- 172.21.15.159:0/1339282709 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f7b700046f0 con 0x5575e24bb3a0 2024-07-24T16:25:07.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b87c00740 1 -- 172.21.15.159:0/1339282709 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b7006b630 con 0x5575e24bb3a0 2024-07-24T16:25:07.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b5d7fa640 1 -- 172.21.15.159:0/1339282709 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f7b70062610 con 0x5575e24bb3a0 2024-07-24T16:25:07.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b87c00740 10 client.5181 fetch_fsmap learned FSMap version 16 2024-07-24T16:25:07.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b87c00740 1 -- 172.21.15.159:0/1339282709 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) -- 0x5575e24f8900 con 0x5575e24bb3a0 2024-07-24T16:25:07.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b5d7fa640 1 -- 172.21.15.159:0/1339282709 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b7006b630 con 0x5575e24bb3a0 2024-07-24T16:25:07.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b5d7fa640 1 -- 172.21.15.159:0/1339282709 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 16) ==== 3502+0+0 (secure 0 0 0) 0x7f7b7005df80 con 0x5575e24bb3a0 2024-07-24T16:25:07.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b87c00740 10 client.5181 fetch_fsmap finished waiting for FSMap version 16 2024-07-24T16:25:07.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b87c00740 10 client.5181 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-24T16:25:07.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b87c00740 20 client.5181 populate_metadata read hostname 'smithi159' 2024-07-24T16:25:07.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1339282709 >> [v2:172.21.15.159:6832/279171348,v1:172.21.15.159:6834/279171348] conn(0x5575e24cdda0 0x5575e24ce180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b87c00740 4 client.5181 mds_command: new command op to 4998 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-24T16:25:07.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b87c00740 1 -- 172.21.15.159:0/1339282709 --> [v2:172.21.15.159:6832/279171348,v1:172.21.15.159:6834/279171348] -- command(tid 0: {"prefix": "status"}) -- 0x5575e2429c60 con 0x5575e24cdda0 2024-07-24T16:25:07.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.340+0000 7f7b7dd9b640 1 --2- 172.21.15.159:0/1339282709 >> [v2:172.21.15.159:6832/279171348,v1:172.21.15.159:6834/279171348] conn(0x5575e24cdda0 0x5575e24ce180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b5d7fa640 10 client.5181 ms_handle_connect on v2:172.21.15.159:6832/279171348 2024-07-24T16:25:07.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b7dd9b640 1 --2- 172.21.15.159:0/1339282709 >> [v2:172.21.15.159:6832/279171348,v1:172.21.15.159:6834/279171348] conn(0x5575e24cdda0 0x5575e24ce180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69fd148024a721f6 server_cookie=2d5f21dfcbd61c97 in_seq=0 out_seq=0 2024-07-24T16:25:07.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b5d7fa640 1 -- 172.21.15.159:0/1339282709 <== mds.0 v2:172.21.15.159:6832/279171348 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5575e2429c60 con 0x5575e24cdda0 2024-07-24T16:25:07.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b5d7fa640 10 client.5181 handle_command_reply: tid=0 2024-07-24T16:25:07.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b87c00740 1 client.5181 shutdown 2024-07-24T16:25:07.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b87c00740 1 -- 172.21.15.159:0/1339282709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 msgr2=0x5575e257d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1339282709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e257d040 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7b700625a0 tx=0x7f7b700102e0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b87c00740 1 -- 172.21.15.159:0/1339282709 shutdown_connections 2024-07-24T16:25:07.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1339282709 >> [v2:172.21.15.159:6832/279171348,v1:172.21.15.159:6834/279171348] conn(0x5575e24cdda0 0x5575e24ce180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1339282709 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x5575e250eae0 0x5575e24e3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1339282709 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x5575e24ffcb0 0x5575e24e36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b87c00740 1 --2- 172.21.15.159:0/1339282709 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x5575e24bb3a0 0x5575e257d040 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b5d7fa640 0 client.5181 ms_handle_reset on v2:172.21.15.159:6832/279171348 2024-07-24T16:25:07.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b87c00740 1 -- 172.21.15.159:0/1339282709 >> 172.21.15.159:0/1339282709 conn(0x5575e24bae20 msgr2=0x5575e24d4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:07.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b87c00740 1 -- 172.21.15.159:0/1339282709 shutdown_connections 2024-07-24T16:25:07.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b87c00740 1 -- 172.21.15.159:0/1339282709 wait complete. 2024-07-24T16:25:07.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.341+0000 7f7b87c00740 20 client.5181 trim_cache size 0 max 16384 2024-07-24T16:25:07.353 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:25:07.353 INFO:teuthology.orchestra.run.smithi159.stdout: "cluster_fsid": "15e9c2b9-79b9-45cf-833e-5ce98c29c7f6", 2024-07-24T16:25:07.353 INFO:teuthology.orchestra.run.smithi159.stdout: "whoami": 0, 2024-07-24T16:25:07.353 INFO:teuthology.orchestra.run.smithi159.stdout: "id": 4998, 2024-07-24T16:25:07.353 INFO:teuthology.orchestra.run.smithi159.stdout: "want_state": "up:active", 2024-07-24T16:25:07.353 INFO:teuthology.orchestra.run.smithi159.stdout: "state": "up:active", 2024-07-24T16:25:07.353 INFO:teuthology.orchestra.run.smithi159.stdout: "fs_name": "cephfs", 2024-07-24T16:25:07.353 INFO:teuthology.orchestra.run.smithi159.stdout: "rank_uptime": 9.1119363900000003, 2024-07-24T16:25:07.353 INFO:teuthology.orchestra.run.smithi159.stdout: "mdsmap_epoch": 16, 2024-07-24T16:25:07.353 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch": 36, 2024-07-24T16:25:07.353 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch_barrier": 36, 2024-07-24T16:25:07.354 INFO:teuthology.orchestra.run.smithi159.stdout: "uptime": 16.28533865 2024-07-24T16:25:07.354 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:25:07.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.342+0000 7f7b84dcb640 1 -- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7b60077010 msgr2=0x7f7b600794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.342+0000 7f7b84dcb640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7b60077010 0x7f7b600794d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7b801f87f0 tx=0x7f7b6800b260 comp rx=0 tx=0).stop 2024-07-24T16:25:07.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.342+0000 7f7b84dcb640 1 -- 172.21.15.159:0/1845372356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c004d40 msgr2=0x7f7b8014fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.342+0000 7f7b84dcb640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c004d40 0x7f7b8014fb90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f7b70010bf0 tx=0x7f7b7000e6c0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.342+0000 7f7b84dcb640 1 -- 172.21.15.159:0/1845372356 shutdown_connections 2024-07-24T16:25:07.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.342+0000 7f7b84dcb640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f7b60077010 0x7f7b600794d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.355 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.342+0000 7f7b84dcb640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7b800addd0 0x7f7b801f76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.342+0000 7f7b84dcb640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7b801f4df0 0x7f7b800ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.342+0000 7f7b84dcb640 1 --2- 172.21.15.159:0/1845372356 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7b6c004d40 0x7f7b8014fb90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.342+0000 7f7b84dcb640 1 -- 172.21.15.159:0/1845372356 >> 172.21.15.159:0/1845372356 conn(0x7f7b8006c560 msgr2=0x7f7b800b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:07.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.342+0000 7f7b84dcb640 1 -- 172.21.15.159:0/1845372356 shutdown_connections 2024-07-24T16:25:07.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.342+0000 7f7b84dcb640 1 -- 172.21.15.159:0/1845372356 wait complete. 2024-07-24T16:25:07.356 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-24T16:25:07.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.458+0000 7f0c486b7640 1 -- 172.21.15.159:0/3514613408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c40072b50 msgr2=0x7f0c40072f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.458+0000 7f0c486b7640 1 --2- 172.21.15.159:0/3514613408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c40072b50 0x7f0c40072f90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f0c40074310 tx=0x7f0c3802a560 comp rx=0 tx=0).stop 2024-07-24T16:25:07.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.458+0000 7f0c486b7640 1 -- 172.21.15.159:0/3514613408 shutdown_connections 2024-07-24T16:25:07.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.458+0000 7f0c486b7640 1 --2- 172.21.15.159:0/3514613408 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c40072b50 0x7f0c40072f90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.458+0000 7f0c486b7640 1 --2- 172.21.15.159:0/3514613408 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c400b4e70 0x7f0c40070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.458+0000 7f0c486b7640 1 --2- 172.21.15.159:0/3514613408 >> v2:172.21.15.193:3300/0 conn(0x7f0c4015a330 0x7f0c400cfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.458+0000 7f0c486b7640 1 -- 172.21.15.159:0/3514613408 >> 172.21.15.159:0/3514613408 conn(0x7f0c400b2230 msgr2=0x7f0c400b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:07.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.458+0000 7f0c486b7640 1 -- 172.21.15.159:0/3514613408 shutdown_connections 2024-07-24T16:25:07.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.458+0000 7f0c486b7640 1 -- 172.21.15.159:0/3514613408 wait complete. 2024-07-24T16:25:07.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.459+0000 7f0c486b7640 1 Processor -- start 2024-07-24T16:25:07.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.459+0000 7f0c486b7640 1 -- start start 2024-07-24T16:25:07.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c486b7640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c40072b50 0x7f0c401f7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c486b7640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c400b4e70 0x7f0c40151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c486b7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c4015a330 0x7f0c40152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c486b7640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0c400cd5b0 con 0x7f0c4015a330 2024-07-24T16:25:07.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c486b7640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0c400cd430 con 0x7f0c400b4e70 2024-07-24T16:25:07.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c486b7640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0c400cd730 con 0x7f0c40072b50 2024-07-24T16:25:07.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c46c54640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c4015a330 0x7f0c40152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c46c54640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c4015a330 0x7f0c40152820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43504/0 (socket says 172.21.15.159:43504) 2024-07-24T16:25:07.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c46c54640 1 -- 172.21.15.159:0/2643907208 learned_addr learned my addr 172.21.15.159:0/2643907208 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:07.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c45c52640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c400b4e70 0x7f0c40151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c46453640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c40072b50 0x7f0c401f7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c46c54640 1 -- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c40072b50 msgr2=0x7f0c401f7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c46c54640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c40072b50 0x7f0c401f7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c46c54640 1 -- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c400b4e70 msgr2=0x7f0c40151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c46c54640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c400b4e70 0x7f0c40151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c46c54640 1 -- 172.21.15.159:0/2643907208 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c401f82b0 con 0x7f0c4015a330 2024-07-24T16:25:07.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c46453640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c40072b50 0x7f0c401f7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:25:07.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c46c54640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c4015a330 0x7f0c40152820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009230 tx=0x7f0c38003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:07.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c3effd640 1 -- 172.21.15.159:0/2643907208 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c3803f070 con 0x7f0c4015a330 2024-07-24T16:25:07.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c3effd640 1 -- 172.21.15.159:0/2643907208 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c380047a0 con 0x7f0c4015a330 2024-07-24T16:25:07.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c486b7640 1 -- 172.21.15.159:0/2643907208 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c40153930 con 0x7f0c4015a330 2024-07-24T16:25:07.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.460+0000 7f0c3effd640 1 -- 172.21.15.159:0/2643907208 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c38035030 con 0x7f0c4015a330 2024-07-24T16:25:07.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.461+0000 7f0c486b7640 1 -- 172.21.15.159:0/2643907208 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c401f4510 con 0x7f0c4015a330 2024-07-24T16:25:07.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.462+0000 7f0c486b7640 1 -- 172.21.15.159:0/2643907208 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c40070070 con 0x7f0c4015a330 2024-07-24T16:25:07.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.462+0000 7f0c3effd640 1 -- 172.21.15.159:0/2643907208 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f0c38042070 con 0x7f0c4015a330 2024-07-24T16:25:07.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.463+0000 7f0c3effd640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0c2c077010 0x7f0c2c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:07.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.463+0000 7f0c3effd640 1 -- 172.21.15.159:0/2643907208 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f0c380b9770 con 0x7f0c4015a330 2024-07-24T16:25:07.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.463+0000 7f0c46453640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0c2c077010 0x7f0c2c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:07.467 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.463+0000 7f0c46453640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0c2c077010 0x7f0c2c0794d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0c30005c40 tx=0x7f0c30005bd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:07.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.467+0000 7f0c3effd640 1 -- 172.21.15.159:0/2643907208 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f0c401f82b0 con 0x7f0c4015a330 2024-07-24T16:25:07.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.687+0000 7f0c486b7640 1 -- 172.21.15.159:0/2643907208 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0c40158c60 con 0x7f0c4015a330 2024-07-24T16:25:07.690 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.688+0000 7f0c3effd640 1 -- 172.21.15.159:0/2643907208 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) ==== 53+0+73 (secure 0 0 0) 0x7f0c38082870 con 0x7f0c4015a330 2024-07-24T16:25:07.690 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-07-24T16:25:07.692 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.690+0000 7f0c486b7640 1 -- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0c2c077010 msgr2=0x7f0c2c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.690+0000 7f0c486b7640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0c2c077010 0x7f0c2c0794d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0c30005c40 tx=0x7f0c30005bd0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.690+0000 7f0c486b7640 1 -- 172.21.15.159:0/2643907208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c4015a330 msgr2=0x7f0c40152820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:07.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.690+0000 7f0c486b7640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c4015a330 0x7f0c40152820 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009230 tx=0x7f0c38003960 comp rx=0 tx=0).stop 2024-07-24T16:25:07.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.690+0000 7f0c486b7640 1 -- 172.21.15.159:0/2643907208 shutdown_connections 2024-07-24T16:25:07.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.690+0000 7f0c486b7640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f0c2c077010 0x7f0c2c0794d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.690+0000 7f0c486b7640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0c4015a330 0x7f0c40152820 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.690+0000 7f0c486b7640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0c400b4e70 0x7f0c40151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.690+0000 7f0c486b7640 1 --2- 172.21.15.159:0/2643907208 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0c40072b50 0x7f0c401f7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:07.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.690+0000 7f0c486b7640 1 -- 172.21.15.159:0/2643907208 >> 172.21.15.159:0/2643907208 conn(0x7f0c400b2230 msgr2=0x7f0c40158000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:07.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.690+0000 7f0c486b7640 1 -- 172.21.15.159:0/2643907208 shutdown_connections 2024-07-24T16:25:07.693 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07.690+0000 7f0c486b7640 1 -- 172.21.15.159:0/2643907208 wait complete. 2024-07-24T16:25:07.703 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-07-24T16:25:07.704 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-24T16:25:07.704 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2024-07-24T16:25:07.704 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-07-24T16:25:07.704 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-24T16:25:07.704 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-07-24T16:25:07.704 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-07-24T16:25:07.704 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-24T16:25:07.704 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-24T16:25:07.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:07.704 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2024-07-24T16:25:07.720 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-24T16:25:07.720 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-24T16:25:07.720 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2024-07-24T16:25:07.721 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:25:07.721 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2024-07-24T16:25:07.721 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:25:07.721 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:25:07.721 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:25:07.721 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2024-07-24T16:25:07.721 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:25:07.721 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:25:07.721 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2024-07-24T16:25:07.721 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:25:07.721 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2024-07-24T16:25:07.721 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-24T16:25:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2024-07-24T16:25:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-24T16:25:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 42713sec preferred_lft 42713sec 2024-07-24T16:25:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2024-07-24T16:25:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:25:07.722 INFO:teuthology.orchestra.run.smithi159.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-24T16:25:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 96:98:2f:87:9c:54 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:25:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-07-24T16:25:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:25:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::d8bc:3bff:fe37:4033/64 scope link 2024-07-24T16:25:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:25:07.722 INFO:teuthology.orchestra.run.smithi159.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-24T16:25:07.722 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether ba:13:bc:12:98:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-24T16:25:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::b813:bcff:fe12:9884/64 scope link 2024-07-24T16:25:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:25:07.723 INFO:teuthology.orchestra.run.smithi159.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-24T16:25:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 96:98:2f:87:9c:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-07-24T16:25:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::9498:2fff:fe87:9c54/64 scope link 2024-07-24T16:25:07.723 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:25:07.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:07.723 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-24T16:25:07.784 INFO:teuthology.orchestra.run.smithi159.stdout:1 2024-07-24T16:25:07.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:07.785 DEBUG:teuthology.orchestra.run.smithi159:> route 2024-07-24T16:25:07.841 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2024-07-24T16:25:07.841 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-24T16:25:07.841 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-24T16:25:07.841 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-24T16:25:07.841 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-24T16:25:07.842 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:25:07.842 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:25:07.842 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-24T16:25:07.842 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-24T16:25:07.842 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-24T16:25:07.842 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:25:07.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:25:07.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:25:07.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:07.968 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-07-24T16:25:07.985 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-07-24T16:25:07.985 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-07-24T16:25:07.985 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-24T16:25:07.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:07.986 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2024-07-24T16:25:08.050 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:25:08.050 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-07-24T16:25:08.105 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-07-24T16:25:08.106 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:25:08.106 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-07-24T16:25:08.161 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-07-24T16:25:08.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:08.162 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-07-24T16:25:08.246 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-07-24T16:25:08.246 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-07-24T16:25:08.246 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-07-24T16:25:08.255 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-07-24T16:25:08.255 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-07-24T16:25:08.255 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-07-24T16:25:08.255 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.159:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-07-24T16:25:08.255 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2024-07-24T16:25:08.260 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-07-24T16:25:08.260 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-07-24T16:25:08.260 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-07-24T16:25:08.260 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.159:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-07-24T16:25:08.260 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2024-07-24T16:25:08.260 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.159:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-07-24T16:25:08.260 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.159:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-07-24T16:25:08.261 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=15e9c2b9-79b9-45cf-833e-5ce98c29c7f6" will pass to kernel 2024-07-24T16:25:08.261 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-07-24T16:25:08.261 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2024-07-24T16:25:08.261 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-24T16:25:08.261 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2024-07-24T16:25:08.261 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-24T16:25:08.263 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-24T16:25:08.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:08.263 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-07-24T16:25:08.336 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:25:08.427 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:25:08.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:25:08.437 INFO:teuthology.orchestra.run.smithi159.stdout:client5190 2024-07-24T16:25:08.437 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:25:08.437 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:25:08.455 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-07-24T16:25:08.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.597+0000 7f265891a640 1 -- 172.21.15.159:0/3548927749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2640003a30 msgr2=0x7f2640003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:08.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.597+0000 7f265891a640 1 --2- 172.21.15.159:0/3548927749 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2640003a30 0x7f2640003e50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f2644009ed0 tx=0x7f2640005830 comp rx=0 tx=0).stop 2024-07-24T16:25:08.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.597+0000 7f2652d9d640 1 -- 172.21.15.159:0/3548927749 reap_dead start 2024-07-24T16:25:08.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.597+0000 7f265891a640 1 -- 172.21.15.159:0/3548927749 shutdown_connections 2024-07-24T16:25:08.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.597+0000 7f265891a640 1 -- 172.21.15.159:0/3548927749 >> 172.21.15.159:0/3548927749 conn(0x7f265406c560 msgr2=0x7f265406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:08.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.597+0000 7f265891a640 1 -- 172.21.15.159:0/3548927749 shutdown_connections 2024-07-24T16:25:08.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.597+0000 7f265891a640 1 -- 172.21.15.159:0/3548927749 wait complete. 2024-07-24T16:25:08.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.598+0000 7f265891a640 1 Processor -- start 2024-07-24T16:25:08.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.598+0000 7f265891a640 1 -- start start 2024-07-24T16:25:08.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f265891a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2640003a30 0x7f26541515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:08.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f265891a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26540b2620 0x7f2654149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:08.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f265891a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26540b3ce0 0x7f26540b4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:08.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f265891a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f265415f2d0 con 0x7f26540b2620 2024-07-24T16:25:08.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f265891a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f265415c6a0 con 0x7f2640003a30 2024-07-24T16:25:08.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f265891a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f265415c820 con 0x7f26540b3ce0 2024-07-24T16:25:08.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f2651d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26540b2620 0x7f2654149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:08.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f2651d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26540b2620 0x7f2654149f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43520/0 (socket says 172.21.15.159:43520) 2024-07-24T16:25:08.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f2651d9b640 1 -- 172.21.15.159:0/4119690682 learned_addr learned my addr 172.21.15.159:0/4119690682 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:08.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f265259c640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2640003a30 0x7f26541515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:08.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f2652d9d640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26540b3ce0 0x7f26540b4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:08.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f2651d9b640 1 -- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26540b3ce0 msgr2=0x7f26540b4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:08.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f2651d9b640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26540b3ce0 0x7f26540b4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:08.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f2651d9b640 1 -- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2640003a30 msgr2=0x7f26541515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:08.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f2651d9b640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2640003a30 0x7f26541515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:08.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f2651d9b640 1 -- 172.21.15.159:0/4119690682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26540b2c40 con 0x7f26540b2620 2024-07-24T16:25:08.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.599+0000 7f2651d9b640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26540b2620 0x7f2654149f60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f263c004df0 tx=0x7f263c001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:08.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.600+0000 7f264affd640 1 -- 172.21.15.159:0/4119690682 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c015020 con 0x7f26540b2620 2024-07-24T16:25:08.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.600+0000 7f264affd640 1 -- 172.21.15.159:0/4119690682 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f263c011960 con 0x7f26540b2620 2024-07-24T16:25:08.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.600+0000 7f265891a640 1 -- 172.21.15.159:0/4119690682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26540b2f20 con 0x7f26540b2620 2024-07-24T16:25:08.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.600+0000 7f264affd640 1 -- 172.21.15.159:0/4119690682 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c001d40 con 0x7f26540b2620 2024-07-24T16:25:08.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.600+0000 7f265891a640 1 -- 172.21.15.159:0/4119690682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26540b34e0 con 0x7f26540b2620 2024-07-24T16:25:08.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.601+0000 7f265891a640 1 -- 172.21.15.159:0/4119690682 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f265406f970 con 0x7f26540b2620 2024-07-24T16:25:08.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.601+0000 7f264affd640 1 -- 172.21.15.159:0/4119690682 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f263c018020 con 0x7f26540b2620 2024-07-24T16:25:08.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.602+0000 7f264affd640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2634077010 0x7f26340794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:08.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.602+0000 7f264affd640 1 -- 172.21.15.159:0/4119690682 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f263c0993b0 con 0x7f26540b2620 2024-07-24T16:25:08.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.602+0000 7f265259c640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2634077010 0x7f26340794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:08.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.602+0000 7f265259c640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2634077010 0x7f26340794d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2644035000 tx=0x7f2644004a40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:08.608 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.606+0000 7f264affd640 1 -- 172.21.15.159:0/4119690682 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f263c01f020 con 0x7f26540b2620 2024-07-24T16:25:08.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.811+0000 7f265891a640 1 -- 172.21.15.159:0/4119690682 --> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f265406cc00 con 0x7f2634077010 2024-07-24T16:25:08.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.813+0000 7f264affd640 1 -- 172.21.15.159:0/4119690682 <== mgr.4103 v2:172.21.15.193:6832/222319347 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f265406cc00 con 0x7f2634077010 2024-07-24T16:25:08.816 INFO:teuthology.orchestra.run.smithi159.stdout:[ 2024-07-24T16:25:08.816 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:25:08.816 INFO:teuthology.orchestra.run.smithi159.stdout: "name": "cephfs" 2024-07-24T16:25:08.816 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:25:08.816 INFO:teuthology.orchestra.run.smithi159.stdout:] 2024-07-24T16:25:08.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.815+0000 7f265891a640 1 -- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2634077010 msgr2=0x7f26340794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:08.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.815+0000 7f265891a640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2634077010 0x7f26340794d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2644035000 tx=0x7f2644004a40 comp rx=0 tx=0).stop 2024-07-24T16:25:08.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.815+0000 7f265891a640 1 -- 172.21.15.159:0/4119690682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26540b2620 msgr2=0x7f2654149f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:08.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.815+0000 7f265891a640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26540b2620 0x7f2654149f60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f263c004df0 tx=0x7f263c001630 comp rx=0 tx=0).stop 2024-07-24T16:25:08.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.815+0000 7f265891a640 1 -- 172.21.15.159:0/4119690682 shutdown_connections 2024-07-24T16:25:08.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.815+0000 7f265891a640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f2634077010 0x7f26340794d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:08.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.815+0000 7f265891a640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26540b3ce0 0x7f26540b4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:08.818 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.815+0000 7f265891a640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26540b2620 0x7f2654149f60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:08.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.815+0000 7f265891a640 1 --2- 172.21.15.159:0/4119690682 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2640003a30 0x7f26541515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:08.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.815+0000 7f265891a640 1 -- 172.21.15.159:0/4119690682 >> 172.21.15.159:0/4119690682 conn(0x7f265406c560 msgr2=0x7f2654159f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:08.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.815+0000 7f265891a640 1 -- 172.21.15.159:0/4119690682 shutdown_connections 2024-07-24T16:25:08.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.816+0000 7f265891a640 1 -- 172.21.15.159:0/4119690682 wait complete. 2024-07-24T16:25:08.829 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module enable snap_schedule 2024-07-24T16:25:08.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.931+0000 7f5148ebe640 1 -- 172.21.15.159:0/659402092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f514415d950 msgr2=0x7f5144161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:08.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.931+0000 7f5148ebe640 1 --2- 172.21.15.159:0/659402092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f514415d950 0x7f5144161f20 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f51440c72c0 tx=0x7f513402a680 comp rx=0 tx=0).stop 2024-07-24T16:25:08.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.931+0000 7f5148ebe640 1 -- 172.21.15.159:0/659402092 shutdown_connections 2024-07-24T16:25:08.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.931+0000 7f5148ebe640 1 --2- 172.21.15.159:0/659402092 >> v2:172.21.15.193:3300/0 conn(0x7f51440cf770 0x7f51440cfbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:08.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.931+0000 7f5148ebe640 1 --2- 172.21.15.159:0/659402092 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f514415d950 0x7f5144161f20 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:08.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.931+0000 7f5148ebe640 1 -- 172.21.15.159:0/659402092 >> 172.21.15.159:0/659402092 conn(0x7f514409cd30 msgr2=0x7f51440d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:08.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.931+0000 7f5148ebe640 1 -- 172.21.15.159:0/659402092 shutdown_connections 2024-07-24T16:25:08.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.931+0000 7f5148ebe640 1 -- 172.21.15.159:0/659402092 wait complete. 2024-07-24T16:25:08.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.933+0000 7f5148ebe640 1 Processor -- start 2024-07-24T16:25:08.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.933+0000 7f5148ebe640 1 -- start start 2024-07-24T16:25:08.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.933+0000 7f5148ebe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51440b2ae0 0x7f51441f7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:08.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.933+0000 7f5148ebe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51440cf770 0x7f51440b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:08.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.933+0000 7f5148ebe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f514415d950 0x7f51440b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:08.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.933+0000 7f5148ebe640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f51440ce470 con 0x7f51440cf770 2024-07-24T16:25:08.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.933+0000 7f5148ebe640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f51440ce2f0 con 0x7f51440b2ae0 2024-07-24T16:25:08.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.933+0000 7f5148ebe640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f51440d02e0 con 0x7f514415d950 2024-07-24T16:25:08.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.933+0000 7f513bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51440cf770 0x7f51440b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:08.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f513bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51440cf770 0x7f51440b4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43536/0 (socket says 172.21.15.159:43536) 2024-07-24T16:25:08.939 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f513bfff640 1 -- 172.21.15.159:0/1820334078 learned_addr learned my addr 172.21.15.159:0/1820334078 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:08.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f5142d9d640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f514415d950 0x7f51440b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:08.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f514259c640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51440b2ae0 0x7f51441f7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:08.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f513bfff640 1 -- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f514415d950 msgr2=0x7f51440b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:08.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f513bfff640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f514415d950 0x7f51440b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:08.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f513bfff640 1 -- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51440b2ae0 msgr2=0x7f51441f7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:08.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f513bfff640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51440b2ae0 0x7f51441f7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:08.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f513bfff640 1 -- 172.21.15.159:0/1820334078 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5144160920 con 0x7f51440cf770 2024-07-24T16:25:08.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f513bfff640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51440cf770 0x7f51440b4a90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c500 tx=0x7f512c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:08.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f513affd640 1 -- 172.21.15.159:0/1820334078 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c0052d0 con 0x7f51440cf770 2024-07-24T16:25:08.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f513affd640 1 -- 172.21.15.159:0/1820334078 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f512c005470 con 0x7f51440cf770 2024-07-24T16:25:08.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f5148ebe640 1 -- 172.21.15.159:0/1820334078 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5144160c00 con 0x7f51440cf770 2024-07-24T16:25:08.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f513affd640 1 -- 172.21.15.159:0/1820334078 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c012870 con 0x7f51440cf770 2024-07-24T16:25:08.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.934+0000 7f5148ebe640 1 -- 172.21.15.159:0/1820334078 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51440b4570 con 0x7f51440cf770 2024-07-24T16:25:08.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.935+0000 7f5148ebe640 1 -- 172.21.15.159:0/1820334078 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f514415e2f0 con 0x7f51440cf770 2024-07-24T16:25:08.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.936+0000 7f513affd640 1 -- 172.21.15.159:0/1820334078 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 5) ==== 99139+0+0 (secure 0 0 0) 0x7f512c0035f0 con 0x7f51440cf770 2024-07-24T16:25:08.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.936+0000 7f513affd640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5124077010 0x7f51240794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:08.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.936+0000 7f513affd640 1 -- 172.21.15.159:0/1820334078 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f512c0984f0 con 0x7f51440cf770 2024-07-24T16:25:08.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.937+0000 7f514259c640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5124077010 0x7f51240794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:08.941 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.937+0000 7f514259c640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5124077010 0x7f51240794d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5134033000 tx=0x7f5134004730 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:08.943 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:08.941+0000 7f513affd640 1 -- 172.21.15.159:0/1820334078 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f512c060fb0 con 0x7f51440cf770 2024-07-24T16:25:09.175 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.172+0000 7f5148ebe640 1 -- 172.21.15.159:0/1820334078 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f51440b4740 con 0x7f51440cf770 2024-07-24T16:25:09.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.442+0000 7f513affd640 1 -- 172.21.15.159:0/1820334078 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v6) ==== 92+0+0 (secure 0 0 0) 0x7f512c065500 con 0x7f51440cf770 2024-07-24T16:25:09.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.444+0000 7f5148ebe640 1 -- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5124077010 msgr2=0x7f51240794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.444+0000 7f5148ebe640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5124077010 0x7f51240794d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5134033000 tx=0x7f5134004730 comp rx=0 tx=0).stop 2024-07-24T16:25:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.444+0000 7f5148ebe640 1 -- 172.21.15.159:0/1820334078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51440cf770 msgr2=0x7f51440b4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.445+0000 7f5148ebe640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51440cf770 0x7f51440b4a90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f512c00c500 tx=0x7f512c00c9c0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.445+0000 7f5148ebe640 1 -- 172.21.15.159:0/1820334078 shutdown_connections 2024-07-24T16:25:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.445+0000 7f5148ebe640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f5124077010 0x7f51240794d0 secure :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f5134033000 tx=0x7f5134004730 comp rx=0 tx=0).stop 2024-07-24T16:25:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.445+0000 7f5148ebe640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f514415d950 0x7f51440b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.445+0000 7f5148ebe640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51440cf770 0x7f51440b4a90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.445+0000 7f5148ebe640 1 --2- 172.21.15.159:0/1820334078 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51440b2ae0 0x7f51441f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.445+0000 7f5148ebe640 1 -- 172.21.15.159:0/1820334078 >> 172.21.15.159:0/1820334078 conn(0x7f514409cd30 msgr2=0x7f514406cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.445+0000 7f5148ebe640 1 -- 172.21.15.159:0/1820334078 shutdown_connections 2024-07-24T16:25:09.448 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.445+0000 7f5148ebe640 1 -- 172.21.15.159:0/1820334078 wait complete. 2024-07-24T16:25:09.461 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/allow_m_granularity True 2024-07-24T16:25:09.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.568+0000 7f95a4acb640 1 -- 172.21.15.159:0/593148678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a00d0fc0 msgr2=0x7f95a0071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:09.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.568+0000 7f95a4acb640 1 --2- 172.21.15.159:0/593148678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a00d0fc0 0x7f95a0071ca0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f9588005fd0 tx=0x7f958802a540 comp rx=0 tx=0).stop 2024-07-24T16:25:09.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.568+0000 7f95a4acb640 1 -- 172.21.15.159:0/593148678 shutdown_connections 2024-07-24T16:25:09.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.568+0000 7f95a4acb640 1 --2- 172.21.15.159:0/593148678 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a00d0fc0 0x7f95a0071ca0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.568+0000 7f95a4acb640 1 --2- 172.21.15.159:0/593148678 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95a00b66e0 0x7f95a015bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.569+0000 7f95a4acb640 1 -- 172.21.15.159:0/593148678 >> 172.21.15.159:0/593148678 conn(0x7f95a00b33c0 msgr2=0x7f95a00b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:09.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.569+0000 7f95a4acb640 1 -- 172.21.15.159:0/593148678 shutdown_connections 2024-07-24T16:25:09.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.569+0000 7f95a4acb640 1 -- 172.21.15.159:0/593148678 wait complete. 2024-07-24T16:25:09.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.570+0000 7f95a4acb640 1 Processor -- start 2024-07-24T16:25:09.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.570+0000 7f95a4acb640 1 -- start start 2024-07-24T16:25:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f95a4acb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95a00721e0 0x7f95a006ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f95a4acb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95a00b66e0 0x7f95a0158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f95a4acb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a00d0fc0 0x7f95a01f75d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f95a4acb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f95a0074430 con 0x7f95a00d0fc0 2024-07-24T16:25:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f95a4acb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f95a00742b0 con 0x7f95a00b66e0 2024-07-24T16:25:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f95a4acb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f95a00cf4c0 con 0x7f95a00721e0 2024-07-24T16:25:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f959ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a00d0fc0 0x7f95a01f75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f959ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a00d0fc0 0x7f95a01f75d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43548/0 (socket says 172.21.15.159:43548) 2024-07-24T16:25:09.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f959ed9d640 1 -- 172.21.15.159:0/797303793 learned_addr learned my addr 172.21.15.159:0/797303793 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f9595d9b640 1 --2- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95a00b66e0 0x7f95a0158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f959e59c640 1 --2- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95a00721e0 0x7f95a006ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f959ed9d640 1 -- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95a00721e0 msgr2=0x7f95a006ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f959ed9d640 1 --2- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95a00721e0 0x7f95a006ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f959ed9d640 1 -- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95a00b66e0 msgr2=0x7f95a0158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f959ed9d640 1 --2- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95a00b66e0 0x7f95a0158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f959ed9d640 1 -- 172.21.15.159:0/797303793 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95a006db30 con 0x7f95a00d0fc0 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.571+0000 7f959ed9d640 1 --2- 172.21.15.159:0/797303793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a00d0fc0 0x7f95a01f75d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f959800c7a0 tx=0x7f959800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.572+0000 7f95977fe640 1 -- 172.21.15.159:0/797303793 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9598003b70 con 0x7f95a00d0fc0 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.572+0000 7f95977fe640 1 -- 172.21.15.159:0/797303793 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9598003d30 con 0x7f95a00d0fc0 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.572+0000 7f95a4acb640 1 -- 172.21.15.159:0/797303793 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95a006de10 con 0x7f95a00d0fc0 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.572+0000 7f95977fe640 1 -- 172.21.15.159:0/797303793 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959800aa50 con 0x7f95a00d0fc0 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.572+0000 7f95a4acb640 1 -- 172.21.15.159:0/797303793 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95a006e3d0 con 0x7f95a00d0fc0 2024-07-24T16:25:09.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.573+0000 7f95a4acb640 1 -- 172.21.15.159:0/797303793 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a00cedc0 con 0x7f95a00d0fc0 2024-07-24T16:25:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.573+0000 7f95977fe640 1 -- 172.21.15.159:0/797303793 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 6) ==== 99156+0+0 (secure 0 0 0) 0x7f959800abf0 con 0x7f95a00d0fc0 2024-07-24T16:25:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.574+0000 7f95977fe640 1 --2- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9580077090 0x7f9580079550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.574+0000 7f959e59c640 1 -- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9580077090 msgr2=0x7f9580079550 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/222319347 2024-07-24T16:25:09.577 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.574+0000 7f95977fe640 1 -- 172.21.15.159:0/797303793 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7f95980986d0 con 0x7f95a00d0fc0 2024-07-24T16:25:09.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.574+0000 7f959e59c640 1 --2- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9580077090 0x7f9580079550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-07-24T16:25:09.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.578+0000 7f95977fe640 1 -- 172.21.15.159:0/797303793 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f95a00cedc0 con 0x7f95a00d0fc0 2024-07-24T16:25:09.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.769+0000 7f95a4acb640 1 -- 172.21.15.159:0/797303793 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f95a015bae0 con 0x7f95a00d0fc0 2024-07-24T16:25:09.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.773+0000 7f95977fe640 1 -- 172.21.15.159:0/797303793 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7f9598061210 con 0x7f95a00d0fc0 2024-07-24T16:25:09.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.775+0000 7f95a4acb640 1 -- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9580077090 msgr2=0x7f9580079550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:25:09.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.775+0000 7f95a4acb640 1 --2- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9580077090 0x7f9580079550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.775+0000 7f95a4acb640 1 -- 172.21.15.159:0/797303793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a00d0fc0 msgr2=0x7f95a01f75d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:09.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.775+0000 7f95a4acb640 1 --2- 172.21.15.159:0/797303793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a00d0fc0 0x7f95a01f75d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f959800c7a0 tx=0x7f959800cc60 comp rx=0 tx=0).stop 2024-07-24T16:25:09.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.775+0000 7f95a4acb640 1 -- 172.21.15.159:0/797303793 shutdown_connections 2024-07-24T16:25:09.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.775+0000 7f95a4acb640 1 --2- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7f9580077090 0x7f9580079550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.775+0000 7f95a4acb640 1 --2- 172.21.15.159:0/797303793 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95a00d0fc0 0x7f95a01f75d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.775+0000 7f95a4acb640 1 --2- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95a00b66e0 0x7f95a0158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.775+0000 7f95a4acb640 1 --2- 172.21.15.159:0/797303793 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95a00721e0 0x7f95a006ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.775+0000 7f95a4acb640 1 -- 172.21.15.159:0/797303793 >> 172.21.15.159:0/797303793 conn(0x7f95a00b33c0 msgr2=0x7f95a015a590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:09.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.776+0000 7f95a4acb640 1 -- 172.21.15.159:0/797303793 shutdown_connections 2024-07-24T16:25:09.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.776+0000 7f95a4acb640 1 -- 172.21.15.159:0/797303793 wait complete. 2024-07-24T16:25:09.790 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr/snap_schedule/dump_on_update True 2024-07-24T16:25:09.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.896+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/2056433956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2c415f9a0 msgr2=0x7fa2c40ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:09.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.896+0000 7fa2cc2d4640 1 --2- 172.21.15.159:0/2056433956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2c415f9a0 0x7fa2c40ae730 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40b4450 tx=0x7fa2bc02ab40 comp rx=0 tx=0).stop 2024-07-24T16:25:09.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.896+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/2056433956 shutdown_connections 2024-07-24T16:25:09.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.896+0000 7fa2cc2d4640 1 --2- 172.21.15.159:0/2056433956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2c415f9a0 0x7fa2c40ae730 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.896+0000 7fa2cc2d4640 1 --2- 172.21.15.159:0/2056433956 >> v2:172.21.15.193:3300/0 conn(0x7fa2c415b4d0 0x7fa2c4070750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.896+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/2056433956 >> 172.21.15.159:0/2056433956 conn(0x7fa2c409aa20 msgr2=0x7fa2c40d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:09.899 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.896+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/2056433956 shutdown_connections 2024-07-24T16:25:09.900 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.896+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/2056433956 wait complete. 2024-07-24T16:25:09.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.897+0000 7fa2cc2d4640 1 Processor -- start 2024-07-24T16:25:09.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.897+0000 7fa2cc2d4640 1 -- start start 2024-07-24T16:25:09.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2cc2d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2c409af50 0x7fa2c40c76e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:09.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2cc2d4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2c415b4d0 0x7fa2c40c7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:09.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2cc2d4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2c415f9a0 0x7fa2c41f4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:09.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2cc2d4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c40af000 con 0x7fa2c409af50 2024-07-24T16:25:09.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2cc2d4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa2c40aee80 con 0x7fa2c415b4d0 2024-07-24T16:25:09.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2cc2d4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa2c40af180 con 0x7fa2c415f9a0 2024-07-24T16:25:09.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2ca070640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2c409af50 0x7fa2c40c76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:09.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2ca070640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2c409af50 0x7fa2c40c76e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43562/0 (socket says 172.21.15.159:43562) 2024-07-24T16:25:09.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2ca070640 1 -- 172.21.15.159:0/1351563547 learned_addr learned my addr 172.21.15.159:0/1351563547 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:09.902 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2c986f640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2c415b4d0 0x7fa2c40c7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2ca871640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2c415f9a0 0x7fa2c41f4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2ca070640 1 -- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2c415f9a0 msgr2=0x7fa2c41f4070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2ca070640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2c415f9a0 0x7fa2c41f4070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2ca070640 1 -- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2c415b4d0 msgr2=0x7fa2c40c7c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2ca070640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2c415b4d0 0x7fa2c40c7c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2ca070640 1 -- 172.21.15.159:0/1351563547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c406e590 con 0x7fa2c409af50 2024-07-24T16:25:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.898+0000 7fa2ca070640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2c409af50 0x7fa2c40c76e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000d950 tx=0x7fa2c000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.899+0000 7fa2b6ffd640 1 -- 172.21.15.159:0/1351563547 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0017070 con 0x7fa2c409af50 2024-07-24T16:25:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.899+0000 7fa2b6ffd640 1 -- 172.21.15.159:0/1351563547 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2c0009d20 con 0x7fa2c409af50 2024-07-24T16:25:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.899+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/1351563547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c406e870 con 0x7fa2c409af50 2024-07-24T16:25:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.899+0000 7fa2b6ffd640 1 -- 172.21.15.159:0/1351563547 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c0004280 con 0x7fa2c409af50 2024-07-24T16:25:09.903 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.899+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/1351563547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2c415a650 con 0x7fa2c409af50 2024-07-24T16:25:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.900+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/1351563547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2c406eab0 con 0x7fa2c409af50 2024-07-24T16:25:09.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.901+0000 7fa2b6ffd640 1 -- 172.21.15.159:0/1351563547 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 6) ==== 99156+0+0 (secure 0 0 0) 0x7fa2c00035f0 con 0x7fa2c409af50 2024-07-24T16:25:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.901+0000 7fa2b6ffd640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa2a8077060 0x7fa2a8079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.901+0000 7fa2c986f640 1 -- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa2a8077060 msgr2=0x7fa2a8079520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/222319347 2024-07-24T16:25:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.902+0000 7fa2b6ffd640 1 -- 172.21.15.159:0/1351563547 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fa2c0098a30 con 0x7fa2c409af50 2024-07-24T16:25:09.905 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.902+0000 7fa2c986f640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa2a8077060 0x7fa2a8079520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-07-24T16:25:09.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:09.906+0000 7fa2b6ffd640 1 -- 172.21.15.159:0/1351563547 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa2c0061570 con 0x7fa2c409af50 2024-07-24T16:25:10.099 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.097+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/1351563547 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fa2c4070750 con 0x7fa2c409af50 2024-07-24T16:25:10.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.102+0000 7fa2b6ffd640 1 -- 172.21.15.159:0/1351563547 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7fa2c0065ac0 con 0x7fa2c409af50 2024-07-24T16:25:10.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.103+0000 7fa2c986f640 1 -- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa2a8077060 msgr2=0x7fa2a8079520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/222319347 2024-07-24T16:25:10.105 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.103+0000 7fa2c986f640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa2a8077060 0x7fa2a8079520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-07-24T16:25:10.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.105+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa2a8077060 msgr2=0x7fa2a8079520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:25:10.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.105+0000 7fa2cc2d4640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa2a8077060 0x7fa2a8079520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:10.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.105+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/1351563547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2c409af50 msgr2=0x7fa2c40c76e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:10.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.105+0000 7fa2cc2d4640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2c409af50 0x7fa2c40c76e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa2c000d950 tx=0x7fa2c000de10 comp rx=0 tx=0).stop 2024-07-24T16:25:10.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.105+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/1351563547 shutdown_connections 2024-07-24T16:25:10.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.105+0000 7fa2cc2d4640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa2a8077060 0x7fa2a8079520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:10.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.105+0000 7fa2cc2d4640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa2c415f9a0 0x7fa2c41f4070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:10.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.105+0000 7fa2cc2d4640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa2c415b4d0 0x7fa2c40c7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:10.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.105+0000 7fa2cc2d4640 1 --2- 172.21.15.159:0/1351563547 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa2c409af50 0x7fa2c40c76e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:10.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.105+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/1351563547 >> 172.21.15.159:0/1351563547 conn(0x7fa2c409aa20 msgr2=0x7fa2c40b66c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:10.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.105+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/1351563547 shutdown_connections 2024-07-24T16:25:10.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.105+0000 7fa2cc2d4640 1 -- 172.21.15.159:0/1351563547 wait complete. 2024-07-24T16:25:10.119 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:10.119 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1) 2024-07-24T16:25:10.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:10.139 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir0) 2024-07-24T16:25:10.196 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir0 1m 2024-07-24T16:25:10.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.342+0000 7fa0d671e640 1 -- 172.21.15.159:0/4078454058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0d006cc70 msgr2=0x7fa0d006eba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:10.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.342+0000 7fa0d671e640 1 --2- 172.21.15.159:0/4078454058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0d006cc70 0x7fa0d006eba0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8005fd0 tx=0x7fa0c802aa00 comp rx=0 tx=0).stop 2024-07-24T16:25:10.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.342+0000 7fa0d671e640 1 -- 172.21.15.159:0/4078454058 shutdown_connections 2024-07-24T16:25:10.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.342+0000 7fa0d671e640 1 --2- 172.21.15.159:0/4078454058 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0d0072a80 0x7fa0d015f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:10.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.342+0000 7fa0d671e640 1 --2- 172.21.15.159:0/4078454058 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0d006cc70 0x7fa0d006eba0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:10.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.342+0000 7fa0d671e640 1 -- 172.21.15.159:0/4078454058 >> 172.21.15.159:0/4078454058 conn(0x7fa0d0071140 msgr2=0x7fa0d006d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:10.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.342+0000 7fa0d671e640 1 -- 172.21.15.159:0/4078454058 shutdown_connections 2024-07-24T16:25:10.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.342+0000 7fa0d671e640 1 -- 172.21.15.159:0/4078454058 wait complete. 2024-07-24T16:25:10.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.343+0000 7fa0d671e640 1 Processor -- start 2024-07-24T16:25:10.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.344+0000 7fa0d671e640 1 -- start start 2024-07-24T16:25:10.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.344+0000 7fa0d671e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0d006cc70 0x7fa0d01f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:10.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.344+0000 7fa0d671e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0d015b3e0 0x7fa0d0151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:10.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.344+0000 7fa0d671e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0d0152410 0x7fa0d0150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:10.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.344+0000 7fa0d671e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d006f4b0 con 0x7fa0d0152410 2024-07-24T16:25:10.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.344+0000 7fa0d671e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa0d006f330 con 0x7fa0d006cc70 2024-07-24T16:25:10.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.344+0000 7fa0d671e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa0d006f630 con 0x7fa0d015b3e0 2024-07-24T16:25:10.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.344+0000 7fa0d4cbb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0d0152410 0x7fa0d0150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:10.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.344+0000 7fa0d4cbb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0d0152410 0x7fa0d0150320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:43588/0 (socket says 172.21.15.159:43588) 2024-07-24T16:25:10.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.344+0000 7fa0d4cbb640 1 -- 172.21.15.159:0/3190015819 learned_addr learned my addr 172.21.15.159:0/3190015819 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:10.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.345+0000 7fa0cf7fe640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0d015b3e0 0x7fa0d0151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:10.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.345+0000 7fa0cffff640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0d006cc70 0x7fa0d01f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:10.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.345+0000 7fa0d4cbb640 1 -- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0d015b3e0 msgr2=0x7fa0d0151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:10.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.345+0000 7fa0d4cbb640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0d015b3e0 0x7fa0d0151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:10.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.345+0000 7fa0d4cbb640 1 -- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0d006cc70 msgr2=0x7fa0d01f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:10.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.345+0000 7fa0d4cbb640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0d006cc70 0x7fa0d01f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:10.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.345+0000 7fa0d4cbb640 1 -- 172.21.15.159:0/3190015819 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0d0154930 con 0x7fa0d0152410 2024-07-24T16:25:10.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.345+0000 7fa0d4cbb640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0d0152410 0x7fa0d0150320 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8009d90 tx=0x7fa0c8003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:10.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.345+0000 7fa0ccff9640 1 -- 172.21.15.159:0/3190015819 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8047070 con 0x7fa0d0152410 2024-07-24T16:25:10.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.345+0000 7fa0ccff9640 1 -- 172.21.15.159:0/3190015819 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0c8004250 con 0x7fa0d0152410 2024-07-24T16:25:10.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.345+0000 7fa0d671e640 1 -- 172.21.15.159:0/3190015819 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0d0154c10 con 0x7fa0d0152410 2024-07-24T16:25:10.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.345+0000 7fa0ccff9640 1 -- 172.21.15.159:0/3190015819 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0c8033050 con 0x7fa0d0152410 2024-07-24T16:25:10.350 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.345+0000 7fa0d671e640 1 -- 172.21.15.159:0/3190015819 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0d014fe00 con 0x7fa0d0152410 2024-07-24T16:25:10.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.346+0000 7fa0d671e640 1 -- 172.21.15.159:0/3190015819 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0d006eba0 con 0x7fa0d0152410 2024-07-24T16:25:10.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.347+0000 7fa0ccff9640 1 -- 172.21.15.159:0/3190015819 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 6) ==== 99156+0+0 (secure 0 0 0) 0x7fa0c804a070 con 0x7fa0d0152410 2024-07-24T16:25:10.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.347+0000 7fa0ccff9640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa0bc077060 0x7fa0bc079520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:10.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.348+0000 7fa0cffff640 1 -- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa0bc077060 msgr2=0x7fa0bc079520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/222319347 2024-07-24T16:25:10.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.348+0000 7fa0ccff9640 1 -- 172.21.15.159:0/3190015819 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 6101+0+0 (secure 0 0 0) 0x7fa0c80b9b90 con 0x7fa0d0152410 2024-07-24T16:25:10.351 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.348+0000 7fa0cffff640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa0bc077060 0x7fa0bc079520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-07-24T16:25:10.354 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.352+0000 7fa0ccff9640 1 -- 172.21.15.159:0/3190015819 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa0c8082650 con 0x7fa0d0152410 2024-07-24T16:25:10.417 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:25:10.419 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:25:10.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.549+0000 7fa0cffff640 1 -- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa0bc077060 msgr2=0x7fa0bc079520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/222319347 2024-07-24T16:25:10.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.549+0000 7fa0cffff640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa0bc077060 0x7fa0bc079520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-07-24T16:25:10.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.568+0000 7fa0d671e640 1 -- 172.21.15.159:0/3190015819 --> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir0", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa0d0154de0 con 0x7fa0bc077060 2024-07-24T16:25:10.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.950+0000 7fa0cffff640 1 -- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa0bc077060 msgr2=0x7fa0bc079520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/222319347 2024-07-24T16:25:10.952 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:10.950+0000 7fa0cffff640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa0bc077060 0x7fa0bc079520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-07-24T16:25:11.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:11.751+0000 7fa0cffff640 1 -- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa0bc077060 msgr2=0x7fa0bc079520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/222319347 2024-07-24T16:25:11.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:11.751+0000 7fa0cffff640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa0bc077060 0x7fa0bc079520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-07-24T16:25:13.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:13.039+0000 7fa0ccff9640 1 -- 172.21.15.159:0/3190015819 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 7) ==== 98867+0+0 (secure 0 0 0) 0x7fa0c8036070 con 0x7fa0d0152410 2024-07-24T16:25:13.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:13.039+0000 7fa0ccff9640 1 -- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa0bc077060 msgr2=0x7fa0bc079520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:25:13.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:13.039+0000 7fa0ccff9640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/222319347,v1:172.21.15.193:6833/222319347] conn(0x7fa0bc077060 0x7fa0bc079520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:13.195 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:25:13.193+0000 7f369035f640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:25:13.195 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:25:13.193+0000 7f369035f640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:25:13.196 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:25:13.193+0000 7f368d359640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:25:13.196 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:25:13.193+0000 7f368d359640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:25:13.196 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:25:13.193+0000 7f368d359640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:25:13.196 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:25:13.193+0000 7f368d359640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:25:13.196 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:25:13.193+0000 7f368d359640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:25:13.196 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:25:13.193+0000 7f369035f640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:25:13.196 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:25:13.193+0000 7f369035f640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:25:13.196 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:25:13.193+0000 7f369035f640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:25:14.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.041+0000 7fa0ccff9640 1 -- 172.21.15.159:0/3190015819 <== mon.0 v2:172.21.15.159:3300/0 8 ==== mgrmap(e 8) ==== 98994+0+0 (secure 0 0 0) 0x7fa0c807e8e0 con 0x7fa0d0152410 2024-07-24T16:25:14.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.041+0000 7fa0ccff9640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa0bc07f560 0x7fa0bc081950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:14.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.041+0000 7fa0ccff9640 1 -- 172.21.15.159:0/3190015819 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir0", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa0bc0081c0 con 0x7fa0bc07f560 2024-07-24T16:25:14.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.046+0000 7fa0cffff640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa0bc07f560 0x7fa0bc081950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:14.051 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.049+0000 7fa0cffff640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa0bc07f560 0x7fa0bc081950 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0006fd0 tx=0x7fa0c0009060 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:14.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.199+0000 7fa0ccff9640 1 -- 172.21.15.159:0/3190015819 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fa0bc0081c0 con 0x7fa0bc07f560 2024-07-24T16:25:14.202 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule set for path /snap_test_dir1/dir0 2024-07-24T16:25:14.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.201+0000 7fa0d671e640 1 -- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa0bc07f560 msgr2=0x7fa0bc081950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:14.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.201+0000 7fa0d671e640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa0bc07f560 0x7fa0bc081950 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fa0c0006fd0 tx=0x7fa0c0009060 comp rx=0 tx=0).stop 2024-07-24T16:25:14.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.201+0000 7fa0d671e640 1 -- 172.21.15.159:0/3190015819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0d0152410 msgr2=0x7fa0d0150320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:14.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.201+0000 7fa0d671e640 1 --2- 172.21.15.159:0/3190015819 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0d0152410 0x7fa0d0150320 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa0c8009d90 tx=0x7fa0c8003f30 comp rx=0 tx=0).stop 2024-07-24T16:25:14.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.201+0000 7fa0d4cbb640 1 -- 172.21.15.159:0/3190015819 reap_dead start 2024-07-24T16:25:14.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.201+0000 7fa0d671e640 1 -- 172.21.15.159:0/3190015819 shutdown_connections 2024-07-24T16:25:14.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.201+0000 7fa0d671e640 1 -- 172.21.15.159:0/3190015819 >> 172.21.15.159:0/3190015819 conn(0x7fa0d0071140 msgr2=0x7fa0d00b2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:14.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.202+0000 7fa0d671e640 1 -- 172.21.15.159:0/3190015819 shutdown_connections 2024-07-24T16:25:14.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.202+0000 7fa0d671e640 1 -- 172.21.15.159:0/3190015819 wait complete. 2024-07-24T16:25:14.216 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir0 2024-07-24T16:25:14.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:14.217 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir1) 2024-07-24T16:25:14.234 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir1 1m 2024-07-24T16:25:14.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.379+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3188343326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe80b5de0 msgr2=0x7f5fe80ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:14.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.379+0000 7f5fed9b1640 1 --2- 172.21.15.159:0/3188343326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe80b5de0 0x7f5fe80ce400 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f5fe80ccd20 tx=0x7f5fd002a4d0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.379+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3188343326 shutdown_connections 2024-07-24T16:25:14.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.379+0000 7f5fed9b1640 1 --2- 172.21.15.159:0/3188343326 >> v2:172.21.15.193:3300/0 conn(0x7f5fe80ce940 0x7f5fe8072a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.379+0000 7f5fed9b1640 1 --2- 172.21.15.159:0/3188343326 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe80b5de0 0x7f5fe80ce400 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.379+0000 7f5fed9b1640 1 --2- 172.21.15.159:0/3188343326 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5fe815a220 0x7f5fe80b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.379+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3188343326 >> 172.21.15.159:0/3188343326 conn(0x7f5fe8071140 msgr2=0x7f5fe806d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:14.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.379+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3188343326 shutdown_connections 2024-07-24T16:25:14.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.379+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3188343326 wait complete. 2024-07-24T16:25:14.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.380+0000 7f5fed9b1640 1 Processor -- start 2024-07-24T16:25:14.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.380+0000 7f5fed9b1640 1 -- start start 2024-07-24T16:25:14.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.381+0000 7f5fed9b1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe80b5de0 0x7f5fe8152dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:14.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.381+0000 7f5fed9b1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5fe80ce940 0x7f5fe815d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:14.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.381+0000 7f5fed9b1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fe815a220 0x7f5fe81f5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:14.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.381+0000 7f5fed9b1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe8073140 con 0x7f5fe80b5de0 2024-07-24T16:25:14.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.381+0000 7f5fed9b1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe8072fc0 con 0x7f5fe815a220 2024-07-24T16:25:14.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.381+0000 7f5fed9b1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5fe80732c0 con 0x7f5fe80ce940 2024-07-24T16:25:14.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.381+0000 7f5fe6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe80b5de0 0x7f5fe8152dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:14.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.381+0000 7f5fe6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe80b5de0 0x7f5fe8152dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35426/0 (socket says 172.21.15.159:35426) 2024-07-24T16:25:14.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.381+0000 7f5fe6ffd640 1 -- 172.21.15.159:0/3815077780 learned_addr learned my addr 172.21.15.159:0/3815077780 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:14.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.381+0000 7f5fe77fe640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fe815a220 0x7f5fe81f5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:14.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.381+0000 7f5fe67fc640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5fe80ce940 0x7f5fe815d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:14.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.381+0000 7f5fe6ffd640 1 -- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5fe80ce940 msgr2=0x7f5fe815d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:14.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.381+0000 7f5fe6ffd640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5fe80ce940 0x7f5fe815d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.382+0000 7f5fe6ffd640 1 -- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fe815a220 msgr2=0x7f5fe81f5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:14.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.382+0000 7f5fe6ffd640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fe815a220 0x7f5fe81f5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.382+0000 7f5fe6ffd640 1 -- 172.21.15.159:0/3815077780 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe815c8b0 con 0x7f5fe80b5de0 2024-07-24T16:25:14.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.382+0000 7f5fe6ffd640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe80b5de0 0x7f5fe8152dc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800ea50 tx=0x7f5fd800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:14.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.382+0000 7f5fdffff640 1 -- 172.21.15.159:0/3815077780 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd800cdc0 con 0x7f5fe80b5de0 2024-07-24T16:25:14.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.382+0000 7f5fdffff640 1 -- 172.21.15.159:0/3815077780 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5fd8011560 con 0x7f5fe80b5de0 2024-07-24T16:25:14.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.382+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3815077780 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe80c82e0 con 0x7f5fe80b5de0 2024-07-24T16:25:14.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.382+0000 7f5fdffff640 1 -- 172.21.15.159:0/3815077780 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8011990 con 0x7f5fe80b5de0 2024-07-24T16:25:14.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.382+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3815077780 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe80c88a0 con 0x7f5fe80b5de0 2024-07-24T16:25:14.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.383+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3815077780 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe80c98b0 con 0x7f5fe80b5de0 2024-07-24T16:25:14.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.383+0000 7f5fdffff640 1 -- 172.21.15.159:0/3815077780 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) ==== 98994+0+0 (secure 0 0 0) 0x7f5fd8011b30 con 0x7f5fe80b5de0 2024-07-24T16:25:14.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.384+0000 7f5fdffff640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5fc8076eb0 0x7f5fc8079370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:14.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.384+0000 7f5fdffff640 1 -- 172.21.15.159:0/3815077780 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7f5fd80991f0 con 0x7f5fe80b5de0 2024-07-24T16:25:14.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.384+0000 7f5fe67fc640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5fc8076eb0 0x7f5fc8079370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:14.389 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.384+0000 7f5fe67fc640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5fc8076eb0 0x7f5fc8079370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0033000 tx=0x7f5fd0004730 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:14.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.388+0000 7f5fdffff640 1 -- 172.21.15.159:0/3815077780 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f5fd8016030 con 0x7f5fe80b5de0 2024-07-24T16:25:14.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.594+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3815077780 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir1", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f5fe80737e0 con 0x7f5fc8076eb0 2024-07-24T16:25:14.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.659+0000 7f5fdffff640 1 -- 172.21.15.159:0/3815077780 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f5fe80737e0 con 0x7f5fc8076eb0 2024-07-24T16:25:14.661 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule set for path /snap_test_dir1/dir1 2024-07-24T16:25:14.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.661+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5fc8076eb0 msgr2=0x7f5fc8079370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:14.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.661+0000 7f5fed9b1640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5fc8076eb0 0x7f5fc8079370 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0033000 tx=0x7f5fd0004730 comp rx=0 tx=0).stop 2024-07-24T16:25:14.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.661+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3815077780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe80b5de0 msgr2=0x7f5fe8152dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:14.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.661+0000 7f5fed9b1640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe80b5de0 0x7f5fe8152dc0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f5fd800ea50 tx=0x7f5fd800ef10 comp rx=0 tx=0).stop 2024-07-24T16:25:14.665 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.661+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3815077780 shutdown_connections 2024-07-24T16:25:14.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.661+0000 7f5fed9b1640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5fc8076eb0 0x7f5fc8079370 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.661+0000 7f5fed9b1640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5fe815a220 0x7f5fe81f5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.661+0000 7f5fed9b1640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5fe80ce940 0x7f5fe815d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.661+0000 7f5fed9b1640 1 --2- 172.21.15.159:0/3815077780 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5fe80b5de0 0x7f5fe8152dc0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.661+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3815077780 >> 172.21.15.159:0/3815077780 conn(0x7f5fe8071140 msgr2=0x7f5fe806eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:14.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.662+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3815077780 shutdown_connections 2024-07-24T16:25:14.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.662+0000 7f5fed9b1640 1 -- 172.21.15.159:0/3815077780 wait complete. 2024-07-24T16:25:14.675 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir1 2024-07-24T16:25:14.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:14.675 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir2) 2024-07-24T16:25:14.692 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir2 1m 2024-07-24T16:25:14.838 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.835+0000 7fb42d372640 1 -- 172.21.15.159:0/899435787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb42815d8e0 msgr2=0x7fb4280d15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:14.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.835+0000 7fb42d372640 1 --2- 172.21.15.159:0/899435787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb42815d8e0 0x7fb4280d15e0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb410009830 tx=0x7fb41002a5c0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.836+0000 7fb42d372640 1 -- 172.21.15.159:0/899435787 shutdown_connections 2024-07-24T16:25:14.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.836+0000 7fb42d372640 1 --2- 172.21.15.159:0/899435787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb42815d8e0 0x7fb4280d15e0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.836+0000 7fb42d372640 1 -- 172.21.15.159:0/899435787 >> 172.21.15.159:0/899435787 conn(0x7fb42806cbd0 msgr2=0x7fb42806cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:14.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.836+0000 7fb42d372640 1 -- 172.21.15.159:0/899435787 shutdown_connections 2024-07-24T16:25:14.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.836+0000 7fb42d372640 1 -- 172.21.15.159:0/899435787 wait complete. 2024-07-24T16:25:14.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.837+0000 7fb42d372640 1 Processor -- start 2024-07-24T16:25:14.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.837+0000 7fb42d372640 1 -- start start 2024-07-24T16:25:14.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.837+0000 7fb42d372640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4280b2710 0x7fb42815dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:14.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.837+0000 7fb42d372640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4280d3be0 0x7fb4280b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:14.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.837+0000 7fb42d372640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb42815d8e0 0x7fb428159900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:14.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.837+0000 7fb42d372640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb4280d23b0 con 0x7fb4280b2710 2024-07-24T16:25:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb42d372640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb4280d2230 con 0x7fb4280d3be0 2024-07-24T16:25:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb42d372640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb4280d2530 con 0x7fb42815d8e0 2024-07-24T16:25:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb426ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4280b2710 0x7fb42815dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb426ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4280b2710 0x7fb42815dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35450/0 (socket says 172.21.15.159:35450) 2024-07-24T16:25:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb426ffd640 1 -- 172.21.15.159:0/731521037 learned_addr learned my addr 172.21.15.159:0/731521037 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb41ffff640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4280d3be0 0x7fb4280b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb4277fe640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb42815d8e0 0x7fb428159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb426ffd640 1 -- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb42815d8e0 msgr2=0x7fb428159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb426ffd640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb42815d8e0 0x7fb428159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb426ffd640 1 -- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4280d3be0 msgr2=0x7fb4280b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb426ffd640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4280d3be0 0x7fb4280b1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb426ffd640 1 -- 172.21.15.159:0/731521037 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb428160bc0 con 0x7fb4280b2710 2024-07-24T16:25:14.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb426ffd640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4280b2710 0x7fb42815dd20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb41800c410 tx=0x7fb41800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:14.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb41f7fe640 1 -- 172.21.15.159:0/731521037 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb418017070 con 0x7fb4280b2710 2024-07-24T16:25:14.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb41f7fe640 1 -- 172.21.15.159:0/731521037 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4180035f0 con 0x7fb4280b2710 2024-07-24T16:25:14.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb42d372640 1 -- 172.21.15.159:0/731521037 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42815e300 con 0x7fb4280b2710 2024-07-24T16:25:14.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb41f7fe640 1 -- 172.21.15.159:0/731521037 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb418003a80 con 0x7fb4280b2710 2024-07-24T16:25:14.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.838+0000 7fb42d372640 1 -- 172.21.15.159:0/731521037 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb428161120 con 0x7fb4280b2710 2024-07-24T16:25:14.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.839+0000 7fb42d372640 1 -- 172.21.15.159:0/731521037 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4280d3fc0 con 0x7fb4280b2710 2024-07-24T16:25:14.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.840+0000 7fb41f7fe640 1 -- 172.21.15.159:0/731521037 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 8) ==== 98994+0+0 (secure 0 0 0) 0x7fb41801a070 con 0x7fb4280b2710 2024-07-24T16:25:14.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.840+0000 7fb41f7fe640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb408076ee0 0x7fb4080793a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:14.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.841+0000 7fb41f7fe640 1 -- 172.21.15.159:0/731521037 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7fb418097a60 con 0x7fb4280b2710 2024-07-24T16:25:14.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.841+0000 7fb41ffff640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb408076ee0 0x7fb4080793a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:14.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.841+0000 7fb41ffff640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb408076ee0 0x7fb4080793a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb410034000 tx=0x7fb410004730 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:14.847 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:14.845+0000 7fb41f7fe640 1 -- 172.21.15.159:0/731521037 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fb428160bc0 con 0x7fb4280b2710 2024-07-24T16:25:15.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.051+0000 7fb42d372640 1 -- 172.21.15.159:0/731521037 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir2", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fb42806d210 con 0x7fb408076ee0 2024-07-24T16:25:15.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.091+0000 7fb41f7fe640 1 -- 172.21.15.159:0/731521037 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 9) ==== 99259+0+0 (secure 0 0 0) 0x7fb41805c9e0 con 0x7fb4280b2710 2024-07-24T16:25:15.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.129+0000 7fb41f7fe640 1 -- 172.21.15.159:0/731521037 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fb42806d210 con 0x7fb408076ee0 2024-07-24T16:25:15.132 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule set for path /snap_test_dir1/dir2 2024-07-24T16:25:15.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.132+0000 7fb42d372640 1 -- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb408076ee0 msgr2=0x7fb4080793a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:15.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.132+0000 7fb42d372640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb408076ee0 0x7fb4080793a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fb410034000 tx=0x7fb410004730 comp rx=0 tx=0).stop 2024-07-24T16:25:15.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.132+0000 7fb42d372640 1 -- 172.21.15.159:0/731521037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4280b2710 msgr2=0x7fb42815dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:15.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.132+0000 7fb42d372640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4280b2710 0x7fb42815dd20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb41800c410 tx=0x7fb41800c8d0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.132+0000 7fb42d372640 1 -- 172.21.15.159:0/731521037 shutdown_connections 2024-07-24T16:25:15.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.132+0000 7fb42d372640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb408076ee0 0x7fb4080793a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.132+0000 7fb42d372640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb42815d8e0 0x7fb428159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.132+0000 7fb42d372640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4280d3be0 0x7fb4280b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.132+0000 7fb42d372640 1 --2- 172.21.15.159:0/731521037 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4280b2710 0x7fb42815dd20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.132+0000 7fb42d372640 1 -- 172.21.15.159:0/731521037 >> 172.21.15.159:0/731521037 conn(0x7fb42806cbd0 msgr2=0x7fb4280b8080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:15.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.132+0000 7fb42d372640 1 -- 172.21.15.159:0/731521037 shutdown_connections 2024-07-24T16:25:15.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.132+0000 7fb42d372640 1 -- 172.21.15.159:0/731521037 wait complete. 2024-07-24T16:25:15.145 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir2 2024-07-24T16:25:15.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:15.145 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir3) 2024-07-24T16:25:15.162 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir3 1m 2024-07-24T16:25:15.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.307+0000 7fcb81655640 1 -- 172.21.15.159:0/521317070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb7c15d950 msgr2=0x7fcb7c161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:15.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.307+0000 7fcb81655640 1 --2- 172.21.15.159:0/521317070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb7c15d950 0x7fcb7c161f20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c009830 tx=0x7fcb6c02a5a0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.307+0000 7fcb81655640 1 -- 172.21.15.159:0/521317070 shutdown_connections 2024-07-24T16:25:15.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.307+0000 7fcb81655640 1 --2- 172.21.15.159:0/521317070 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcb7c0b2ae0 0x7fcb7c0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.307+0000 7fcb81655640 1 --2- 172.21.15.159:0/521317070 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb7c15d950 0x7fcb7c161f20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.307+0000 7fcb81655640 1 -- 172.21.15.159:0/521317070 >> 172.21.15.159:0/521317070 conn(0x7fcb7c09cd30 msgr2=0x7fcb7c0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:15.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.307+0000 7fcb81655640 1 -- 172.21.15.159:0/521317070 shutdown_connections 2024-07-24T16:25:15.310 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.307+0000 7fcb81655640 1 -- 172.21.15.159:0/521317070 wait complete. 2024-07-24T16:25:15.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.308+0000 7fcb81655640 1 Processor -- start 2024-07-24T16:25:15.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.308+0000 7fcb81655640 1 -- start start 2024-07-24T16:25:15.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb81655640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb7c0b0b60 0x7fcb7c0b2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:15.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb81655640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcb7c0b2ae0 0x7fcb7c15fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:15.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb81655640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb7c15d950 0x7fcb7c1f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:15.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb81655640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0d02e0 con 0x7fcb7c15d950 2024-07-24T16:25:15.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb81655640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcb7c0d0090 con 0x7fcb7c0b0b60 2024-07-24T16:25:15.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb81655640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcb7c0d0460 con 0x7fcb7c0b2ae0 2024-07-24T16:25:15.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb7b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb7c15d950 0x7fcb7c1f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb7b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb7c15d950 0x7fcb7c1f3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35452/0 (socket says 172.21.15.159:35452) 2024-07-24T16:25:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb7b7fe640 1 -- 172.21.15.159:0/2154147325 learned_addr learned my addr 172.21.15.159:0/2154147325 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb7affd640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb7c0b0b60 0x7fcb7c0b2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb727fc640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcb7c0b2ae0 0x7fcb7c15fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb7b7fe640 1 -- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcb7c0b2ae0 msgr2=0x7fcb7c15fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb7b7fe640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcb7c0b2ae0 0x7fcb7c15fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb7b7fe640 1 -- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb7c0b0b60 msgr2=0x7fcb7c0b2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb7b7fe640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb7c0b0b60 0x7fcb7c0b2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb7b7fe640 1 -- 172.21.15.159:0/2154147325 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb7c1f4a10 con 0x7fcb7c15d950 2024-07-24T16:25:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb7b7fe640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb7c15d950 0x7fcb7c1f3ec0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400cbc0 tx=0x7fcb7400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.309+0000 7fcb73fff640 1 -- 172.21.15.159:0/2154147325 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74016020 con 0x7fcb7c15d950 2024-07-24T16:25:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.310+0000 7fcb73fff640 1 -- 172.21.15.159:0/2154147325 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcb7400ad90 con 0x7fcb7c15d950 2024-07-24T16:25:15.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.310+0000 7fcb81655640 1 -- 172.21.15.159:0/2154147325 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb7c1f4cf0 con 0x7fcb7c15d950 2024-07-24T16:25:15.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.310+0000 7fcb73fff640 1 -- 172.21.15.159:0/2154147325 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb74012680 con 0x7fcb7c15d950 2024-07-24T16:25:15.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.310+0000 7fcb81655640 1 -- 172.21.15.159:0/2154147325 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb7c15e540 con 0x7fcb7c15d950 2024-07-24T16:25:15.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.311+0000 7fcb81655640 1 -- 172.21.15.159:0/2154147325 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb7c15e070 con 0x7fcb7c15d950 2024-07-24T16:25:15.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.311+0000 7fcb73fff640 1 -- 172.21.15.159:0/2154147325 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 9) ==== 99259+0+0 (secure 0 0 0) 0x7fcb74019020 con 0x7fcb7c15d950 2024-07-24T16:25:15.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.311+0000 7fcb73fff640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcb60077180 0x7fcb60079640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:15.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.312+0000 7fcb73fff640 1 -- 172.21.15.159:0/2154147325 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7fcb74099220 con 0x7fcb7c15d950 2024-07-24T16:25:15.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.312+0000 7fcb7affd640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcb60077180 0x7fcb60079640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:15.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.312+0000 7fcb7affd640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcb60077180 0x7fcb60079640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c034000 tx=0x7fcb6c004730 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:15.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.316+0000 7fcb73fff640 1 -- 172.21.15.159:0/2154147325 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fcb74020020 con 0x7fcb7c15d950 2024-07-24T16:25:15.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.522+0000 7fcb81655640 1 -- 172.21.15.159:0/2154147325 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir3", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fcb7c0d08f0 con 0x7fcb60077180 2024-07-24T16:25:15.580 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.578+0000 7fcb73fff640 1 -- 172.21.15.159:0/2154147325 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fcb7c0d08f0 con 0x7fcb60077180 2024-07-24T16:25:15.581 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule set for path /snap_test_dir1/dir3 2024-07-24T16:25:15.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.580+0000 7fcb81655640 1 -- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcb60077180 msgr2=0x7fcb60079640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:15.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.580+0000 7fcb81655640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcb60077180 0x7fcb60079640 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c034000 tx=0x7fcb6c004730 comp rx=0 tx=0).stop 2024-07-24T16:25:15.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.580+0000 7fcb81655640 1 -- 172.21.15.159:0/2154147325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb7c15d950 msgr2=0x7fcb7c1f3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:15.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.580+0000 7fcb81655640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb7c15d950 0x7fcb7c1f3ec0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fcb7400cbc0 tx=0x7fcb7400a060 comp rx=0 tx=0).stop 2024-07-24T16:25:15.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.580+0000 7fcb81655640 1 -- 172.21.15.159:0/2154147325 shutdown_connections 2024-07-24T16:25:15.583 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.580+0000 7fcb81655640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcb60077180 0x7fcb60079640 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.580+0000 7fcb81655640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcb7c15d950 0x7fcb7c1f3ec0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.580+0000 7fcb81655640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcb7c0b2ae0 0x7fcb7c15fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.580+0000 7fcb81655640 1 --2- 172.21.15.159:0/2154147325 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcb7c0b0b60 0x7fcb7c0b2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.580+0000 7fcb81655640 1 -- 172.21.15.159:0/2154147325 >> 172.21.15.159:0/2154147325 conn(0x7fcb7c09cd30 msgr2=0x7fcb7c0b6970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:15.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.580+0000 7fcb81655640 1 -- 172.21.15.159:0/2154147325 shutdown_connections 2024-07-24T16:25:15.584 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.580+0000 7fcb81655640 1 -- 172.21.15.159:0/2154147325 wait complete. 2024-07-24T16:25:15.593 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir3 2024-07-24T16:25:15.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:15.594 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir4) 2024-07-24T16:25:15.610 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir4 1m 2024-07-24T16:25:15.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.753+0000 7feb31d04640 1 -- 172.21.15.159:0/40490820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb2c0cf770 msgr2=0x7feb2c0cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:15.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.753+0000 7feb31d04640 1 --2- 172.21.15.159:0/40490820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb2c0cf770 0x7feb2c0cfbc0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7feb2c08c710 tx=0x7feb2402a5f0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.753+0000 7feb31d04640 1 -- 172.21.15.159:0/40490820 shutdown_connections 2024-07-24T16:25:15.756 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.753+0000 7feb31d04640 1 --2- 172.21.15.159:0/40490820 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb2c0cf770 0x7feb2c0cfbc0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.753+0000 7feb31d04640 1 --2- 172.21.15.159:0/40490820 >> v2:172.21.15.193:3300/0 conn(0x7feb2c15d950 0x7feb2c161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.753+0000 7feb31d04640 1 -- 172.21.15.159:0/40490820 >> 172.21.15.159:0/40490820 conn(0x7feb2c09cd30 msgr2=0x7feb2c0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:15.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.753+0000 7feb31d04640 1 -- 172.21.15.159:0/40490820 shutdown_connections 2024-07-24T16:25:15.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.753+0000 7feb31d04640 1 -- 172.21.15.159:0/40490820 wait complete. 2024-07-24T16:25:15.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.754+0000 7feb31d04640 1 Processor -- start 2024-07-24T16:25:15.757 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.755+0000 7feb31d04640 1 -- start start 2024-07-24T16:25:15.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.755+0000 7feb31d04640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb2c0b2ae0 0x7feb2c160de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:15.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.755+0000 7feb31d04640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb2c0cf770 0x7feb2c1f77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:15.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.755+0000 7feb31d04640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb2c15d950 0x7feb2c0cd270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:15.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.755+0000 7feb31d04640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c0ce470 con 0x7feb2c0cf770 2024-07-24T16:25:15.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.755+0000 7feb31d04640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feb2c0ce2f0 con 0x7feb2c15d950 2024-07-24T16:25:15.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.755+0000 7feb31d04640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7feb2c0d02e0 con 0x7feb2c0b2ae0 2024-07-24T16:25:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.755+0000 7feb2affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb2c0cf770 0x7feb2c1f77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.755+0000 7feb2affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb2c0cf770 0x7feb2c1f77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35466/0 (socket says 172.21.15.159:35466) 2024-07-24T16:25:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.755+0000 7feb2affd640 1 -- 172.21.15.159:0/3298508856 learned_addr learned my addr 172.21.15.159:0/3298508856 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.756+0000 7feb2bfff640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb2c15d950 0x7feb2c0cd270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.756+0000 7feb2b7fe640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb2c0b2ae0 0x7feb2c160de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.756+0000 7feb2affd640 1 -- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb2c0b2ae0 msgr2=0x7feb2c160de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.756+0000 7feb2affd640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb2c0b2ae0 0x7feb2c160de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.756+0000 7feb2affd640 1 -- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb2c15d950 msgr2=0x7feb2c0cd270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.756+0000 7feb2affd640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb2c15d950 0x7feb2c0cd270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.756+0000 7feb2affd640 1 -- 172.21.15.159:0/3298508856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2c160020 con 0x7feb2c0cf770 2024-07-24T16:25:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.756+0000 7feb2affd640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb2c0cf770 0x7feb2c1f77c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c410 tx=0x7feb2000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.756+0000 7feb13fff640 1 -- 172.21.15.159:0/3298508856 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20017070 con 0x7feb2c0cf770 2024-07-24T16:25:15.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.756+0000 7feb13fff640 1 -- 172.21.15.159:0/3298508856 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb200035f0 con 0x7feb2c0cf770 2024-07-24T16:25:15.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.756+0000 7feb31d04640 1 -- 172.21.15.159:0/3298508856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2c160300 con 0x7feb2c0cf770 2024-07-24T16:25:15.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.756+0000 7feb13fff640 1 -- 172.21.15.159:0/3298508856 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb20003a40 con 0x7feb2c0cf770 2024-07-24T16:25:15.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.756+0000 7feb31d04640 1 -- 172.21.15.159:0/3298508856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb2c1f7d00 con 0x7feb2c0cf770 2024-07-24T16:25:15.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.757+0000 7feb31d04640 1 -- 172.21.15.159:0/3298508856 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2c160910 con 0x7feb2c0cf770 2024-07-24T16:25:15.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.758+0000 7feb13fff640 1 -- 172.21.15.159:0/3298508856 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 9) ==== 99259+0+0 (secure 0 0 0) 0x7feb2001a070 con 0x7feb2c0cf770 2024-07-24T16:25:15.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.758+0000 7feb13fff640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7feb18077180 0x7feb18079640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:15.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.759+0000 7feb13fff640 1 -- 172.21.15.159:0/3298508856 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7feb200980f0 con 0x7feb2c0cf770 2024-07-24T16:25:15.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.759+0000 7feb2b7fe640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7feb18077180 0x7feb18079640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:15.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.759+0000 7feb2b7fe640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7feb18077180 0x7feb18079640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feb1c007dc0 tx=0x7feb1c0072f0 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:15.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.762+0000 7feb13fff640 1 -- 172.21.15.159:0/3298508856 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7feb20061070 con 0x7feb2c0cf770 2024-07-24T16:25:15.968 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:15.966+0000 7feb31d04640 1 -- 172.21.15.159:0/3298508856 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir4", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7feb2c14d880 con 0x7feb18077180 2024-07-24T16:25:16.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.039+0000 7feb13fff640 1 -- 172.21.15.159:0/3298508856 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7feb2c14d880 con 0x7feb18077180 2024-07-24T16:25:16.042 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule set for path /snap_test_dir1/dir4 2024-07-24T16:25:16.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.041+0000 7feb31d04640 1 -- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7feb18077180 msgr2=0x7feb18079640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:16.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.041+0000 7feb31d04640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7feb18077180 0x7feb18079640 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feb1c007dc0 tx=0x7feb1c0072f0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.044 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.041+0000 7feb31d04640 1 -- 172.21.15.159:0/3298508856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb2c0cf770 msgr2=0x7feb2c1f77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:16.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.041+0000 7feb31d04640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb2c0cf770 0x7feb2c1f77c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7feb2000c410 tx=0x7feb2000c8d0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.041+0000 7feb31d04640 1 -- 172.21.15.159:0/3298508856 shutdown_connections 2024-07-24T16:25:16.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.041+0000 7feb31d04640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7feb18077180 0x7feb18079640 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.041+0000 7feb31d04640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb2c15d950 0x7feb2c0cd270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.041+0000 7feb31d04640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb2c0cf770 0x7feb2c1f77c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.041+0000 7feb31d04640 1 --2- 172.21.15.159:0/3298508856 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb2c0b2ae0 0x7feb2c160de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.041+0000 7feb31d04640 1 -- 172.21.15.159:0/3298508856 >> 172.21.15.159:0/3298508856 conn(0x7feb2c09cd30 msgr2=0x7feb2c0b8670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:16.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.041+0000 7feb31d04640 1 -- 172.21.15.159:0/3298508856 shutdown_connections 2024-07-24T16:25:16.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.041+0000 7feb31d04640 1 -- 172.21.15.159:0/3298508856 wait complete. 2024-07-24T16:25:16.055 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir4 2024-07-24T16:25:16.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:16.055 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir5) 2024-07-24T16:25:16.072 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir5 1m 2024-07-24T16:25:16.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.216+0000 7f8c14806640 1 -- 172.21.15.159:0/1948076148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100cee10 msgr2=0x7f8c100d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:16.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.216+0000 7f8c14806640 1 --2- 172.21.15.159:0/1948076148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100cee10 0x7f8c100d08a0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f8c08005fd0 tx=0x7f8c0802a4f0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.216+0000 7f8c14806640 1 -- 172.21.15.159:0/1948076148 shutdown_connections 2024-07-24T16:25:16.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.216+0000 7f8c14806640 1 --2- 172.21.15.159:0/1948076148 >> v2:172.21.15.193:3300/0 conn(0x7f8c100707c0 0x7f8c10071590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.216+0000 7f8c14806640 1 --2- 172.21.15.159:0/1948076148 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100cee10 0x7f8c100d08a0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.216+0000 7f8c14806640 1 -- 172.21.15.159:0/1948076148 >> 172.21.15.159:0/1948076148 conn(0x7f8c100b36f0 msgr2=0x7f8c100b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:16.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.216+0000 7f8c14806640 1 -- 172.21.15.159:0/1948076148 shutdown_connections 2024-07-24T16:25:16.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.216+0000 7f8c14806640 1 -- 172.21.15.159:0/1948076148 wait complete. 2024-07-24T16:25:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.217+0000 7f8c14806640 1 Processor -- start 2024-07-24T16:25:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.217+0000 7f8c14806640 1 -- start start 2024-07-24T16:25:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.218+0000 7f8c14806640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100707c0 0x7f8c1013b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.218+0000 7f8c14806640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c100cee10 0x7f8c101f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.218+0000 7f8c14806640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c100cf1f0 0x7f8c101541e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.218+0000 7f8c14806640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8c10071e90 con 0x7f8c100707c0 2024-07-24T16:25:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.218+0000 7f8c14806640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8c10071d10 con 0x7f8c100cf1f0 2024-07-24T16:25:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.218+0000 7f8c14806640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8c1015f860 con 0x7f8c100cee10 2024-07-24T16:25:16.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.218+0000 7f8c0e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100707c0 0x7f8c1013b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:16.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.218+0000 7f8c0e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100707c0 0x7f8c1013b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35492/0 (socket says 172.21.15.159:35492) 2024-07-24T16:25:16.223 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.218+0000 7f8c0e59c640 1 -- 172.21.15.159:0/2439368345 learned_addr learned my addr 172.21.15.159:0/2439368345 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:16.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.218+0000 7f8c0dd9b640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c100cee10 0x7f8c101f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:16.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.218+0000 7f8c0ed9d640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c100cf1f0 0x7f8c101541e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:16.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.219+0000 7f8c0e59c640 1 -- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c100cee10 msgr2=0x7f8c101f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:16.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.219+0000 7f8c0e59c640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c100cee10 0x7f8c101f5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.219+0000 7f8c0e59c640 1 -- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c100cf1f0 msgr2=0x7f8c101541e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:16.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.219+0000 7f8c0e59c640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c100cf1f0 0x7f8c101541e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.219+0000 7f8c0e59c640 1 -- 172.21.15.159:0/2439368345 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c101f5ba0 con 0x7f8c100707c0 2024-07-24T16:25:16.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.219+0000 7f8c0e59c640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100707c0 0x7f8c1013b200 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8c08000c00 tx=0x7f8c08003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:16.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.219+0000 7f8c06ffd640 1 -- 172.21.15.159:0/2439368345 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c0803f070 con 0x7f8c100707c0 2024-07-24T16:25:16.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.219+0000 7f8c06ffd640 1 -- 172.21.15.159:0/2439368345 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c080047a0 con 0x7f8c100707c0 2024-07-24T16:25:16.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.219+0000 7f8c06ffd640 1 -- 172.21.15.159:0/2439368345 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c08035030 con 0x7f8c100707c0 2024-07-24T16:25:16.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.219+0000 7f8c14806640 1 -- 172.21.15.159:0/2439368345 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c101f5e80 con 0x7f8c100707c0 2024-07-24T16:25:16.224 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.219+0000 7f8c14806640 1 -- 172.21.15.159:0/2439368345 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c1013b740 con 0x7f8c100707c0 2024-07-24T16:25:16.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.220+0000 7f8c14806640 1 -- 172.21.15.159:0/2439368345 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c1015fd80 con 0x7f8c100707c0 2024-07-24T16:25:16.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.220+0000 7f8c06ffd640 1 -- 172.21.15.159:0/2439368345 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 9) ==== 99259+0+0 (secure 0 0 0) 0x7f8c08042070 con 0x7f8c100707c0 2024-07-24T16:25:16.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.221+0000 7f8c06ffd640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f8bf0077180 0x7f8bf0079640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:16.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.221+0000 7f8c06ffd640 1 -- 172.21.15.159:0/2439368345 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7f8c080b9f40 con 0x7f8c100707c0 2024-07-24T16:25:16.225 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.221+0000 7f8c0dd9b640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f8bf0077180 0x7f8bf0079640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:16.226 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.222+0000 7f8c0dd9b640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f8bf0077180 0x7f8bf0079640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8c100b4bc0 tx=0x7f8bf800b2e0 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:16.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.225+0000 7f8c06ffd640 1 -- 172.21.15.159:0/2439368345 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f8c080826d0 con 0x7f8c100707c0 2024-07-24T16:25:16.431 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.429+0000 7f8c14806640 1 -- 172.21.15.159:0/2439368345 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir5", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f8c101f6050 con 0x7f8bf0077180 2024-07-24T16:25:16.496 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.493+0000 7f8c06ffd640 1 -- 172.21.15.159:0/2439368345 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f8c101f6050 con 0x7f8bf0077180 2024-07-24T16:25:16.496 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule set for path /snap_test_dir1/dir5 2024-07-24T16:25:16.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.496+0000 7f8c14806640 1 -- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f8bf0077180 msgr2=0x7f8bf0079640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:16.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.496+0000 7f8c14806640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f8bf0077180 0x7f8bf0079640 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8c100b4bc0 tx=0x7f8bf800b2e0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.496+0000 7f8c14806640 1 -- 172.21.15.159:0/2439368345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100707c0 msgr2=0x7f8c1013b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:16.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.496+0000 7f8c14806640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100707c0 0x7f8c1013b200 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f8c08000c00 tx=0x7f8c08003910 comp rx=0 tx=0).stop 2024-07-24T16:25:16.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.496+0000 7f8c14806640 1 -- 172.21.15.159:0/2439368345 shutdown_connections 2024-07-24T16:25:16.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.496+0000 7f8c14806640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f8bf0077180 0x7f8bf0079640 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.496+0000 7f8c14806640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8c100cf1f0 0x7f8c101541e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.496+0000 7f8c14806640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8c100cee10 0x7f8c101f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.496+0000 7f8c14806640 1 --2- 172.21.15.159:0/2439368345 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8c100707c0 0x7f8c1013b200 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.499 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.496+0000 7f8c14806640 1 -- 172.21.15.159:0/2439368345 >> 172.21.15.159:0/2439368345 conn(0x7f8c100b36f0 msgr2=0x7f8c100b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:16.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.496+0000 7f8c14806640 1 -- 172.21.15.159:0/2439368345 shutdown_connections 2024-07-24T16:25:16.500 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.496+0000 7f8c14806640 1 -- 172.21.15.159:0/2439368345 wait complete. 2024-07-24T16:25:16.509 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir5 2024-07-24T16:25:16.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:16.509 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir6) 2024-07-24T16:25:16.526 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir6 1m 2024-07-24T16:25:16.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.669+0000 7f0b0643f640 1 -- 172.21.15.159:0/3222017008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000cf770 msgr2=0x7f0b000cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:16.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.669+0000 7f0b0643f640 1 --2- 172.21.15.159:0/3222017008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000cf770 0x7f0b000cfbc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f0b00161470 tx=0x7f0af802ab40 comp rx=0 tx=0).stop 2024-07-24T16:25:16.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.669+0000 7f0b0643f640 1 -- 172.21.15.159:0/3222017008 shutdown_connections 2024-07-24T16:25:16.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.669+0000 7f0b0643f640 1 --2- 172.21.15.159:0/3222017008 >> v2:172.21.15.193:3300/0 conn(0x7f0b000b2ae0 0x7f0b00161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.669+0000 7f0b0643f640 1 --2- 172.21.15.159:0/3222017008 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000cf770 0x7f0b000cfbc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.669+0000 7f0b0643f640 1 -- 172.21.15.159:0/3222017008 >> 172.21.15.159:0/3222017008 conn(0x7f0b0009cd30 msgr2=0x7f0b000d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:16.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.669+0000 7f0b0643f640 1 -- 172.21.15.159:0/3222017008 shutdown_connections 2024-07-24T16:25:16.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.669+0000 7f0b0643f640 1 -- 172.21.15.159:0/3222017008 wait complete. 2024-07-24T16:25:16.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.671+0000 7f0b0643f640 1 Processor -- start 2024-07-24T16:25:16.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.671+0000 7f0b0643f640 1 -- start start 2024-07-24T16:25:16.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.671+0000 7f0b0643f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000b2ae0 0x7f0b0015f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:16.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.671+0000 7f0b0643f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b000cf770 0x7f0b0014f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:16.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0b0643f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b0015d950 0x7f0b001f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:16.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0b0643f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0b000ce470 con 0x7f0b000b2ae0 2024-07-24T16:25:16.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0b0643f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0b000ce2f0 con 0x7f0b0015d950 2024-07-24T16:25:16.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0b0643f640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0b000d02e0 con 0x7f0b000cf770 2024-07-24T16:25:16.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0afffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000b2ae0 0x7f0b0015f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:16.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0afffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000b2ae0 0x7f0b0015f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35520/0 (socket says 172.21.15.159:35520) 2024-07-24T16:25:16.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0afffff640 1 -- 172.21.15.159:0/2396836963 learned_addr learned my addr 172.21.15.159:0/2396836963 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:16.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0b049dc640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b0015d950 0x7f0b001f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:16.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0aff7fe640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b000cf770 0x7f0b0014f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:16.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0afffff640 1 -- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b000cf770 msgr2=0x7f0b0014f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:16.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0afffff640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b000cf770 0x7f0b0014f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0afffff640 1 -- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b0015d950 msgr2=0x7f0b001f4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:16.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0afffff640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b0015d950 0x7f0b001f4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0afffff640 1 -- 172.21.15.159:0/2396836963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b001f5090 con 0x7f0b000b2ae0 2024-07-24T16:25:16.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0afffff640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000b2ae0 0x7f0b0015f380 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0af000c3a0 tx=0x7f0af000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:16.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0afcff9640 1 -- 172.21.15.159:0/2396836963 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0017070 con 0x7f0b000b2ae0 2024-07-24T16:25:16.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0afcff9640 1 -- 172.21.15.159:0/2396836963 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0af00053c0 con 0x7f0b000b2ae0 2024-07-24T16:25:16.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0afcff9640 1 -- 172.21.15.159:0/2396836963 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af0003850 con 0x7f0b000b2ae0 2024-07-24T16:25:16.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0b0643f640 1 -- 172.21.15.159:0/2396836963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b0015e2e0 con 0x7f0b000b2ae0 2024-07-24T16:25:16.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.672+0000 7f0b0643f640 1 -- 172.21.15.159:0/2396836963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b0015e8a0 con 0x7f0b000b2ae0 2024-07-24T16:25:16.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.673+0000 7f0b0643f640 1 -- 172.21.15.159:0/2396836963 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b00161f20 con 0x7f0b000b2ae0 2024-07-24T16:25:16.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.674+0000 7f0afcff9640 1 -- 172.21.15.159:0/2396836963 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 9) ==== 99259+0+0 (secure 0 0 0) 0x7f0af001a070 con 0x7f0b000b2ae0 2024-07-24T16:25:16.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.674+0000 7f0afcff9640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0ae0077180 0x7f0ae0079640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:16.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.674+0000 7f0afcff9640 1 -- 172.21.15.159:0/2396836963 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7f0af0098040 con 0x7f0b000b2ae0 2024-07-24T16:25:16.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.675+0000 7f0aff7fe640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0ae0077180 0x7f0ae0079640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:16.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.675+0000 7f0aff7fe640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0ae0077180 0x7f0ae0079640 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0b000b0b70 tx=0x7f0ae8005f90 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:16.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.678+0000 7f0afcff9640 1 -- 172.21.15.159:0/2396836963 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f0b001f5090 con 0x7f0b000b2ae0 2024-07-24T16:25:16.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.882+0000 7f0b0643f640 1 -- 172.21.15.159:0/2396836963 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir6", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f0b0015f8c0 con 0x7f0ae0077180 2024-07-24T16:25:16.951 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.949+0000 7f0afcff9640 1 -- 172.21.15.159:0/2396836963 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f0ae801b3f0 con 0x7f0ae0077180 2024-07-24T16:25:16.952 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule set for path /snap_test_dir1/dir6 2024-07-24T16:25:16.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.951+0000 7f0b0643f640 1 -- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0ae0077180 msgr2=0x7f0ae0079640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:16.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.951+0000 7f0b0643f640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0ae0077180 0x7f0ae0079640 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0b000b0b70 tx=0x7f0ae8005f90 comp rx=0 tx=0).stop 2024-07-24T16:25:16.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.951+0000 7f0b0643f640 1 -- 172.21.15.159:0/2396836963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000b2ae0 msgr2=0x7f0b0015f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:16.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.951+0000 7f0b0643f640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000b2ae0 0x7f0b0015f380 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f0af000c3a0 tx=0x7f0af000c860 comp rx=0 tx=0).stop 2024-07-24T16:25:16.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.951+0000 7f0b0643f640 1 -- 172.21.15.159:0/2396836963 shutdown_connections 2024-07-24T16:25:16.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.951+0000 7f0b0643f640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0ae0077180 0x7f0ae0079640 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.951+0000 7f0b0643f640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0b0015d950 0x7f0b001f4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.951+0000 7f0b0643f640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b000cf770 0x7f0b0014f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.951+0000 7f0b0643f640 1 --2- 172.21.15.159:0/2396836963 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b000b2ae0 0x7f0b0015f380 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:16.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.951+0000 7f0b0643f640 1 -- 172.21.15.159:0/2396836963 >> 172.21.15.159:0/2396836963 conn(0x7f0b0009cd30 msgr2=0x7f0b000b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:16.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.951+0000 7f0b0643f640 1 -- 172.21.15.159:0/2396836963 shutdown_connections 2024-07-24T16:25:16.955 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:16.951+0000 7f0b0643f640 1 -- 172.21.15.159:0/2396836963 wait complete. 2024-07-24T16:25:16.965 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir6 2024-07-24T16:25:16.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:16.965 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir7) 2024-07-24T16:25:16.982 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir7 1m 2024-07-24T16:25:17.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.130+0000 7f66e5265640 1 -- 172.21.15.159:0/3925536234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66e0161370 msgr2=0x7f66e006ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:17.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.130+0000 7f66e5265640 1 --2- 172.21.15.159:0/3925536234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66e0161370 0x7f66e006ccb0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f66d8009830 tx=0x7f66d802a5a0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.130+0000 7f66e5265640 1 -- 172.21.15.159:0/3925536234 shutdown_connections 2024-07-24T16:25:17.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.130+0000 7f66e5265640 1 --2- 172.21.15.159:0/3925536234 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f66e006d670 0x7f66e006c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.130+0000 7f66e5265640 1 --2- 172.21.15.159:0/3925536234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66e0161370 0x7f66e006ccb0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.130+0000 7f66e5265640 1 -- 172.21.15.159:0/3925536234 >> 172.21.15.159:0/3925536234 conn(0x7f66e00b5780 msgr2=0x7f66e00b5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:17.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.130+0000 7f66e5265640 1 -- 172.21.15.159:0/3925536234 shutdown_connections 2024-07-24T16:25:17.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.130+0000 7f66e5265640 1 -- 172.21.15.159:0/3925536234 wait complete. 2024-07-24T16:25:17.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.131+0000 7f66e5265640 1 Processor -- start 2024-07-24T16:25:17.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.131+0000 7f66e5265640 1 -- start start 2024-07-24T16:25:17.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.132+0000 7f66e5265640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66e006d670 0x7f66e00cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:17.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.132+0000 7f66e5265640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f66e015d870 0x7f66e015f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:17.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.132+0000 7f66e5265640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66e0161370 0x7f66e00cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:17.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.132+0000 7f66e5265640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f66e00d29e0 con 0x7f66e006d670 2024-07-24T16:25:17.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.132+0000 7f66e5265640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f66e00d2860 con 0x7f66e0161370 2024-07-24T16:25:17.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.132+0000 7f66e5265640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f66e00d2b60 con 0x7f66e015d870 2024-07-24T16:25:17.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.132+0000 7f66deffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66e006d670 0x7f66e00cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:17.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.132+0000 7f66deffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66e006d670 0x7f66e00cd6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35530/0 (socket says 172.21.15.159:35530) 2024-07-24T16:25:17.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.132+0000 7f66deffd640 1 -- 172.21.15.159:0/1793159101 learned_addr learned my addr 172.21.15.159:0/1793159101 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:17.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.132+0000 7f66deffd640 1 -- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f66e015d870 msgr2=0x7f66e015f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:17.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.132+0000 7f66deffd640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f66e015d870 0x7f66e015f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.132+0000 7f66df7fe640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66e0161370 0x7f66e00cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:17.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.132+0000 7f66deffd640 1 -- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66e0161370 msgr2=0x7f66e00cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:17.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.133+0000 7f66deffd640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66e0161370 0x7f66e00cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.133+0000 7f66deffd640 1 -- 172.21.15.159:0/1793159101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e01f4970 con 0x7f66e006d670 2024-07-24T16:25:17.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.133+0000 7f66df7fe640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66e0161370 0x7f66e00cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:25:17.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.133+0000 7f66deffd640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66e006d670 0x7f66e00cd6e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f66d000cbe0 tx=0x7f66d000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:17.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.133+0000 7f66d77fe640 1 -- 172.21.15.159:0/1793159101 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0016020 con 0x7f66e006d670 2024-07-24T16:25:17.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.133+0000 7f66d77fe640 1 -- 172.21.15.159:0/1793159101 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66d000adf0 con 0x7f66e006d670 2024-07-24T16:25:17.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.133+0000 7f66e5265640 1 -- 172.21.15.159:0/1793159101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66e01f4c50 con 0x7f66e006d670 2024-07-24T16:25:17.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.133+0000 7f66d77fe640 1 -- 172.21.15.159:0/1793159101 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66d0012660 con 0x7f66e006d670 2024-07-24T16:25:17.137 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.133+0000 7f66e5265640 1 -- 172.21.15.159:0/1793159101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66e01f5210 con 0x7f66e006d670 2024-07-24T16:25:17.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.134+0000 7f66e5265640 1 -- 172.21.15.159:0/1793159101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66e00641a0 con 0x7f66e006d670 2024-07-24T16:25:17.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.135+0000 7f66d77fe640 1 -- 172.21.15.159:0/1793159101 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 10) ==== 99315+0+0 (secure 0 0 0) 0x7f66d0019020 con 0x7f66e006d670 2024-07-24T16:25:17.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.135+0000 7f66d77fe640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f66c0077210 0x7f66c00796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:17.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.135+0000 7f66d77fe640 1 -- 172.21.15.159:0/1793159101 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7f66d0099560 con 0x7f66e006d670 2024-07-24T16:25:17.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.135+0000 7f66de7fc640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f66c0077210 0x7f66c00796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:17.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.136+0000 7f66de7fc640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f66c0077210 0x7f66c00796d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f66c8005fd0 tx=0x7f66c800b410 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:17.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.139+0000 7f66d77fe640 1 -- 172.21.15.159:0/1793159101 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f66e00641a0 con 0x7f66e006d670 2024-07-24T16:25:17.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.343+0000 7f66e5265640 1 -- 172.21.15.159:0/1793159101 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir7", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f66e00d2ff0 con 0x7f66c0077210 2024-07-24T16:25:17.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.418+0000 7f66d77fe640 1 -- 172.21.15.159:0/1793159101 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f66e00d2ff0 con 0x7f66c0077210 2024-07-24T16:25:17.421 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule set for path /snap_test_dir1/dir7 2024-07-24T16:25:17.423 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.421+0000 7f66e5265640 1 -- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f66c0077210 msgr2=0x7f66c00796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:17.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.421+0000 7f66e5265640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f66c0077210 0x7f66c00796d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f66c8005fd0 tx=0x7f66c800b410 comp rx=0 tx=0).stop 2024-07-24T16:25:17.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.421+0000 7f66e5265640 1 -- 172.21.15.159:0/1793159101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66e006d670 msgr2=0x7f66e00cd6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:17.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.421+0000 7f66e5265640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66e006d670 0x7f66e00cd6e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f66d000cbe0 tx=0x7f66d000a430 comp rx=0 tx=0).stop 2024-07-24T16:25:17.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.421+0000 7f66e5265640 1 -- 172.21.15.159:0/1793159101 shutdown_connections 2024-07-24T16:25:17.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.421+0000 7f66e5265640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f66c0077210 0x7f66c00796d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.421+0000 7f66e5265640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f66e0161370 0x7f66e00cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.421+0000 7f66e5265640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f66e015d870 0x7f66e015f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.421+0000 7f66e5265640 1 --2- 172.21.15.159:0/1793159101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f66e006d670 0x7f66e00cd6e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.421+0000 7f66e5265640 1 -- 172.21.15.159:0/1793159101 >> 172.21.15.159:0/1793159101 conn(0x7f66e00b5780 msgr2=0x7f66e01617a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:17.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.421+0000 7f66e5265640 1 -- 172.21.15.159:0/1793159101 shutdown_connections 2024-07-24T16:25:17.424 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.421+0000 7f66e5265640 1 -- 172.21.15.159:0/1793159101 wait complete. 2024-07-24T16:25:17.434 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir7 2024-07-24T16:25:17.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:17.434 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir8) 2024-07-24T16:25:17.451 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir8 1m 2024-07-24T16:25:17.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.594+0000 7fa9581e8640 1 -- 172.21.15.159:0/4031523828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa950158fe0 msgr2=0x7fa95006f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:17.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.594+0000 7fa9581e8640 1 --2- 172.21.15.159:0/4031523828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa950158fe0 0x7fa95006f890 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fa9500730a0 tx=0x7fa94c02aa30 comp rx=0 tx=0).stop 2024-07-24T16:25:17.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.594+0000 7fa9581e8640 1 -- 172.21.15.159:0/4031523828 shutdown_connections 2024-07-24T16:25:17.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.594+0000 7fa9581e8640 1 --2- 172.21.15.159:0/4031523828 >> v2:172.21.15.193:3300/0 conn(0x7fa9500cf860 0x7fa95015bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.594+0000 7fa9581e8640 1 --2- 172.21.15.159:0/4031523828 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa95006d670 0x7fa9500cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.594+0000 7fa9581e8640 1 --2- 172.21.15.159:0/4031523828 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa950158fe0 0x7fa95006f890 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.594+0000 7fa9581e8640 1 -- 172.21.15.159:0/4031523828 >> 172.21.15.159:0/4031523828 conn(0x7fa95006c560 msgr2=0x7fa95006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:17.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.594+0000 7fa9581e8640 1 -- 172.21.15.159:0/4031523828 shutdown_connections 2024-07-24T16:25:17.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.594+0000 7fa9581e8640 1 -- 172.21.15.159:0/4031523828 wait complete. 2024-07-24T16:25:17.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.595+0000 7fa9581e8640 1 Processor -- start 2024-07-24T16:25:17.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.595+0000 7fa9581e8640 1 -- start start 2024-07-24T16:25:17.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa9581e8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa95006d670 0x7fa9500aff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:17.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa9581e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9500cf860 0x7fa9500b1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:17.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa9581e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa950158fe0 0x7fa950152f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:17.604 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa9581e8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa9501593c0 con 0x7fa9500cf860 2024-07-24T16:25:17.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa9581e8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa95006dc20 con 0x7fa950158fe0 2024-07-24T16:25:17.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa9581e8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa950159540 con 0x7fa95006d670 2024-07-24T16:25:17.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa955783640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9500cf860 0x7fa9500b1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:17.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa955783640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9500cf860 0x7fa9500b1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35560/0 (socket says 172.21.15.159:35560) 2024-07-24T16:25:17.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa955783640 1 -- 172.21.15.159:0/3562275708 learned_addr learned my addr 172.21.15.159:0/3562275708 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:17.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa956785640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa950158fe0 0x7fa950152f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:17.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa955f84640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa95006d670 0x7fa9500aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:17.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa955783640 1 -- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa95006d670 msgr2=0x7fa9500aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:17.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa955783640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa95006d670 0x7fa9500aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa955783640 1 -- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa950158fe0 msgr2=0x7fa950152f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:17.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa955783640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa950158fe0 0x7fa950152f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa955783640 1 -- 172.21.15.159:0/3562275708 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9501f2cc0 con 0x7fa9500cf860 2024-07-24T16:25:17.605 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.596+0000 7fa955783640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9500cf860 0x7fa9500b1b10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa94000d750 tx=0x7fa94000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:17.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.597+0000 7fa9467fc640 1 -- 172.21.15.159:0/3562275708 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa940017070 con 0x7fa9500cf860 2024-07-24T16:25:17.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.597+0000 7fa9467fc640 1 -- 172.21.15.159:0/3562275708 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa940009d20 con 0x7fa9500cf860 2024-07-24T16:25:17.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.597+0000 7fa9581e8640 1 -- 172.21.15.159:0/3562275708 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9501513d0 con 0x7fa9500cf860 2024-07-24T16:25:17.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.597+0000 7fa9467fc640 1 -- 172.21.15.159:0/3562275708 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9400106c0 con 0x7fa9500cf860 2024-07-24T16:25:17.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.597+0000 7fa9581e8640 1 -- 172.21.15.159:0/3562275708 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9501f29e0 con 0x7fa9500cf860 2024-07-24T16:25:17.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.598+0000 7fa9581e8640 1 -- 172.21.15.159:0/3562275708 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa950159f50 con 0x7fa9500cf860 2024-07-24T16:25:17.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.598+0000 7fa9467fc640 1 -- 172.21.15.159:0/3562275708 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 10) ==== 99315+0+0 (secure 0 0 0) 0x7fa94001a070 con 0x7fa9500cf860 2024-07-24T16:25:17.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.599+0000 7fa9467fc640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa934077210 0x7fa9340796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:17.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.599+0000 7fa9467fc640 1 -- 172.21.15.159:0/3562275708 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7fa940098f70 con 0x7fa9500cf860 2024-07-24T16:25:17.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.599+0000 7fa955f84640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa934077210 0x7fa9340796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:17.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.600+0000 7fa955f84640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa934077210 0x7fa9340796d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa94c035000 tx=0x7fa94c03b040 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:17.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.603+0000 7fa9467fc640 1 -- 172.21.15.159:0/3562275708 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa94000de60 con 0x7fa9500cf860 2024-07-24T16:25:17.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.805+0000 7fa9581e8640 1 -- 172.21.15.159:0/3562275708 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir8", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa9501f2720 con 0x7fa934077210 2024-07-24T16:25:17.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.859+0000 7fa9467fc640 1 -- 172.21.15.159:0/3562275708 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fa9501f2720 con 0x7fa934077210 2024-07-24T16:25:17.862 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule set for path /snap_test_dir1/dir8 2024-07-24T16:25:17.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.861+0000 7fa9581e8640 1 -- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa934077210 msgr2=0x7fa9340796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:17.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.861+0000 7fa9581e8640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa934077210 0x7fa9340796d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa94c035000 tx=0x7fa94c03b040 comp rx=0 tx=0).stop 2024-07-24T16:25:17.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.861+0000 7fa9581e8640 1 -- 172.21.15.159:0/3562275708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9500cf860 msgr2=0x7fa9500b1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:17.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.861+0000 7fa9581e8640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9500cf860 0x7fa9500b1b10 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fa94000d750 tx=0x7fa94000dc10 comp rx=0 tx=0).stop 2024-07-24T16:25:17.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.861+0000 7fa9581e8640 1 -- 172.21.15.159:0/3562275708 shutdown_connections 2024-07-24T16:25:17.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.861+0000 7fa9581e8640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa934077210 0x7fa9340796d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.861+0000 7fa9581e8640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa950158fe0 0x7fa950152f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.861+0000 7fa9581e8640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9500cf860 0x7fa9500b1b10 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.861+0000 7fa9581e8640 1 --2- 172.21.15.159:0/3562275708 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa95006d670 0x7fa9500aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:17.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.861+0000 7fa9581e8640 1 -- 172.21.15.159:0/3562275708 >> 172.21.15.159:0/3562275708 conn(0x7fa95006c560 msgr2=0x7fa950159760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:17.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.861+0000 7fa9581e8640 1 -- 172.21.15.159:0/3562275708 shutdown_connections 2024-07-24T16:25:17.865 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:17.861+0000 7fa9581e8640 1 -- 172.21.15.159:0/3562275708 wait complete. 2024-07-24T16:25:17.875 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir8 2024-07-24T16:25:17.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:25:17.875 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir -p snap_test_dir1/dir9) 2024-07-24T16:25:17.891 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule add /snap_test_dir1/dir9 1m 2024-07-24T16:25:18.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.034+0000 7f4f6aca9640 1 -- 172.21.15.159:0/2113287841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f64071ca0 msgr2=0x7f4f641662d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:18.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.034+0000 7f4f6aca9640 1 --2- 172.21.15.159:0/2113287841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f64071ca0 0x7f4f641662d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c005fd0 tx=0x7f4f5c02a820 comp rx=0 tx=0).stop 2024-07-24T16:25:18.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.034+0000 7f4f6aca9640 1 -- 172.21.15.159:0/2113287841 shutdown_connections 2024-07-24T16:25:18.037 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.034+0000 7f4f6aca9640 1 --2- 172.21.15.159:0/2113287841 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f64071ca0 0x7f4f641662d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.034+0000 7f4f6aca9640 1 -- 172.21.15.159:0/2113287841 >> 172.21.15.159:0/2113287841 conn(0x7f4f640b36f0 msgr2=0x7f4f640b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:18.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.035+0000 7f4f6aca9640 1 -- 172.21.15.159:0/2113287841 shutdown_connections 2024-07-24T16:25:18.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.035+0000 7f4f6aca9640 1 -- 172.21.15.159:0/2113287841 wait complete. 2024-07-24T16:25:18.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.036+0000 7f4f6aca9640 1 Processor -- start 2024-07-24T16:25:18.038 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.036+0000 7f4f6aca9640 1 -- start start 2024-07-24T16:25:18.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f6aca9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f640707c0 0x7f4f6406e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:18.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f6aca9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f64071ca0 0x7f4f64147cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:18.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f6aca9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4f640cee10 0x7f4f641543f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:18.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f6aca9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4f64166a20 con 0x7f4f64071ca0 2024-07-24T16:25:18.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f6aca9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4f640cf4a0 con 0x7f4f640707c0 2024-07-24T16:25:18.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f6aca9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4f64166ba0 con 0x7f4f640cee10 2024-07-24T16:25:18.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f5bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f64071ca0 0x7f4f64147cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:18.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f5bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f64071ca0 0x7f4f64147cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35584/0 (socket says 172.21.15.159:35584) 2024-07-24T16:25:18.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f5bfff640 1 -- 172.21.15.159:0/931144468 learned_addr learned my addr 172.21.15.159:0/931144468 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:18.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f68a45640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f640707c0 0x7f4f6406e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:18.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f69246640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4f640cee10 0x7f4f641543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:18.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f5bfff640 1 -- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4f640cee10 msgr2=0x7f4f641543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:18.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f5bfff640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4f640cee10 0x7f4f641543f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f5bfff640 1 -- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f640707c0 msgr2=0x7f4f6406e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:18.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f5bfff640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f640707c0 0x7f4f6406e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f5bfff640 1 -- 172.21.15.159:0/931144468 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6406ed00 con 0x7f4f64071ca0 2024-07-24T16:25:18.041 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f5bfff640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f64071ca0 0x7f4f64147cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400b3f0 tx=0x7f4f5400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:18.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f597fa640 1 -- 172.21.15.159:0/931144468 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54015020 con 0x7f4f64071ca0 2024-07-24T16:25:18.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f597fa640 1 -- 172.21.15.159:0/931144468 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f54011920 con 0x7f4f64071ca0 2024-07-24T16:25:18.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f597fa640 1 -- 172.21.15.159:0/931144468 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54011d70 con 0x7f4f64071ca0 2024-07-24T16:25:18.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.037+0000 7f4f6aca9640 1 -- 172.21.15.159:0/931144468 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6406efe0 con 0x7f4f64071ca0 2024-07-24T16:25:18.042 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.038+0000 7f4f6aca9640 1 -- 172.21.15.159:0/931144468 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f641f7da0 con 0x7f4f64071ca0 2024-07-24T16:25:18.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.038+0000 7f4f6aca9640 1 -- 172.21.15.159:0/931144468 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f64071590 con 0x7f4f64071ca0 2024-07-24T16:25:18.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.039+0000 7f4f597fa640 1 -- 172.21.15.159:0/931144468 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 10) ==== 99315+0+0 (secure 0 0 0) 0x7f4f54018020 con 0x7f4f64071ca0 2024-07-24T16:25:18.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.039+0000 7f4f597fa640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f4f50077210 0x7f4f500796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:18.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.039+0000 7f4f597fa640 1 -- 172.21.15.159:0/931144468 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7f4f54098990 con 0x7f4f64071ca0 2024-07-24T16:25:18.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.040+0000 7f4f68a45640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f4f50077210 0x7f4f500796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:18.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.040+0000 7f4f68a45640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f4f50077210 0x7f4f500796d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4f600017c0 tx=0x7f4f60007e90 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:18.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.043+0000 7f4f597fa640 1 -- 172.21.15.159:0/931144468 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f4f5401f030 con 0x7f4f64071ca0 2024-07-24T16:25:18.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.246+0000 7f4f6aca9640 1 -- 172.21.15.159:0/931144468 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "path": "/snap_test_dir1/dir9", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f4f6406ea60 con 0x7f4f50077210 2024-07-24T16:25:18.312 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.310+0000 7f4f597fa640 1 -- 172.21.15.159:0/931144468 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f4f6406ea60 con 0x7f4f50077210 2024-07-24T16:25:18.312 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule set for path /snap_test_dir1/dir9 2024-07-24T16:25:18.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.312+0000 7f4f6aca9640 1 -- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f4f50077210 msgr2=0x7f4f500796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:18.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.312+0000 7f4f6aca9640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f4f50077210 0x7f4f500796d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f4f600017c0 tx=0x7f4f60007e90 comp rx=0 tx=0).stop 2024-07-24T16:25:18.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.312+0000 7f4f6aca9640 1 -- 172.21.15.159:0/931144468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f64071ca0 msgr2=0x7f4f64147cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:18.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.312+0000 7f4f6aca9640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f64071ca0 0x7f4f64147cf0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400b3f0 tx=0x7f4f5400b8b0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.312+0000 7f4f6aca9640 1 -- 172.21.15.159:0/931144468 shutdown_connections 2024-07-24T16:25:18.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.312+0000 7f4f6aca9640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f4f50077210 0x7f4f500796d0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.312+0000 7f4f6aca9640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4f640cee10 0x7f4f641543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.312+0000 7f4f6aca9640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4f64071ca0 0x7f4f64147cf0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.312+0000 7f4f6aca9640 1 --2- 172.21.15.159:0/931144468 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4f640707c0 0x7f4f6406e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.312+0000 7f4f6aca9640 1 -- 172.21.15.159:0/931144468 >> 172.21.15.159:0/931144468 conn(0x7f4f640b36f0 msgr2=0x7f4f6415ba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:18.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.312+0000 7f4f6aca9640 1 -- 172.21.15.159:0/931144468 shutdown_connections 2024-07-24T16:25:18.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.312+0000 7f4f6aca9640 1 -- 172.21.15.159:0/931144468 wait complete. 2024-07-24T16:25:18.325 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule set for path /snap_test_dir1/dir9 2024-07-24T16:25:18.326 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir0 1m 2024-07-24T16:25:18.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.429+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2521120907 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa9cc15b4d0 msgr2=0x7fa9cc070750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:18.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.429+0000 7fa9d3f6f640 1 --2- 172.21.15.159:0/2521120907 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa9cc15b4d0 0x7fa9cc070750 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc005fd0 tx=0x7fa9bc02a940 comp rx=0 tx=0).stop 2024-07-24T16:25:18.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.430+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2521120907 shutdown_connections 2024-07-24T16:25:18.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.430+0000 7fa9d3f6f640 1 --2- 172.21.15.159:0/2521120907 >> v2:172.21.15.193:3300/0 conn(0x7fa9cc15f9a0 0x7fa9cc0ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.430+0000 7fa9d3f6f640 1 --2- 172.21.15.159:0/2521120907 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa9cc15b4d0 0x7fa9cc070750 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.430+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2521120907 >> 172.21.15.159:0/2521120907 conn(0x7fa9cc09aa20 msgr2=0x7fa9cc0d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:18.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.430+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2521120907 shutdown_connections 2024-07-24T16:25:18.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.430+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2521120907 wait complete. 2024-07-24T16:25:18.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.431+0000 7fa9d3f6f640 1 Processor -- start 2024-07-24T16:25:18.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.431+0000 7fa9d3f6f640 1 -- start start 2024-07-24T16:25:18.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d3f6f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa9cc09af50 0x7fa9cc0c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:18.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d3f6f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9cc15b4d0 0x7fa9cc1f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:18.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d3f6f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9cc15f9a0 0x7fa9cc0ca260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:18.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d3f6f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc0af000 con 0x7fa9cc15f9a0 2024-07-24T16:25:18.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d3f6f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa9cc0aee80 con 0x7fa9cc15b4d0 2024-07-24T16:25:18.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d3f6f640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa9cc0af180 con 0x7fa9cc09af50 2024-07-24T16:25:18.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d150a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9cc15b4d0 0x7fa9cc1f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:18.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d250c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9cc15f9a0 0x7fa9cc0ca260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:18.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d1d0b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa9cc09af50 0x7fa9cc0c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:18.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d150a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9cc15b4d0 0x7fa9cc1f8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.193:3300/0 says I am v2:172.21.15.159:58692/0 (socket says 172.21.15.159:58692) 2024-07-24T16:25:18.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d150a640 1 -- 172.21.15.159:0/2012475971 learned_addr learned my addr 172.21.15.159:0/2012475971 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:18.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d250c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9cc15f9a0 0x7fa9cc0ca260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35594/0 (socket says 172.21.15.159:35594) 2024-07-24T16:25:18.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d150a640 1 -- 172.21.15.159:0/2012475971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa9cc09af50 msgr2=0x7fa9cc0c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:18.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d150a640 1 --2- 172.21.15.159:0/2012475971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa9cc09af50 0x7fa9cc0c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d150a640 1 -- 172.21.15.159:0/2012475971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9cc15f9a0 msgr2=0x7fa9cc0ca260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:18.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d150a640 1 --2- 172.21.15.159:0/2012475971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9cc15f9a0 0x7fa9cc0ca260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d150a640 1 -- 172.21.15.159:0/2012475971 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9cc148c50 con 0x7fa9cc15b4d0 2024-07-24T16:25:18.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d150a640 1 --2- 172.21.15.159:0/2012475971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9cc15b4d0 0x7fa9cc1f8330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000c3f0 tx=0x7fa9c000c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:18.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9ca7fc640 1 -- 172.21.15.159:0/2012475971 <== mon.1 v2:172.21.15.193:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0017070 con 0x7fa9cc15b4d0 2024-07-24T16:25:18.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9ca7fc640 1 -- 172.21.15.159:0/2012475971 <== mon.1 v2:172.21.15.193:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9c00053c0 con 0x7fa9cc15b4d0 2024-07-24T16:25:18.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2012475971 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9cc148f30 con 0x7fa9cc15b4d0 2024-07-24T16:25:18.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9ca7fc640 1 -- 172.21.15.159:0/2012475971 <== mon.1 v2:172.21.15.193:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9c0003850 con 0x7fa9cc15b4d0 2024-07-24T16:25:18.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.432+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2012475971 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9cc1494f0 con 0x7fa9cc15b4d0 2024-07-24T16:25:18.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.433+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2012475971 --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9cc06fb20 con 0x7fa9cc15b4d0 2024-07-24T16:25:18.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.434+0000 7fa9ca7fc640 1 -- 172.21.15.159:0/2012475971 <== mon.1 v2:172.21.15.193:3300/0 4 ==== mgrmap(e 10) ==== 99315+0+0 (secure 0 0 0) 0x7fa9c001a070 con 0x7fa9cc15b4d0 2024-07-24T16:25:18.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.434+0000 7fa9ca7fc640 1 --2- 172.21.15.159:0/2012475971 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa9b8077210 0x7fa9b80796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:18.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.435+0000 7fa9ca7fc640 1 -- 172.21.15.159:0/2012475971 <== mon.1 v2:172.21.15.193:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7fa9c0098200 con 0x7fa9cc15b4d0 2024-07-24T16:25:18.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.435+0000 7fa9d1d0b640 1 --2- 172.21.15.159:0/2012475971 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa9b8077210 0x7fa9b80796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:18.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.435+0000 7fa9d1d0b640 1 --2- 172.21.15.159:0/2012475971 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa9b8077210 0x7fa9b80796d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc034000 tx=0x7fa9bc004ab0 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:18.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.439+0000 7fa9ca7fc640 1 -- 172.21.15.159:0/2012475971 <== mon.1 v2:172.21.15.193:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa9cc06fb20 con 0x7fa9cc15b4d0 2024-07-24T16:25:18.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.645+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2012475971 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir0", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa9cc070750 con 0x7fa9b8077210 2024-07-24T16:25:18.698 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.695+0000 7fa9ca7fc640 1 -- 172.21.15.159:0/2012475971 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fa9cc070750 con 0x7fa9b8077210 2024-07-24T16:25:18.698 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule activated for path /snap_test_dir1/dir0 2024-07-24T16:25:18.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.697+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2012475971 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa9b8077210 msgr2=0x7fa9b80796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:18.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.697+0000 7fa9d3f6f640 1 --2- 172.21.15.159:0/2012475971 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa9b8077210 0x7fa9b80796d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa9bc034000 tx=0x7fa9bc004ab0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.697+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2012475971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9cc15b4d0 msgr2=0x7fa9cc1f8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:18.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.697+0000 7fa9d3f6f640 1 --2- 172.21.15.159:0/2012475971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9cc15b4d0 0x7fa9cc1f8330 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa9c000c3f0 tx=0x7fa9c000c8b0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.697+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2012475971 shutdown_connections 2024-07-24T16:25:18.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.697+0000 7fa9d3f6f640 1 --2- 172.21.15.159:0/2012475971 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa9b8077210 0x7fa9b80796d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.697+0000 7fa9d3f6f640 1 --2- 172.21.15.159:0/2012475971 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9cc15f9a0 0x7fa9cc0ca260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.698+0000 7fa9d3f6f640 1 --2- 172.21.15.159:0/2012475971 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9cc15b4d0 0x7fa9cc1f8330 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.698+0000 7fa9d3f6f640 1 --2- 172.21.15.159:0/2012475971 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa9cc09af50 0x7fa9cc0c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.698+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2012475971 >> 172.21.15.159:0/2012475971 conn(0x7fa9cc09aa20 msgr2=0x7fa9cc15e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:18.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.698+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2012475971 shutdown_connections 2024-07-24T16:25:18.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.698+0000 7fa9d3f6f640 1 -- 172.21.15.159:0/2012475971 wait complete. 2024-07-24T16:25:18.710 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir0 2024-07-24T16:25:18.711 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir1 1m 2024-07-24T16:25:18.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.813+0000 7fab91abe640 1 -- 172.21.15.159:0/4162138479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab8c15d950 msgr2=0x7fab8c161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:18.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.813+0000 7fab91abe640 1 --2- 172.21.15.159:0/4162138479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab8c15d950 0x7fab8c161f20 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fab8c161470 tx=0x7fab7c02a5d0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.813+0000 7fab91abe640 1 -- 172.21.15.159:0/4162138479 shutdown_connections 2024-07-24T16:25:18.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.813+0000 7fab91abe640 1 --2- 172.21.15.159:0/4162138479 >> v2:172.21.15.193:3300/0 conn(0x7fab8c0b2ae0 0x7fab8c0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.813+0000 7fab91abe640 1 --2- 172.21.15.159:0/4162138479 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab8c15d950 0x7fab8c161f20 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.813+0000 7fab91abe640 1 -- 172.21.15.159:0/4162138479 >> 172.21.15.159:0/4162138479 conn(0x7fab8c09cd30 msgr2=0x7fab8c0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:18.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.813+0000 7fab91abe640 1 -- 172.21.15.159:0/4162138479 shutdown_connections 2024-07-24T16:25:18.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.813+0000 7fab91abe640 1 -- 172.21.15.159:0/4162138479 wait complete. 2024-07-24T16:25:18.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.814+0000 7fab91abe640 1 Processor -- start 2024-07-24T16:25:18.817 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.815+0000 7fab91abe640 1 -- start start 2024-07-24T16:25:18.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.815+0000 7fab91abe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab8c0b0b60 0x7fab8c1f4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:18.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.815+0000 7fab91abe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fab8c0b2ae0 0x7fab8c1f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:18.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.815+0000 7fab91abe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab8c15d950 0x7fab8c06e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:18.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.815+0000 7fab91abe640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c0d02e0 con 0x7fab8c0b0b60 2024-07-24T16:25:18.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.815+0000 7fab91abe640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fab8c0d0090 con 0x7fab8c15d950 2024-07-24T16:25:18.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.815+0000 7fab91abe640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fab8c0d0460 con 0x7fab8c0b2ae0 2024-07-24T16:25:18.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.815+0000 7fab8b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab8c0b0b60 0x7fab8c1f4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:18.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab8b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab8c0b0b60 0x7fab8c1f4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35606/0 (socket says 172.21.15.159:35606) 2024-07-24T16:25:18.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab8b7fe640 1 -- 172.21.15.159:0/3055266333 learned_addr learned my addr 172.21.15.159:0/3055266333 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:18.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab8bfff640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab8c15d950 0x7fab8c06e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:18.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab82ffd640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fab8c0b2ae0 0x7fab8c1f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:18.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab8b7fe640 1 -- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fab8c0b2ae0 msgr2=0x7fab8c1f5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:18.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab8b7fe640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fab8c0b2ae0 0x7fab8c1f5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab8b7fe640 1 -- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab8c15d950 msgr2=0x7fab8c06e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:18.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab8b7fe640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab8c15d950 0x7fab8c06e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:18.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab8b7fe640 1 -- 172.21.15.159:0/3055266333 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab8c0b4f50 con 0x7fab8c0b0b60 2024-07-24T16:25:18.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab8b7fe640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab8c0b0b60 0x7fab8c1f4280 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009920 tx=0x7fab7c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:18.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab88ff9640 1 -- 172.21.15.159:0/3055266333 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c031d60 con 0x7fab8c0b0b60 2024-07-24T16:25:18.820 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab88ff9640 1 -- 172.21.15.159:0/3055266333 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab7c033e10 con 0x7fab8c0b0b60 2024-07-24T16:25:18.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab88ff9640 1 -- 172.21.15.159:0/3055266333 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab7c005280 con 0x7fab8c0b0b60 2024-07-24T16:25:18.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab91abe640 1 -- 172.21.15.159:0/3055266333 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab8c1f5200 con 0x7fab8c0b0b60 2024-07-24T16:25:18.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.816+0000 7fab91abe640 1 -- 172.21.15.159:0/3055266333 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab8c1f4c40 con 0x7fab8c0b0b60 2024-07-24T16:25:18.821 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.817+0000 7fab91abe640 1 -- 172.21.15.159:0/3055266333 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab8c0d0980 con 0x7fab8c0b0b60 2024-07-24T16:25:18.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.818+0000 7fab88ff9640 1 -- 172.21.15.159:0/3055266333 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 10) ==== 99315+0+0 (secure 0 0 0) 0x7fab7c005420 con 0x7fab8c0b0b60 2024-07-24T16:25:18.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.818+0000 7fab88ff9640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fab6c077210 0x7fab6c0796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:18.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.818+0000 7fab88ff9640 1 -- 172.21.15.159:0/3055266333 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7fab7c0b9e00 con 0x7fab8c0b0b60 2024-07-24T16:25:18.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.818+0000 7fab82ffd640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fab6c077210 0x7fab6c0796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:18.822 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.819+0000 7fab82ffd640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fab6c077210 0x7fab6c0796d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0cfbb0 tx=0x7fab7400a2d0 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:18.825 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:18.822+0000 7fab88ff9640 1 -- 172.21.15.159:0/3055266333 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fab7c03f030 con 0x7fab8c0b0b60 2024-07-24T16:25:19.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.027+0000 7fab91abe640 1 -- 172.21.15.159:0/3055266333 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir1", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fab8c1f5980 con 0x7fab6c077210 2024-07-24T16:25:19.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.087+0000 7fab88ff9640 1 -- 172.21.15.159:0/3055266333 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fab8c1f5980 con 0x7fab6c077210 2024-07-24T16:25:19.090 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule activated for path /snap_test_dir1/dir1 2024-07-24T16:25:19.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.090+0000 7fab91abe640 1 -- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fab6c077210 msgr2=0x7fab6c0796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.092 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.090+0000 7fab91abe640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fab6c077210 0x7fab6c0796d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0cfbb0 tx=0x7fab7400a2d0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.090+0000 7fab91abe640 1 -- 172.21.15.159:0/3055266333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab8c0b0b60 msgr2=0x7fab8c1f4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.090+0000 7fab91abe640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab8c0b0b60 0x7fab8c1f4280 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009920 tx=0x7fab7c033c20 comp rx=0 tx=0).stop 2024-07-24T16:25:19.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.090+0000 7fab91abe640 1 -- 172.21.15.159:0/3055266333 shutdown_connections 2024-07-24T16:25:19.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.090+0000 7fab91abe640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fab6c077210 0x7fab6c0796d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.090+0000 7fab91abe640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fab8c15d950 0x7fab8c06e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.090+0000 7fab91abe640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fab8c0b2ae0 0x7fab8c1f5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.090+0000 7fab91abe640 1 --2- 172.21.15.159:0/3055266333 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fab8c0b0b60 0x7fab8c1f4280 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.090+0000 7fab91abe640 1 -- 172.21.15.159:0/3055266333 >> 172.21.15.159:0/3055266333 conn(0x7fab8c09cd30 msgr2=0x7fab8c0b7a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:19.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.090+0000 7fab91abe640 1 -- 172.21.15.159:0/3055266333 shutdown_connections 2024-07-24T16:25:19.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.090+0000 7fab91abe640 1 -- 172.21.15.159:0/3055266333 wait complete. 2024-07-24T16:25:19.103 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir1 2024-07-24T16:25:19.104 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir2 1m 2024-07-24T16:25:19.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.208+0000 7fc94c6f0640 1 -- 172.21.15.159:0/3366777483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc94406c560 msgr2=0x7fc94415fa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.208+0000 7fc94c6f0640 1 --2- 172.21.15.159:0/3366777483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc94406c560 0x7fc94415fa80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc944074cc0 tx=0x7fc93802a530 comp rx=0 tx=0).stop 2024-07-24T16:25:19.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.208+0000 7fc94c6f0640 1 -- 172.21.15.159:0/3366777483 shutdown_connections 2024-07-24T16:25:19.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.208+0000 7fc94c6f0640 1 --2- 172.21.15.159:0/3366777483 >> v2:172.21.15.193:3300/0 conn(0x7fc944070610 0x7fc944070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.208+0000 7fc94c6f0640 1 --2- 172.21.15.159:0/3366777483 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc94406c560 0x7fc94415fa80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.208+0000 7fc94c6f0640 1 -- 172.21.15.159:0/3366777483 >> 172.21.15.159:0/3366777483 conn(0x7fc9440b2230 msgr2=0x7fc9440b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:19.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.208+0000 7fc94c6f0640 1 -- 172.21.15.159:0/3366777483 shutdown_connections 2024-07-24T16:25:19.212 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.208+0000 7fc94c6f0640 1 -- 172.21.15.159:0/3366777483 wait complete. 2024-07-24T16:25:19.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.209+0000 7fc94c6f0640 1 Processor -- start 2024-07-24T16:25:19.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.209+0000 7fc94c6f0640 1 -- start start 2024-07-24T16:25:19.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.210+0000 7fc94c6f0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc94406c560 0x7fc94413f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:19.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.210+0000 7fc94c6f0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc944070610 0x7fc94413c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:19.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.210+0000 7fc94c6f0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9440ce310 0x7fc94413cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:19.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.210+0000 7fc94c6f0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc944070f50 con 0x7fc9440ce310 2024-07-24T16:25:19.214 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.210+0000 7fc94c6f0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc94415ee30 con 0x7fc944070610 2024-07-24T16:25:19.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.210+0000 7fc94c6f0640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc9440710d0 con 0x7fc94406c560 2024-07-24T16:25:19.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.210+0000 7fc94ac8d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9440ce310 0x7fc94413cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:19.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.210+0000 7fc94ac8d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9440ce310 0x7fc94413cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35620/0 (socket says 172.21.15.159:35620) 2024-07-24T16:25:19.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.210+0000 7fc94ac8d640 1 -- 172.21.15.159:0/2625778714 learned_addr learned my addr 172.21.15.159:0/2625778714 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:19.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.210+0000 7fc949c8b640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc944070610 0x7fc94413c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:19.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.210+0000 7fc94a48c640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc94406c560 0x7fc94413f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:19.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.211+0000 7fc94ac8d640 1 -- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc94406c560 msgr2=0x7fc94413f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.211+0000 7fc94ac8d640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc94406c560 0x7fc94413f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.211+0000 7fc94ac8d640 1 -- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc944070610 msgr2=0x7fc94413c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.211+0000 7fc94ac8d640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc944070610 0x7fc94413c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.211+0000 7fc94ac8d640 1 -- 172.21.15.159:0/2625778714 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9441e5ad0 con 0x7fc9440ce310 2024-07-24T16:25:19.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.211+0000 7fc94a48c640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc94406c560 0x7fc94413f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:25:19.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.211+0000 7fc94ac8d640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9440ce310 0x7fc94413cdc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00eb10 tx=0x7fc93c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:19.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.211+0000 7fc936ffd640 1 -- 172.21.15.159:0/2625778714 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c004b20 con 0x7fc9440ce310 2024-07-24T16:25:19.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.211+0000 7fc936ffd640 1 -- 172.21.15.159:0/2625778714 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc93c004ce0 con 0x7fc9440ce310 2024-07-24T16:25:19.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.211+0000 7fc94c6f0640 1 -- 172.21.15.159:0/2625778714 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc944153950 con 0x7fc9440ce310 2024-07-24T16:25:19.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.211+0000 7fc936ffd640 1 -- 172.21.15.159:0/2625778714 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc93c005280 con 0x7fc9440ce310 2024-07-24T16:25:19.216 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.211+0000 7fc94c6f0640 1 -- 172.21.15.159:0/2625778714 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc94413da10 con 0x7fc9440ce310 2024-07-24T16:25:19.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.212+0000 7fc94c6f0640 1 -- 172.21.15.159:0/2625778714 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9440641a0 con 0x7fc9440ce310 2024-07-24T16:25:19.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.213+0000 7fc936ffd640 1 -- 172.21.15.159:0/2625778714 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 10) ==== 99315+0+0 (secure 0 0 0) 0x7fc93c005420 con 0x7fc9440ce310 2024-07-24T16:25:19.217 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.213+0000 7fc936ffd640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fc928077210 0x7fc9280796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:19.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.213+0000 7fc936ffd640 1 -- 172.21.15.159:0/2625778714 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7fc93c099b40 con 0x7fc9440ce310 2024-07-24T16:25:19.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.213+0000 7fc94a48c640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fc928077210 0x7fc9280796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:19.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.214+0000 7fc94a48c640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fc928077210 0x7fc9280796d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc938034000 tx=0x7fc938004730 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:19.219 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.217+0000 7fc936ffd640 1 -- 172.21.15.159:0/2625778714 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fc9440641a0 con 0x7fc9440ce310 2024-07-24T16:25:19.426 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.423+0000 7fc94c6f0640 1 -- 172.21.15.159:0/2625778714 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir2", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fc9440cf0c0 con 0x7fc928077210 2024-07-24T16:25:19.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.475+0000 7fc936ffd640 1 -- 172.21.15.159:0/2625778714 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fc9440cf0c0 con 0x7fc928077210 2024-07-24T16:25:19.477 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule activated for path /snap_test_dir1/dir2 2024-07-24T16:25:19.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.477+0000 7fc94c6f0640 1 -- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fc928077210 msgr2=0x7fc9280796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.477+0000 7fc94c6f0640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fc928077210 0x7fc9280796d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc938034000 tx=0x7fc938004730 comp rx=0 tx=0).stop 2024-07-24T16:25:19.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.477+0000 7fc94c6f0640 1 -- 172.21.15.159:0/2625778714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9440ce310 msgr2=0x7fc94413cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.477+0000 7fc94c6f0640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9440ce310 0x7fc94413cdc0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc93c00eb10 tx=0x7fc93c00c2d0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.477+0000 7fc94c6f0640 1 -- 172.21.15.159:0/2625778714 shutdown_connections 2024-07-24T16:25:19.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.477+0000 7fc94c6f0640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fc928077210 0x7fc9280796d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.477+0000 7fc94c6f0640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc9440ce310 0x7fc94413cdc0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.477+0000 7fc94c6f0640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc944070610 0x7fc94413c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.477+0000 7fc94c6f0640 1 --2- 172.21.15.159:0/2625778714 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc94406c560 0x7fc94413f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.477+0000 7fc94c6f0640 1 -- 172.21.15.159:0/2625778714 >> 172.21.15.159:0/2625778714 conn(0x7fc9440b2230 msgr2=0x7fc9440ce790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:19.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.477+0000 7fc94c6f0640 1 -- 172.21.15.159:0/2625778714 shutdown_connections 2024-07-24T16:25:19.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.477+0000 7fc94c6f0640 1 -- 172.21.15.159:0/2625778714 wait complete. 2024-07-24T16:25:19.490 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir2 2024-07-24T16:25:19.490 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir3 1m 2024-07-24T16:25:19.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.594+0000 7fa0be6e9640 1 -- 172.21.15.159:0/2281811265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b806f1c0 msgr2=0x7fa0b815b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.594+0000 7fa0be6e9640 1 --2- 172.21.15.159:0/2281811265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b806f1c0 0x7fa0b815b3c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80cc710 tx=0x7fa0b002a7c0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.594+0000 7fa0be6e9640 1 -- 172.21.15.159:0/2281811265 shutdown_connections 2024-07-24T16:25:19.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.594+0000 7fa0be6e9640 1 --2- 172.21.15.159:0/2281811265 >> v2:172.21.15.193:3300/0 conn(0x7fa0b8070500 0x7fa0b80cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.594+0000 7fa0be6e9640 1 --2- 172.21.15.159:0/2281811265 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b806f1c0 0x7fa0b815b3c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.594+0000 7fa0be6e9640 1 -- 172.21.15.159:0/2281811265 >> 172.21.15.159:0/2281811265 conn(0x7fa0b806d450 msgr2=0x7fa0b806d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:19.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.594+0000 7fa0be6e9640 1 -- 172.21.15.159:0/2281811265 shutdown_connections 2024-07-24T16:25:19.598 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.594+0000 7fa0be6e9640 1 -- 172.21.15.159:0/2281811265 wait complete. 2024-07-24T16:25:19.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.595+0000 7fa0be6e9640 1 Processor -- start 2024-07-24T16:25:19.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.595+0000 7fa0be6e9640 1 -- start start 2024-07-24T16:25:19.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.596+0000 7fa0be6e9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b806f1c0 0x7fa0b814bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:19.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.596+0000 7fa0be6e9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0b8070500 0x7fa0b815a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:19.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.596+0000 7fa0be6e9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0b8157d50 0x7fa0b8146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:19.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.596+0000 7fa0be6e9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b80cdea0 con 0x7fa0b806f1c0 2024-07-24T16:25:19.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.596+0000 7fa0be6e9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa0b80cdd20 con 0x7fa0b8070500 2024-07-24T16:25:19.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.596+0000 7fa0be6e9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa0b80ce020 con 0x7fa0b8157d50 2024-07-24T16:25:19.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.596+0000 7fa0b7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b806f1c0 0x7fa0b814bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:19.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.596+0000 7fa0b7fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b806f1c0 0x7fa0b814bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35646/0 (socket says 172.21.15.159:35646) 2024-07-24T16:25:19.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.596+0000 7fa0b7fff640 1 -- 172.21.15.159:0/3765427364 learned_addr learned my addr 172.21.15.159:0/3765427364 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:19.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.596+0000 7fa0bcc86640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0b8157d50 0x7fa0b8146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:19.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.596+0000 7fa0b77fe640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0b8070500 0x7fa0b815a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:19.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.597+0000 7fa0b7fff640 1 -- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0b8157d50 msgr2=0x7fa0b8146c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.597+0000 7fa0b7fff640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0b8157d50 0x7fa0b8146c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.597+0000 7fa0b7fff640 1 -- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0b8070500 msgr2=0x7fa0b815a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.597+0000 7fa0b7fff640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0b8070500 0x7fa0b815a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.597+0000 7fa0b7fff640 1 -- 172.21.15.159:0/3765427364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b80ad030 con 0x7fa0b806f1c0 2024-07-24T16:25:19.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.597+0000 7fa0b7fff640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b806f1c0 0x7fa0b814bd00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800c520 tx=0x7fa0a800c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:19.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.597+0000 7fa0b4ff9640 1 -- 172.21.15.159:0/3765427364 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8017070 con 0x7fa0b806f1c0 2024-07-24T16:25:19.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.597+0000 7fa0b4ff9640 1 -- 172.21.15.159:0/3765427364 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa0a80035f0 con 0x7fa0b806f1c0 2024-07-24T16:25:19.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.597+0000 7fa0b4ff9640 1 -- 172.21.15.159:0/3765427364 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8003a40 con 0x7fa0b806f1c0 2024-07-24T16:25:19.601 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.597+0000 7fa0be6e9640 1 -- 172.21.15.159:0/3765427364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b80ad310 con 0x7fa0b806f1c0 2024-07-24T16:25:19.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.597+0000 7fa0be6e9640 1 -- 172.21.15.159:0/3765427364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0b80ad8d0 con 0x7fa0b806f1c0 2024-07-24T16:25:19.602 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.598+0000 7fa0be6e9640 1 -- 172.21.15.159:0/3765427364 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0b80ab750 con 0x7fa0b806f1c0 2024-07-24T16:25:19.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.599+0000 7fa0b4ff9640 1 -- 172.21.15.159:0/3765427364 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 10) ==== 99315+0+0 (secure 0 0 0) 0x7fa0a801a070 con 0x7fa0b806f1c0 2024-07-24T16:25:19.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.599+0000 7fa0b4ff9640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa0a4077210 0x7fa0a40796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:19.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.599+0000 7fa0b4ff9640 1 -- 172.21.15.159:0/3765427364 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7fa0a8098320 con 0x7fa0b806f1c0 2024-07-24T16:25:19.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.599+0000 7fa0b77fe640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa0a4077210 0x7fa0a40796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:19.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.600+0000 7fa0b77fe640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa0a4077210 0x7fa0a40796d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80b0830 tx=0x7fa0ac00a4c0 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:19.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.603+0000 7fa0b4ff9640 1 -- 172.21.15.159:0/3765427364 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa0b80ab750 con 0x7fa0b806f1c0 2024-07-24T16:25:19.809 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.807+0000 7fa0be6e9640 1 -- 172.21.15.159:0/3765427364 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir3", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa0b815b3c0 con 0x7fa0a4077210 2024-07-24T16:25:19.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.857+0000 7fa0b4ff9640 1 -- 172.21.15.159:0/3765427364 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fa0b815b3c0 con 0x7fa0a4077210 2024-07-24T16:25:19.860 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule activated for path /snap_test_dir1/dir3 2024-07-24T16:25:19.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.860+0000 7fa0be6e9640 1 -- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa0a4077210 msgr2=0x7fa0a40796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.860+0000 7fa0be6e9640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa0a4077210 0x7fa0a40796d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80b0830 tx=0x7fa0ac00a4c0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.860+0000 7fa0be6e9640 1 -- 172.21.15.159:0/3765427364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b806f1c0 msgr2=0x7fa0b814bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.860+0000 7fa0be6e9640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b806f1c0 0x7fa0b814bd00 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800c520 tx=0x7fa0a800c9e0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.860+0000 7fa0be6e9640 1 -- 172.21.15.159:0/3765427364 shutdown_connections 2024-07-24T16:25:19.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.860+0000 7fa0be6e9640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa0a4077210 0x7fa0a40796d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.860+0000 7fa0be6e9640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa0b8157d50 0x7fa0b8146c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.860+0000 7fa0be6e9640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa0b8070500 0x7fa0b815a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.860+0000 7fa0be6e9640 1 --2- 172.21.15.159:0/3765427364 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa0b806f1c0 0x7fa0b814bd00 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.860+0000 7fa0be6e9640 1 -- 172.21.15.159:0/3765427364 >> 172.21.15.159:0/3765427364 conn(0x7fa0b806d450 msgr2=0x7fa0b80b0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:19.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.860+0000 7fa0be6e9640 1 -- 172.21.15.159:0/3765427364 shutdown_connections 2024-07-24T16:25:19.863 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.860+0000 7fa0be6e9640 1 -- 172.21.15.159:0/3765427364 wait complete. 2024-07-24T16:25:19.873 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir3 2024-07-24T16:25:19.873 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir4 1m 2024-07-24T16:25:19.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.978+0000 7fa50f69a640 1 -- 172.21.15.159:0/689668796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5080cd130 msgr2=0x7fa5080b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.978+0000 7fa50f69a640 1 --2- 172.21.15.159:0/689668796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5080cd130 0x7fa5080b3ed0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa500005fd0 tx=0x7fa50002aa10 comp rx=0 tx=0).stop 2024-07-24T16:25:19.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.978+0000 7fa50f69a640 1 -- 172.21.15.159:0/689668796 shutdown_connections 2024-07-24T16:25:19.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.978+0000 7fa50f69a640 1 --2- 172.21.15.159:0/689668796 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5080cd130 0x7fa5080b3ed0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.978+0000 7fa50f69a640 1 --2- 172.21.15.159:0/689668796 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa5081524f0 0x7fa5080af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.978+0000 7fa50f69a640 1 -- 172.21.15.159:0/689668796 >> 172.21.15.159:0/689668796 conn(0x7fa50806d450 msgr2=0x7fa50806d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:19.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.978+0000 7fa50f69a640 1 -- 172.21.15.159:0/689668796 shutdown_connections 2024-07-24T16:25:19.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.978+0000 7fa50f69a640 1 -- 172.21.15.159:0/689668796 wait complete. 2024-07-24T16:25:19.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.979+0000 7fa50f69a640 1 Processor -- start 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.979+0000 7fa50f69a640 1 -- start start 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50f69a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa5080cd130 0x7fa5080aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50f69a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5080cf840 0x7fa5080a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50f69a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5081524f0 0x7fa508159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50f69a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa5080b4590 con 0x7fa5080cf840 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50f69a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa5080b4410 con 0x7fa5081524f0 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50f69a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa5080b4710 con 0x7fa5080cd130 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50cc35640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5080cf840 0x7fa5080a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50cc35640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5080cf840 0x7fa5080a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35670/0 (socket says 172.21.15.159:35670) 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50cc35640 1 -- 172.21.15.159:0/640444051 learned_addr learned my addr 172.21.15.159:0/640444051 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50d436640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa5080cd130 0x7fa5080aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50dc37640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5081524f0 0x7fa508159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50cc35640 1 -- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa5080cd130 msgr2=0x7fa5080aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50cc35640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa5080cd130 0x7fa5080aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50cc35640 1 -- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5081524f0 msgr2=0x7fa508159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:19.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50cc35640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5081524f0 0x7fa508159980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:19.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.980+0000 7fa50cc35640 1 -- 172.21.15.159:0/640444051 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa508159730 con 0x7fa5080cf840 2024-07-24T16:25:19.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.981+0000 7fa50cc35640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5080cf840 0x7fa5080a9480 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800c420 tx=0x7fa4f800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:19.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.981+0000 7fa4fdffb640 1 -- 172.21.15.159:0/640444051 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80052d0 con 0x7fa5080cf840 2024-07-24T16:25:19.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.981+0000 7fa4fdffb640 1 -- 172.21.15.159:0/640444051 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4f8007020 con 0x7fa5080cf840 2024-07-24T16:25:19.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.981+0000 7fa50f69a640 1 -- 172.21.15.159:0/640444051 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5080ae970 con 0x7fa5080cf840 2024-07-24T16:25:19.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.981+0000 7fa4fdffb640 1 -- 172.21.15.159:0/640444051 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8007470 con 0x7fa5080cf840 2024-07-24T16:25:19.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.981+0000 7fa50f69a640 1 -- 172.21.15.159:0/640444051 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5080aef30 con 0x7fa5080cf840 2024-07-24T16:25:19.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.982+0000 7fa50f69a640 1 -- 172.21.15.159:0/640444051 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5080b4c30 con 0x7fa5080cf840 2024-07-24T16:25:19.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.983+0000 7fa4fdffb640 1 -- 172.21.15.159:0/640444051 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 10) ==== 99315+0+0 (secure 0 0 0) 0x7fa4f80067d0 con 0x7fa5080cf840 2024-07-24T16:25:19.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.983+0000 7fa4fdffb640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa4ec077210 0x7fa4ec0796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:19.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.983+0000 7fa4fdffb640 1 -- 172.21.15.159:0/640444051 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7fa4f8098300 con 0x7fa5080cf840 2024-07-24T16:25:19.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.983+0000 7fa50d436640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa4ec077210 0x7fa4ec0796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:19.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.984+0000 7fa50d436640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa4ec077210 0x7fa4ec0796d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa504009b30 tx=0x7fa504005f90 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:19.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:19.987+0000 7fa4fdffb640 1 -- 172.21.15.159:0/640444051 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa4f8060ae0 con 0x7fa5080cf840 2024-07-24T16:25:20.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.196+0000 7fa50f69a640 1 -- 172.21.15.159:0/640444051 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir4", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa5080cecf0 con 0x7fa4ec077210 2024-07-24T16:25:20.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.243+0000 7fa4fdffb640 1 -- 172.21.15.159:0/640444051 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fa5080cecf0 con 0x7fa4ec077210 2024-07-24T16:25:20.246 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule activated for path /snap_test_dir1/dir4 2024-07-24T16:25:20.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.245+0000 7fa50f69a640 1 -- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa4ec077210 msgr2=0x7fa4ec0796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:20.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.245+0000 7fa50f69a640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa4ec077210 0x7fa4ec0796d0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa504009b30 tx=0x7fa504005f90 comp rx=0 tx=0).stop 2024-07-24T16:25:20.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.245+0000 7fa50f69a640 1 -- 172.21.15.159:0/640444051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5080cf840 msgr2=0x7fa5080a9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:20.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.245+0000 7fa50f69a640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5080cf840 0x7fa5080a9480 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800c420 tx=0x7fa4f800c8e0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.245+0000 7fa50f69a640 1 -- 172.21.15.159:0/640444051 shutdown_connections 2024-07-24T16:25:20.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.245+0000 7fa50f69a640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa4ec077210 0x7fa4ec0796d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.245+0000 7fa50f69a640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa5081524f0 0x7fa508159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.245+0000 7fa50f69a640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa5080cf840 0x7fa5080a9480 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.245+0000 7fa50f69a640 1 --2- 172.21.15.159:0/640444051 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa5080cd130 0x7fa5080aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.245+0000 7fa50f69a640 1 -- 172.21.15.159:0/640444051 >> 172.21.15.159:0/640444051 conn(0x7fa50806d450 msgr2=0x7fa5080b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:20.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.245+0000 7fa50f69a640 1 -- 172.21.15.159:0/640444051 shutdown_connections 2024-07-24T16:25:20.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.245+0000 7fa50f69a640 1 -- 172.21.15.159:0/640444051 wait complete. 2024-07-24T16:25:20.259 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir4 2024-07-24T16:25:20.259 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir5 1m 2024-07-24T16:25:20.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.363+0000 7f01fb14b640 1 -- 172.21.15.159:0/3766629541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f406f890 msgr2=0x7f01f40cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:20.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.363+0000 7f01fb14b640 1 --2- 172.21.15.159:0/3766629541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f406f890 0x7f01f40cf320 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f01e0009860 tx=0x7f01e002a540 comp rx=0 tx=0).stop 2024-07-24T16:25:20.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.363+0000 7f01fb14b640 1 -- 172.21.15.159:0/3766629541 shutdown_connections 2024-07-24T16:25:20.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.363+0000 7f01fb14b640 1 --2- 172.21.15.159:0/3766629541 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f406f890 0x7f01f40cf320 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.363+0000 7f01fb14b640 1 -- 172.21.15.159:0/3766629541 >> 172.21.15.159:0/3766629541 conn(0x7f01f406c560 msgr2=0x7f01f406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:20.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.363+0000 7f01fb14b640 1 -- 172.21.15.159:0/3766629541 shutdown_connections 2024-07-24T16:25:20.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.363+0000 7f01fb14b640 1 -- 172.21.15.159:0/3766629541 wait complete. 2024-07-24T16:25:20.368 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.364+0000 7f01fb14b640 1 Processor -- start 2024-07-24T16:25:20.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.364+0000 7f01fb14b640 1 -- start start 2024-07-24T16:25:20.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01fb14b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01f406f890 0x7f01f41504e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:20.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01fb14b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01f40cf860 0x7f01f40af190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:20.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01fb14b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f4158fe0 0x7f01f414cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:20.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01fb14b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f01f4159540 con 0x7f01f4158fe0 2024-07-24T16:25:20.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01fb14b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f01f41593c0 con 0x7f01f406f890 2024-07-24T16:25:20.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01fb14b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f01f415c6a0 con 0x7f01f40cf860 2024-07-24T16:25:20.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01f96e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f4158fe0 0x7f01f414cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:20.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01f96e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f4158fe0 0x7f01f414cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35688/0 (socket says 172.21.15.159:35688) 2024-07-24T16:25:20.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01f96e8640 1 -- 172.21.15.159:0/3971494520 learned_addr learned my addr 172.21.15.159:0/3971494520 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:20.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01f8ee7640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01f406f890 0x7f01f41504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:20.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01f3fff640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01f40cf860 0x7f01f40af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:20.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01f96e8640 1 -- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01f40cf860 msgr2=0x7f01f40af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:20.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01f96e8640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01f40cf860 0x7f01f40af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01f96e8640 1 -- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01f406f890 msgr2=0x7f01f41504e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:20.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01f96e8640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01f406f890 0x7f01f41504e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01f96e8640 1 -- 172.21.15.159:0/3971494520 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01f40b0110 con 0x7f01f4158fe0 2024-07-24T16:25:20.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.365+0000 7f01f96e8640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f4158fe0 0x7f01f414cf20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00cbc0 tx=0x7f01ec00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:20.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.366+0000 7f01f17fa640 1 -- 172.21.15.159:0/3971494520 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec016020 con 0x7f01f4158fe0 2024-07-24T16:25:20.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.366+0000 7f01f17fa640 1 -- 172.21.15.159:0/3971494520 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01ec00ae30 con 0x7f01f4158fe0 2024-07-24T16:25:20.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.366+0000 7f01fb14b640 1 -- 172.21.15.159:0/3971494520 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01f40af870 con 0x7f01f4158fe0 2024-07-24T16:25:20.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.366+0000 7f01f17fa640 1 -- 172.21.15.159:0/3971494520 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01ec012660 con 0x7f01f4158fe0 2024-07-24T16:25:20.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.366+0000 7f01fb14b640 1 -- 172.21.15.159:0/3971494520 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01f40afe30 con 0x7f01f4158fe0 2024-07-24T16:25:20.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.367+0000 7f01fb14b640 1 -- 172.21.15.159:0/3971494520 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01f406ee00 con 0x7f01f4158fe0 2024-07-24T16:25:20.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.367+0000 7f01f17fa640 1 -- 172.21.15.159:0/3971494520 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 10) ==== 99315+0+0 (secure 0 0 0) 0x7f01ec019020 con 0x7f01f4158fe0 2024-07-24T16:25:20.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.368+0000 7f01f17fa640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f01d8077210 0x7f01d80796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:20.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.368+0000 7f01f17fa640 1 -- 172.21.15.159:0/3971494520 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7f01ec099400 con 0x7f01f4158fe0 2024-07-24T16:25:20.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.368+0000 7f01f8ee7640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f01d8077210 0x7f01d80796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:20.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.368+0000 7f01f8ee7640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f01d8077210 0x7f01d80796d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f01e8006fd0 tx=0x7f01e8009060 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:20.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.372+0000 7f01f17fa640 1 -- 172.21.15.159:0/3971494520 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f01f406ee00 con 0x7f01f4158fe0 2024-07-24T16:25:20.578 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.575+0000 7f01fb14b640 1 -- 172.21.15.159:0/3971494520 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir5", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f01f414d880 con 0x7f01d8077210 2024-07-24T16:25:20.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.636+0000 7f01f17fa640 1 -- 172.21.15.159:0/3971494520 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f01e8009550 con 0x7f01d8077210 2024-07-24T16:25:20.638 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule activated for path /snap_test_dir1/dir5 2024-07-24T16:25:20.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.638+0000 7f01fb14b640 1 -- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f01d8077210 msgr2=0x7f01d80796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:20.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.638+0000 7f01fb14b640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f01d8077210 0x7f01d80796d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f01e8006fd0 tx=0x7f01e8009060 comp rx=0 tx=0).stop 2024-07-24T16:25:20.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.638+0000 7f01fb14b640 1 -- 172.21.15.159:0/3971494520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f4158fe0 msgr2=0x7f01f414cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:20.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.638+0000 7f01fb14b640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f4158fe0 0x7f01f414cf20 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f01ec00cbc0 tx=0x7f01ec00a430 comp rx=0 tx=0).stop 2024-07-24T16:25:20.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.638+0000 7f01fb14b640 1 -- 172.21.15.159:0/3971494520 shutdown_connections 2024-07-24T16:25:20.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.638+0000 7f01fb14b640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f01d8077210 0x7f01d80796d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.638+0000 7f01fb14b640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f01f4158fe0 0x7f01f414cf20 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.638+0000 7f01fb14b640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f01f40cf860 0x7f01f40af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.638+0000 7f01fb14b640 1 --2- 172.21.15.159:0/3971494520 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f01f406f890 0x7f01f41504e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.638+0000 7f01fb14b640 1 -- 172.21.15.159:0/3971494520 >> 172.21.15.159:0/3971494520 conn(0x7f01f406c560 msgr2=0x7f01f40cd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:20.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.638+0000 7f01fb14b640 1 -- 172.21.15.159:0/3971494520 shutdown_connections 2024-07-24T16:25:20.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.638+0000 7f01fb14b640 1 -- 172.21.15.159:0/3971494520 wait complete. 2024-07-24T16:25:20.652 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir5 2024-07-24T16:25:20.652 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir6 1m 2024-07-24T16:25:20.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.755+0000 7fd055908640 1 -- 172.21.15.159:0/3570673801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd0500cee10 msgr2=0x7fd0500d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:20.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.755+0000 7fd055908640 1 --2- 172.21.15.159:0/3570673801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd0500cee10 0x7fd0500d08a0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd040009be0 tx=0x7fd04002a840 comp rx=0 tx=0).stop 2024-07-24T16:25:20.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.755+0000 7fd055908640 1 -- 172.21.15.159:0/3570673801 shutdown_connections 2024-07-24T16:25:20.758 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.755+0000 7fd055908640 1 --2- 172.21.15.159:0/3570673801 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd050071ca0 0x7fd0500b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.755+0000 7fd055908640 1 --2- 172.21.15.159:0/3570673801 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd0500cee10 0x7fd0500d08a0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.755+0000 7fd055908640 1 -- 172.21.15.159:0/3570673801 >> 172.21.15.159:0/3570673801 conn(0x7fd0500b36f0 msgr2=0x7fd0500b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:20.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.755+0000 7fd055908640 1 -- 172.21.15.159:0/3570673801 shutdown_connections 2024-07-24T16:25:20.759 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.755+0000 7fd055908640 1 -- 172.21.15.159:0/3570673801 wait complete. 2024-07-24T16:25:20.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.756+0000 7fd055908640 1 Processor -- start 2024-07-24T16:25:20.761 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.757+0000 7fd055908640 1 -- start start 2024-07-24T16:25:20.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.757+0000 7fd055908640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd0500707c0 0x7fd05013f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:20.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.757+0000 7fd055908640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd050071ca0 0x7fd050149dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:20.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.757+0000 7fd055908640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0500cee10 0x7fd05014c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:20.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.757+0000 7fd055908640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd0500b5990 con 0x7fd0500cee10 2024-07-24T16:25:20.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.757+0000 7fd055908640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd0500b5b10 con 0x7fd050071ca0 2024-07-24T16:25:20.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.757+0000 7fd055908640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd0500b5c90 con 0x7fd0500707c0 2024-07-24T16:25:20.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.757+0000 7fd04f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0500cee10 0x7fd05014c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:20.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.757+0000 7fd04f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0500cee10 0x7fd05014c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:35704/0 (socket says 172.21.15.159:35704) 2024-07-24T16:25:20.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.757+0000 7fd04f7fe640 1 -- 172.21.15.159:0/600209766 learned_addr learned my addr 172.21.15.159:0/600209766 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:20.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd04effd640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd0500707c0 0x7fd05013f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:20.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd04e7fc640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd050071ca0 0x7fd050149dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:20.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd04f7fe640 1 -- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd0500707c0 msgr2=0x7fd05013f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:20.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd04f7fe640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd0500707c0 0x7fd05013f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd04f7fe640 1 -- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd050071ca0 msgr2=0x7fd050149dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:20.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd04f7fe640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd050071ca0 0x7fd050149dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:20.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd04f7fe640 1 -- 172.21.15.159:0/600209766 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05014a6c0 con 0x7fd0500cee10 2024-07-24T16:25:20.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd04e7fc640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd050071ca0 0x7fd050149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:25:20.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd04f7fe640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0500cee10 0x7fd05014c670 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd04800e970 tx=0x7fd04800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:20.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd047fff640 1 -- 172.21.15.159:0/600209766 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd04800cc60 con 0x7fd0500cee10 2024-07-24T16:25:20.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd047fff640 1 -- 172.21.15.159:0/600209766 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd04800ce00 con 0x7fd0500cee10 2024-07-24T16:25:20.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd055908640 1 -- 172.21.15.159:0/600209766 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd05014a9a0 con 0x7fd0500cee10 2024-07-24T16:25:20.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd047fff640 1 -- 172.21.15.159:0/600209766 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048005280 con 0x7fd0500cee10 2024-07-24T16:25:20.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.758+0000 7fd055908640 1 -- 172.21.15.159:0/600209766 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd05014af60 con 0x7fd0500cee10 2024-07-24T16:25:20.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.759+0000 7fd055908640 1 -- 172.21.15.159:0/600209766 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd050076380 con 0x7fd0500cee10 2024-07-24T16:25:20.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.760+0000 7fd047fff640 1 -- 172.21.15.159:0/600209766 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 10) ==== 99315+0+0 (secure 0 0 0) 0x7fd048005420 con 0x7fd0500cee10 2024-07-24T16:25:20.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.760+0000 7fd047fff640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fd030077210 0x7fd0300796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:20.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.760+0000 7fd047fff640 1 -- 172.21.15.159:0/600209766 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7fd048099940 con 0x7fd0500cee10 2024-07-24T16:25:20.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.760+0000 7fd04effd640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fd030077210 0x7fd0300796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:20.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.761+0000 7fd04effd640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fd030077210 0x7fd0300796d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd040034000 tx=0x7fd040004ab0 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:20.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.764+0000 7fd047fff640 1 -- 172.21.15.159:0/600209766 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fd050076380 con 0x7fd0500cee10 2024-07-24T16:25:20.972 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:20.970+0000 7fd055908640 1 -- 172.21.15.159:0/600209766 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir6", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fd05014b760 con 0x7fd030077210 2024-07-24T16:25:21.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.034+0000 7fd047fff640 1 -- 172.21.15.159:0/600209766 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fd05014b760 con 0x7fd030077210 2024-07-24T16:25:21.037 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule activated for path /snap_test_dir1/dir6 2024-07-24T16:25:21.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.036+0000 7fd055908640 1 -- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fd030077210 msgr2=0x7fd0300796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.036+0000 7fd055908640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fd030077210 0x7fd0300796d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fd040034000 tx=0x7fd040004ab0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.036+0000 7fd055908640 1 -- 172.21.15.159:0/600209766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0500cee10 msgr2=0x7fd05014c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.039 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.036+0000 7fd055908640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0500cee10 0x7fd05014c670 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd04800e970 tx=0x7fd04800ee30 comp rx=0 tx=0).stop 2024-07-24T16:25:21.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.036+0000 7fd055908640 1 -- 172.21.15.159:0/600209766 shutdown_connections 2024-07-24T16:25:21.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.036+0000 7fd055908640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fd030077210 0x7fd0300796d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.036+0000 7fd055908640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd0500cee10 0x7fd05014c670 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.036+0000 7fd055908640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd050071ca0 0x7fd050149dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.036+0000 7fd055908640 1 --2- 172.21.15.159:0/600209766 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd0500707c0 0x7fd05013f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.037+0000 7fd055908640 1 -- 172.21.15.159:0/600209766 >> 172.21.15.159:0/600209766 conn(0x7fd0500b36f0 msgr2=0x7fd0500b63c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:21.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.037+0000 7fd055908640 1 -- 172.21.15.159:0/600209766 shutdown_connections 2024-07-24T16:25:21.040 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.037+0000 7fd055908640 1 -- 172.21.15.159:0/600209766 wait complete. 2024-07-24T16:25:21.050 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir6 2024-07-24T16:25:21.050 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir7 1m 2024-07-24T16:25:21.158 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.156+0000 7eff37e83640 1 -- 172.21.15.159:0/596100906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff3006dba0 msgr2=0x7eff300cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.156+0000 7eff37e83640 1 --2- 172.21.15.159:0/596100906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff3006dba0 0x7eff300cbc10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7eff20005fd0 tx=0x7eff2002a5d0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.156+0000 7eff37e83640 1 -- 172.21.15.159:0/596100906 shutdown_connections 2024-07-24T16:25:21.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.156+0000 7eff37e83640 1 --2- 172.21.15.159:0/596100906 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff3006dba0 0x7eff300cbc10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.156+0000 7eff37e83640 1 -- 172.21.15.159:0/596100906 >> 172.21.15.159:0/596100906 conn(0x7eff3006c560 msgr2=0x7eff3006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:21.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.156+0000 7eff37e83640 1 -- 172.21.15.159:0/596100906 shutdown_connections 2024-07-24T16:25:21.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.156+0000 7eff37e83640 1 -- 172.21.15.159:0/596100906 wait complete. 2024-07-24T16:25:21.159 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.157+0000 7eff37e83640 1 Processor -- start 2024-07-24T16:25:21.160 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.157+0000 7eff37e83640 1 -- start start 2024-07-24T16:25:21.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff37e83640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff3006dba0 0x7eff301ee470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:21.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff37e83640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff300cf770 0x7eff300b1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:21.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff37e83640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff300cfb50 0x7eff300b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:21.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff37e83640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7eff300aef70 con 0x7eff300cfb50 2024-07-24T16:25:21.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff37e83640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7eff300aedf0 con 0x7eff3006dba0 2024-07-24T16:25:21.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff37e83640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7eff3015b4b0 con 0x7eff300cf770 2024-07-24T16:25:21.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff36420640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff300cfb50 0x7eff300b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:21.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff36420640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff300cfb50 0x7eff300b1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59510/0 (socket says 172.21.15.159:59510) 2024-07-24T16:25:21.162 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff36420640 1 -- 172.21.15.159:0/1347912289 learned_addr learned my addr 172.21.15.159:0/1347912289 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:21.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff35c1f640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff3006dba0 0x7eff301ee470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:21.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff3541e640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff300cf770 0x7eff300b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:21.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff36420640 1 -- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff300cf770 msgr2=0x7eff300b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff36420640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff300cf770 0x7eff300b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff36420640 1 -- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff3006dba0 msgr2=0x7eff301ee470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff36420640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff3006dba0 0x7eff301ee470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff36420640 1 -- 172.21.15.159:0/1347912289 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff301f1090 con 0x7eff300cfb50 2024-07-24T16:25:21.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff3541e640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff300cf770 0x7eff300b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:25:21.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff36420640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff300cfb50 0x7eff300b1bb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00b410 tx=0x7eff2c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:21.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff267fc640 1 -- 172.21.15.159:0/1347912289 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c015030 con 0x7eff300cfb50 2024-07-24T16:25:21.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff267fc640 1 -- 172.21.15.159:0/1347912289 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff2c004020 con 0x7eff300cfb50 2024-07-24T16:25:21.163 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff37e83640 1 -- 172.21.15.159:0/1347912289 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff301f1370 con 0x7eff300cfb50 2024-07-24T16:25:21.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.158+0000 7eff267fc640 1 -- 172.21.15.159:0/1347912289 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2c011630 con 0x7eff300cfb50 2024-07-24T16:25:21.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.159+0000 7eff37e83640 1 -- 172.21.15.159:0/1347912289 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff301f1930 con 0x7eff300cfb50 2024-07-24T16:25:21.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.160+0000 7eff37e83640 1 -- 172.21.15.159:0/1347912289 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff300ae4d0 con 0x7eff300cfb50 2024-07-24T16:25:21.164 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.160+0000 7eff267fc640 1 -- 172.21.15.159:0/1347912289 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 10) ==== 99315+0+0 (secure 0 0 0) 0x7eff2c018070 con 0x7eff300cfb50 2024-07-24T16:25:21.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.161+0000 7eff267fc640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7eff14077210 0x7eff140796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:21.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.161+0000 7eff267fc640 1 -- 172.21.15.159:0/1347912289 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7eff2c098960 con 0x7eff300cfb50 2024-07-24T16:25:21.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.161+0000 7eff35c1f640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7eff14077210 0x7eff140796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:21.165 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.161+0000 7eff35c1f640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7eff14077210 0x7eff140796d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7eff300b42f0 tx=0x7eff28009040 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:21.167 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.165+0000 7eff267fc640 1 -- 172.21.15.159:0/1347912289 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7eff2c0616e0 con 0x7eff300cfb50 2024-07-24T16:25:21.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.375+0000 7eff37e83640 1 -- 172.21.15.159:0/1347912289 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir7", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7eff300b3a00 con 0x7eff14077210 2024-07-24T16:25:21.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.428+0000 7eff267fc640 1 -- 172.21.15.159:0/1347912289 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7eff300b3a00 con 0x7eff14077210 2024-07-24T16:25:21.431 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule activated for path /snap_test_dir1/dir7 2024-07-24T16:25:21.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.430+0000 7eff37e83640 1 -- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7eff14077210 msgr2=0x7eff140796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.430+0000 7eff37e83640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7eff14077210 0x7eff140796d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7eff300b42f0 tx=0x7eff28009040 comp rx=0 tx=0).stop 2024-07-24T16:25:21.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.430+0000 7eff37e83640 1 -- 172.21.15.159:0/1347912289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff300cfb50 msgr2=0x7eff300b1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.430+0000 7eff37e83640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff300cfb50 0x7eff300b1bb0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7eff2c00b410 tx=0x7eff2c00b8d0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.430+0000 7eff37e83640 1 -- 172.21.15.159:0/1347912289 shutdown_connections 2024-07-24T16:25:21.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.430+0000 7eff37e83640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7eff14077210 0x7eff140796d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.430+0000 7eff37e83640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7eff300cfb50 0x7eff300b1bb0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.430+0000 7eff37e83640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7eff300cf770 0x7eff300b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.430+0000 7eff37e83640 1 --2- 172.21.15.159:0/1347912289 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7eff3006dba0 0x7eff301ee470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.430+0000 7eff37e83640 1 -- 172.21.15.159:0/1347912289 >> 172.21.15.159:0/1347912289 conn(0x7eff3006c560 msgr2=0x7eff30154000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:21.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.430+0000 7eff37e83640 1 -- 172.21.15.159:0/1347912289 shutdown_connections 2024-07-24T16:25:21.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.430+0000 7eff37e83640 1 -- 172.21.15.159:0/1347912289 wait complete. 2024-07-24T16:25:21.444 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir7 2024-07-24T16:25:21.444 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir8 1m 2024-07-24T16:25:21.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.547+0000 7f9dd3606640 1 -- 172.21.15.159:0/279959210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc158fe0 msgr2=0x7f9dcc06f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.547+0000 7f9dd3606640 1 --2- 172.21.15.159:0/279959210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc158fe0 0x7f9dcc06f890 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc073510 tx=0x7f9dc802a530 comp rx=0 tx=0).stop 2024-07-24T16:25:21.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.547+0000 7f9dd3606640 1 -- 172.21.15.159:0/279959210 shutdown_connections 2024-07-24T16:25:21.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.547+0000 7f9dd3606640 1 --2- 172.21.15.159:0/279959210 >> v2:172.21.15.193:3300/0 conn(0x7f9dcc06d670 0x7f9dcc0cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.547+0000 7f9dd3606640 1 --2- 172.21.15.159:0/279959210 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc158fe0 0x7f9dcc06f890 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.547+0000 7f9dd3606640 1 -- 172.21.15.159:0/279959210 >> 172.21.15.159:0/279959210 conn(0x7f9dcc06c560 msgr2=0x7f9dcc06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:21.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.548+0000 7f9dd3606640 1 -- 172.21.15.159:0/279959210 shutdown_connections 2024-07-24T16:25:21.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.548+0000 7f9dd3606640 1 -- 172.21.15.159:0/279959210 wait complete. 2024-07-24T16:25:21.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.549+0000 7f9dd3606640 1 Processor -- start 2024-07-24T16:25:21.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.549+0000 7f9dd3606640 1 -- start start 2024-07-24T16:25:21.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.549+0000 7f9dd3606640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc06d670 0x7f9dcc142290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:21.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.549+0000 7f9dd3606640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dcc0cf860 0x7f9dcc0af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:21.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.549+0000 7f9dd3606640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9dcc158fe0 0x7f9dcc1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:21.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.549+0000 7f9dd3606640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc1593c0 con 0x7f9dcc06d670 2024-07-24T16:25:21.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.549+0000 7f9dd3606640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc06dc50 con 0x7f9dcc0cf860 2024-07-24T16:25:21.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.549+0000 7f9dd3606640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9dcc159540 con 0x7f9dcc158fe0 2024-07-24T16:25:21.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dd13a2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc06d670 0x7f9dcc142290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:21.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dd13a2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc06d670 0x7f9dcc142290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59516/0 (socket says 172.21.15.159:59516) 2024-07-24T16:25:21.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dd13a2640 1 -- 172.21.15.159:0/1159394299 learned_addr learned my addr 172.21.15.159:0/1159394299 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:21.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dd0ba1640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dcc0cf860 0x7f9dcc0af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:21.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dd1ba3640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9dcc158fe0 0x7f9dcc1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:21.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dd13a2640 1 -- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9dcc158fe0 msgr2=0x7f9dcc1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dd13a2640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9dcc158fe0 0x7f9dcc1550c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dd13a2640 1 -- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dcc0cf860 msgr2=0x7f9dcc0af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dd13a2640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dcc0cf860 0x7f9dcc0af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.554 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dd13a2640 1 -- 172.21.15.159:0/1159394299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc0afcc0 con 0x7f9dcc06d670 2024-07-24T16:25:21.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dd13a2640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc06d670 0x7f9dcc142290 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9dc802ab20 tx=0x7f9dc8033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:21.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dbdffb640 1 -- 172.21.15.159:0/1159394299 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8005c90 con 0x7f9dcc06d670 2024-07-24T16:25:21.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dbdffb640 1 -- 172.21.15.159:0/1159394299 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9dc8031e50 con 0x7f9dcc06d670 2024-07-24T16:25:21.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dd3606640 1 -- 172.21.15.159:0/1159394299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc0affa0 con 0x7f9dcc06d670 2024-07-24T16:25:21.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dbdffb640 1 -- 172.21.15.159:0/1159394299 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8005240 con 0x7f9dcc06d670 2024-07-24T16:25:21.555 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.550+0000 7f9dd3606640 1 -- 172.21.15.159:0/1159394299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dcc0b0560 con 0x7f9dcc06d670 2024-07-24T16:25:21.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.551+0000 7f9dd3606640 1 -- 172.21.15.159:0/1159394299 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dcc15c810 con 0x7f9dcc06d670 2024-07-24T16:25:21.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.552+0000 7f9dbdffb640 1 -- 172.21.15.159:0/1159394299 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 10) ==== 99315+0+0 (secure 0 0 0) 0x7f9dc80053e0 con 0x7f9dcc06d670 2024-07-24T16:25:21.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.552+0000 7f9dbdffb640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f9db0077210 0x7f9db00796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:21.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.553+0000 7f9dbdffb640 1 -- 172.21.15.159:0/1159394299 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7f9dc80b9e00 con 0x7f9dcc06d670 2024-07-24T16:25:21.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.553+0000 7f9dd0ba1640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f9db0077210 0x7f9db00796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:21.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.553+0000 7f9dd0ba1640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f9db0077210 0x7f9db00796d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0b21f0 tx=0x7f9dc0005f90 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:21.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.557+0000 7f9dbdffb640 1 -- 172.21.15.159:0/1159394299 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f9dc803f030 con 0x7f9dcc06d670 2024-07-24T16:25:21.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.762+0000 7f9dd3606640 1 -- 172.21.15.159:0/1159394299 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir8", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f9dcc1584d0 con 0x7f9db0077210 2024-07-24T16:25:21.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.809+0000 7f9dbdffb640 1 -- 172.21.15.159:0/1159394299 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f9dcc1584d0 con 0x7f9db0077210 2024-07-24T16:25:21.812 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule activated for path /snap_test_dir1/dir8 2024-07-24T16:25:21.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.812+0000 7f9dd3606640 1 -- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f9db0077210 msgr2=0x7f9db00796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.812+0000 7f9dd3606640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f9db0077210 0x7f9db00796d0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc0b21f0 tx=0x7f9dc0005f90 comp rx=0 tx=0).stop 2024-07-24T16:25:21.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.812+0000 7f9dd3606640 1 -- 172.21.15.159:0/1159394299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc06d670 msgr2=0x7f9dcc142290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.812+0000 7f9dd3606640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc06d670 0x7f9dcc142290 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9dc802ab20 tx=0x7f9dc8033c20 comp rx=0 tx=0).stop 2024-07-24T16:25:21.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.812+0000 7f9dd3606640 1 -- 172.21.15.159:0/1159394299 shutdown_connections 2024-07-24T16:25:21.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.812+0000 7f9dd3606640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f9db0077210 0x7f9db00796d0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.812+0000 7f9dd3606640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9dcc158fe0 0x7f9dcc1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.812+0000 7f9dd3606640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9dcc0cf860 0x7f9dcc0af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.812+0000 7f9dd3606640 1 --2- 172.21.15.159:0/1159394299 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9dcc06d670 0x7f9dcc142290 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.812+0000 7f9dd3606640 1 -- 172.21.15.159:0/1159394299 >> 172.21.15.159:0/1159394299 conn(0x7f9dcc06c560 msgr2=0x7f9dcc0cb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:21.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.812+0000 7f9dd3606640 1 -- 172.21.15.159:0/1159394299 shutdown_connections 2024-07-24T16:25:21.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.812+0000 7f9dd3606640 1 -- 172.21.15.159:0/1159394299 wait complete. 2024-07-24T16:25:21.825 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir8 2024-07-24T16:25:21.825 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule activate /snap_test_dir1/dir9 1m 2024-07-24T16:25:21.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.929+0000 7fdadff2c640 1 -- 172.21.15.159:0/1047521787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad80cee10 msgr2=0x7fdad80d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.929+0000 7fdadff2c640 1 --2- 172.21.15.159:0/1047521787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad80cee10 0x7fdad80d08a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009900 tx=0x7fdad402a580 comp rx=0 tx=0).stop 2024-07-24T16:25:21.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.929+0000 7fdadff2c640 1 -- 172.21.15.159:0/1047521787 shutdown_connections 2024-07-24T16:25:21.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.929+0000 7fdadff2c640 1 --2- 172.21.15.159:0/1047521787 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdad8071ca0 0x7fdad80b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.929+0000 7fdadff2c640 1 --2- 172.21.15.159:0/1047521787 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad80cee10 0x7fdad80d08a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.929+0000 7fdadff2c640 1 -- 172.21.15.159:0/1047521787 >> 172.21.15.159:0/1047521787 conn(0x7fdad80b36f0 msgr2=0x7fdad80b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:21.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.929+0000 7fdadff2c640 1 -- 172.21.15.159:0/1047521787 shutdown_connections 2024-07-24T16:25:21.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.929+0000 7fdadff2c640 1 -- 172.21.15.159:0/1047521787 wait complete. 2024-07-24T16:25:21.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.930+0000 7fdadff2c640 1 Processor -- start 2024-07-24T16:25:21.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.930+0000 7fdadff2c640 1 -- start start 2024-07-24T16:25:21.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdadff2c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad80707c0 0x7fdad813e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:21.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdadff2c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad8071ca0 0x7fdad81f3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:21.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdadff2c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdad80cee10 0x7fdad814b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:21.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdadff2c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdad80b5b10 con 0x7fdad80707c0 2024-07-24T16:25:21.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdadff2c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdad80b5990 con 0x7fdad8071ca0 2024-07-24T16:25:21.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdadff2c640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdad80b5c90 con 0x7fdad80cee10 2024-07-24T16:25:21.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdaddcc8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad80707c0 0x7fdad813e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:21.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdaddcc8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad80707c0 0x7fdad813e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:59544/0 (socket says 172.21.15.159:59544) 2024-07-24T16:25:21.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdaddcc8640 1 -- 172.21.15.159:0/1180220034 learned_addr learned my addr 172.21.15.159:0/1180220034 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:25:21.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdadd4c7640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad8071ca0 0x7fdad81f3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:21.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdade4c9640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdad80cee10 0x7fdad814b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:21.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdaddcc8640 1 -- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdad80cee10 msgr2=0x7fdad814b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdaddcc8640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdad80cee10 0x7fdad814b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdaddcc8640 1 -- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad8071ca0 msgr2=0x7fdad81f3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:21.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdaddcc8640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad8071ca0 0x7fdad81f3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:21.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdaddcc8640 1 -- 172.21.15.159:0/1180220034 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad814bbc0 con 0x7fdad80707c0 2024-07-24T16:25:21.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdaddcc8640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad80707c0 0x7fdad813e080 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000c00 tx=0x7fdad4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:21.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdace7fc640 1 -- 172.21.15.159:0/1180220034 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad403f070 con 0x7fdad80707c0 2024-07-24T16:25:21.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdace7fc640 1 -- 172.21.15.159:0/1180220034 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdad40047a0 con 0x7fdad80707c0 2024-07-24T16:25:21.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdace7fc640 1 -- 172.21.15.159:0/1180220034 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdad4035030 con 0x7fdad80707c0 2024-07-24T16:25:21.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdadff2c640 1 -- 172.21.15.159:0/1180220034 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad814a5e0 con 0x7fdad80707c0 2024-07-24T16:25:21.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.931+0000 7fdadff2c640 1 -- 172.21.15.159:0/1180220034 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad814aba0 con 0x7fdad80707c0 2024-07-24T16:25:21.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.933+0000 7fdadff2c640 1 -- 172.21.15.159:0/1180220034 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdad80b6970 con 0x7fdad80707c0 2024-07-24T16:25:21.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.933+0000 7fdace7fc640 1 -- 172.21.15.159:0/1180220034 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 10) ==== 99315+0+0 (secure 0 0 0) 0x7fdad4042070 con 0x7fdad80707c0 2024-07-24T16:25:21.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.933+0000 7fdace7fc640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fdabc077210 0x7fdabc0796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:25:21.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.934+0000 7fdace7fc640 1 -- 172.21.15.159:0/1180220034 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6359+0+0 (secure 0 0 0) 0x7fdad40b9c50 con 0x7fdad80707c0 2024-07-24T16:25:21.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.934+0000 7fdadd4c7640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fdabc077210 0x7fdabc0796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:25:21.937 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.934+0000 7fdadd4c7640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fdabc077210 0x7fdabc0796d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdad81503b0 tx=0x7fdac8009040 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:25:21.940 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:21.938+0000 7fdace7fc640 1 -- 172.21.15.159:0/1180220034 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fdad40bf020 con 0x7fdad80707c0 2024-07-24T16:25:22.148 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.145+0000 7fdadff2c640 1 -- 172.21.15.159:0/1180220034 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule activate", "path": "/snap_test_dir1/dir9", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fdad81f3540 con 0x7fdabc077210 2024-07-24T16:25:22.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.188+0000 7fdace7fc640 1 -- 172.21.15.159:0/1180220034 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fdac8001440 con 0x7fdabc077210 2024-07-24T16:25:22.191 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule activated for path /snap_test_dir1/dir9 2024-07-24T16:25:22.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.190+0000 7fdadff2c640 1 -- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fdabc077210 msgr2=0x7fdabc0796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:22.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.190+0000 7fdadff2c640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fdabc077210 0x7fdabc0796d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fdad81503b0 tx=0x7fdac8009040 comp rx=0 tx=0).stop 2024-07-24T16:25:22.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.190+0000 7fdadff2c640 1 -- 172.21.15.159:0/1180220034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad80707c0 msgr2=0x7fdad813e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:25:22.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.190+0000 7fdadff2c640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad80707c0 0x7fdad813e080 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fdad4000c00 tx=0x7fdad4003910 comp rx=0 tx=0).stop 2024-07-24T16:25:22.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.190+0000 7fdadff2c640 1 -- 172.21.15.159:0/1180220034 shutdown_connections 2024-07-24T16:25:22.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.190+0000 7fdadff2c640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fdabc077210 0x7fdabc0796d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:22.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.190+0000 7fdadff2c640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdad80cee10 0x7fdad814b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:22.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.190+0000 7fdadff2c640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdad8071ca0 0x7fdad81f3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:22.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.190+0000 7fdadff2c640 1 --2- 172.21.15.159:0/1180220034 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdad80707c0 0x7fdad813e080 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:25:22.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.190+0000 7fdadff2c640 1 -- 172.21.15.159:0/1180220034 >> 172.21.15.159:0/1180220034 conn(0x7fdad80b36f0 msgr2=0x7fdad815d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:25:22.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.190+0000 7fdadff2c640 1 -- 172.21.15.159:0/1180220034 shutdown_connections 2024-07-24T16:25:22.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:25:22.190+0000 7fdadff2c640 1 -- 172.21.15.159:0/1180220034 wait complete. 2024-07-24T16:25:22.204 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule activated for path /snap_test_dir1/dir9 2024-07-24T16:25:40.481 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:25:40.484 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:26:00.047 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:26:00.044+0000 7f36792b1640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:26:00.047 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:26:00.044+0000 7f36792b1640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:26:00.047 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:26:00.044+0000 7f36792b1640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:26:00.047 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:26:00.044+0000 7f36792b1640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:26:00.047 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:26:00.044+0000 7f36792b1640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:26:10.629 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:26:10.633 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:26:40.914 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:26:40.918 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:27:11.045 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:27:11.048 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:27:41.136 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:27:41.140 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:28:11.274 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:28:11.277 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:28:41.337 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:28:41.341 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:29:11.467 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:29:11.470 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:29:41.567 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:29:41.571 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:30:11.702 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:30:11.705 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:30:41.811 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:30:41.814 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:31:00.525 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:31:00.523+0000 7f36782af640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:31:00.525 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:31:00.523+0000 7f36782af640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:31:00.525 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:31:00.523+0000 7f36782af640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:31:00.526 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:31:00.523+0000 7f36782af640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:31:00.526 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:31:00.523+0000 7f36782af640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:31:11.985 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:31:11.988 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:31:42.095 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:31:42.099 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:32:12.272 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:32:12.275 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:32:42.368 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:32:42.372 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:33:12.502 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:33:12.505 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:33:42.660 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:33:42.663 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:34:12.747 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:34:12.751 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:34:42.990 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:34:42.994 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:35:13.054 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:35:13.057 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:35:43.197 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:35:43.200 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:36:13.292 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:36:13.295 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:36:19.204 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir0 1m 2024-07-24T16:36:19.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.322+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/3061149125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a78150cc0 msgr2=0x7f0a7815ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:19.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.322+0000 7f0a7f0fd640 1 --2- 172.21.15.159:0/3061149125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a78150cc0 0x7f0a7815ad80 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f0a780d0430 tx=0x7f0a6802a3f0 comp rx=0 tx=0).stop 2024-07-24T16:36:19.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.322+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/3061149125 shutdown_connections 2024-07-24T16:36:19.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.322+0000 7f0a7f0fd640 1 --2- 172.21.15.159:0/3061149125 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a7806d670 0x7f0a7806dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:19.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.322+0000 7f0a7f0fd640 1 --2- 172.21.15.159:0/3061149125 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a78150cc0 0x7f0a7815ad80 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:19.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.322+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/3061149125 >> 172.21.15.159:0/3061149125 conn(0x7f0a7806c560 msgr2=0x7f0a7806c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:19.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.322+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/3061149125 shutdown_connections 2024-07-24T16:36:19.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.322+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/3061149125 wait complete. 2024-07-24T16:36:19.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.323+0000 7f0a7f0fd640 1 Processor -- start 2024-07-24T16:36:19.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.323+0000 7f0a7f0fd640 1 -- start start 2024-07-24T16:36:19.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.324+0000 7f0a7f0fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a7806d670 0x7f0a78145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:19.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.324+0000 7f0a7f0fd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a780b41d0 0x7f0a78072ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:19.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.324+0000 7f0a7f0fd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a78150cc0 0x7f0a78073020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:19.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.324+0000 7f0a7f0fd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0a780cf840 con 0x7f0a78150cc0 2024-07-24T16:36:19.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.324+0000 7f0a7f0fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0a780cf6c0 con 0x7f0a7806d670 2024-07-24T16:36:19.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.324+0000 7f0a7f0fd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0a780cf9c0 con 0x7f0a780b41d0 2024-07-24T16:36:19.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.324+0000 7f0a7d69a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a78150cc0 0x7f0a78073020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:19.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.324+0000 7f0a7d69a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a78150cc0 0x7f0a78073020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53220/0 (socket says 172.21.15.159:53220) 2024-07-24T16:36:19.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.324+0000 7f0a7d69a640 1 -- 172.21.15.159:0/2800736441 learned_addr learned my addr 172.21.15.159:0/2800736441 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:19.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.325+0000 7f0a7ce99640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a7806d670 0x7f0a78145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:19.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.325+0000 7f0a77fff640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a780b41d0 0x7f0a78072ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:19.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.325+0000 7f0a7d69a640 1 -- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a780b41d0 msgr2=0x7f0a78072ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:19.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.325+0000 7f0a7d69a640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a780b41d0 0x7f0a78072ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:19.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.325+0000 7f0a7d69a640 1 -- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a7806d670 msgr2=0x7f0a78145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:19.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.325+0000 7f0a7d69a640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a7806d670 0x7f0a78145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:19.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.325+0000 7f0a7d69a640 1 -- 172.21.15.159:0/2800736441 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7814a610 con 0x7f0a78150cc0 2024-07-24T16:36:19.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.325+0000 7f0a7d69a640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a78150cc0 0x7f0a78073020 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000cce0 tx=0x7f0a7000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:19.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.325+0000 7f0a757fa640 1 -- 172.21.15.159:0/2800736441 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7000f450 con 0x7f0a78150cc0 2024-07-24T16:36:19.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.325+0000 7f0a757fa640 1 -- 172.21.15.159:0/2800736441 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a7000f700 con 0x7f0a78150cc0 2024-07-24T16:36:19.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.325+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/2800736441 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7814a8f0 con 0x7f0a78150cc0 2024-07-24T16:36:19.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.325+0000 7f0a757fa640 1 -- 172.21.15.159:0/2800736441 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7000fb50 con 0x7f0a78150cc0 2024-07-24T16:36:19.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.325+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/2800736441 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a7814aeb0 con 0x7f0a78150cc0 2024-07-24T16:36:19.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.326+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/2800736441 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a7806dae0 con 0x7f0a78150cc0 2024-07-24T16:36:19.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.327+0000 7f0a757fa640 1 -- 172.21.15.159:0/2800736441 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f0a7000fcf0 con 0x7f0a78150cc0 2024-07-24T16:36:19.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.327+0000 7f0a757fa640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0a64077210 0x7f0a640796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:19.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.327+0000 7f0a757fa640 1 -- 172.21.15.159:0/2800736441 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f0a700999a0 con 0x7f0a78150cc0 2024-07-24T16:36:19.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.327+0000 7f0a7ce99640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0a64077210 0x7f0a640796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:19.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.328+0000 7f0a7ce99640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0a64077210 0x7f0a640796d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0a68033000 tx=0x7f0a68004730 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:19.334 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.331+0000 7f0a757fa640 1 -- 172.21.15.159:0/2800736441 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f0a70014030 con 0x7f0a78150cc0 2024-07-24T16:36:19.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.539+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/2800736441 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir0", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f0a7815b820 con 0x7f0a64077210 2024-07-24T16:36:19.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.611+0000 7f0a757fa640 1 -- 172.21.15.159:0/2800736441 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f0a7815b820 con 0x7f0a64077210 2024-07-24T16:36:19.613 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule deactivated for path /snap_test_dir1/dir0 2024-07-24T16:36:19.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.613+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0a64077210 msgr2=0x7f0a640796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:19.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.613+0000 7f0a7f0fd640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0a64077210 0x7f0a640796d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0a68033000 tx=0x7f0a68004730 comp rx=0 tx=0).stop 2024-07-24T16:36:19.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.613+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/2800736441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a78150cc0 msgr2=0x7f0a78073020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:19.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.613+0000 7f0a7f0fd640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a78150cc0 0x7f0a78073020 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0a7000cce0 tx=0x7f0a7000a620 comp rx=0 tx=0).stop 2024-07-24T16:36:19.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.613+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/2800736441 shutdown_connections 2024-07-24T16:36:19.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.613+0000 7f0a7f0fd640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0a64077210 0x7f0a640796d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:19.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.613+0000 7f0a7f0fd640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0a78150cc0 0x7f0a78073020 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:19.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.613+0000 7f0a7f0fd640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0a780b41d0 0x7f0a78072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:19.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.613+0000 7f0a7f0fd640 1 --2- 172.21.15.159:0/2800736441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0a7806d670 0x7f0a78145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:19.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.613+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/2800736441 >> 172.21.15.159:0/2800736441 conn(0x7f0a7806c560 msgr2=0x7f0a78165170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:19.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.613+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/2800736441 shutdown_connections 2024-07-24T16:36:19.617 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.613+0000 7f0a7f0fd640 1 -- 172.21.15.159:0/2800736441 wait complete. 2024-07-24T16:36:19.626 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir0 2024-07-24T16:36:19.626 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir1 1m 2024-07-24T16:36:19.733 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.731+0000 7fa604838640 1 -- 172.21.15.159:0/2859536810 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6000cf770 msgr2=0x7fa60015b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:19.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.731+0000 7fa604838640 1 --2- 172.21.15.159:0/2859536810 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6000cf770 0x7fa60015b4b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0009900 tx=0x7fa5f002a610 comp rx=0 tx=0).stop 2024-07-24T16:36:19.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.731+0000 7fa604838640 1 -- 172.21.15.159:0/2859536810 shutdown_connections 2024-07-24T16:36:19.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.731+0000 7fa604838640 1 --2- 172.21.15.159:0/2859536810 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6000cfb50 0x7fa6000cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:19.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.731+0000 7fa604838640 1 --2- 172.21.15.159:0/2859536810 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6000cf770 0x7fa60015b4b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:19.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.731+0000 7fa604838640 1 -- 172.21.15.159:0/2859536810 >> 172.21.15.159:0/2859536810 conn(0x7fa60006c560 msgr2=0x7fa60006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:19.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.731+0000 7fa604838640 1 -- 172.21.15.159:0/2859536810 shutdown_connections 2024-07-24T16:36:19.734 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.731+0000 7fa604838640 1 -- 172.21.15.159:0/2859536810 wait complete. 2024-07-24T16:36:19.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.732+0000 7fa604838640 1 Processor -- start 2024-07-24T16:36:19.735 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.732+0000 7fa604838640 1 -- start start 2024-07-24T16:36:19.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa604838640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa60006dba0 0x7fa60014df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:19.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa604838640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6000cf770 0x7fa6000a9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:19.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa604838640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6000cfb50 0x7fa6000aa040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:19.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa604838640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa6000aeab0 con 0x7fa60006dba0 2024-07-24T16:36:19.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa604838640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa6000ae930 con 0x7fa6000cf770 2024-07-24T16:36:19.737 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa604838640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa6000aec30 con 0x7fa6000cfb50 2024-07-24T16:36:19.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa5fe59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa60006dba0 0x7fa60014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:19.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa5fe59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa60006dba0 0x7fa60014df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53238/0 (socket says 172.21.15.159:53238) 2024-07-24T16:36:19.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa5fe59c640 1 -- 172.21.15.159:0/2919225407 learned_addr learned my addr 172.21.15.159:0/2919225407 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:19.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa5fdd9b640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6000cf770 0x7fa6000a9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:19.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa5fed9d640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6000cfb50 0x7fa6000aa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:19.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa5fe59c640 1 -- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6000cfb50 msgr2=0x7fa6000aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:19.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa5fe59c640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6000cfb50 0x7fa6000aa040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:19.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa5fe59c640 1 -- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6000cf770 msgr2=0x7fa6000a9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:19.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa5fe59c640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6000cf770 0x7fa6000a9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:19.738 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa5fe59c640 1 -- 172.21.15.159:0/2919225407 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6001f1300 con 0x7fa60006dba0 2024-07-24T16:36:19.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.733+0000 7fa5fe59c640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa60006dba0 0x7fa60014df30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0000c00 tx=0x7fa5f0003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:19.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.734+0000 7fa5f6ffd640 1 -- 172.21.15.159:0/2919225407 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0035070 con 0x7fa60006dba0 2024-07-24T16:36:19.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.734+0000 7fa5f6ffd640 1 -- 172.21.15.159:0/2919225407 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5f0005600 con 0x7fa60006dba0 2024-07-24T16:36:19.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.734+0000 7fa5f6ffd640 1 -- 172.21.15.159:0/2919225407 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f0003e00 con 0x7fa60006dba0 2024-07-24T16:36:19.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.734+0000 7fa604838640 1 -- 172.21.15.159:0/2919225407 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6001f5660 con 0x7fa60006dba0 2024-07-24T16:36:19.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.734+0000 7fa604838640 1 -- 172.21.15.159:0/2919225407 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6001f18a0 con 0x7fa60006dba0 2024-07-24T16:36:19.739 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.735+0000 7fa604838640 1 -- 172.21.15.159:0/2919225407 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60015b4b0 con 0x7fa60006dba0 2024-07-24T16:36:19.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.735+0000 7fa5f6ffd640 1 -- 172.21.15.159:0/2919225407 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7fa5f0038470 con 0x7fa60006dba0 2024-07-24T16:36:19.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.736+0000 7fa5f6ffd640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa5e0077210 0x7fa5e00796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:19.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.736+0000 7fa5f6ffd640 1 -- 172.21.15.159:0/2919225407 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7fa5f00bb190 con 0x7fa60006dba0 2024-07-24T16:36:19.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.736+0000 7fa5fdd9b640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa5e0077210 0x7fa5e00796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:19.740 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.737+0000 7fa5fdd9b640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa5e0077210 0x7fa5e00796d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa6001541b0 tx=0x7fa5e8009040 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:19.742 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.741+0000 7fa5f6ffd640 1 -- 172.21.15.159:0/2919225407 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa5f0083e70 con 0x7fa60006dba0 2024-07-24T16:36:19.948 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:19.945+0000 7fa604838640 1 -- 172.21.15.159:0/2919225407 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir1", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa60015a720 con 0x7fa5e0077210 2024-07-24T16:36:20.019 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.018+0000 7fa5f6ffd640 1 -- 172.21.15.159:0/2919225407 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fa60015a720 con 0x7fa5e0077210 2024-07-24T16:36:20.019 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule deactivated for path /snap_test_dir1/dir1 2024-07-24T16:36:20.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.020+0000 7fa604838640 1 -- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa5e0077210 msgr2=0x7fa5e00796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.020+0000 7fa604838640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa5e0077210 0x7fa5e00796d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa6001541b0 tx=0x7fa5e8009040 comp rx=0 tx=0).stop 2024-07-24T16:36:20.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.020+0000 7fa604838640 1 -- 172.21.15.159:0/2919225407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa60006dba0 msgr2=0x7fa60014df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.020+0000 7fa604838640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa60006dba0 0x7fa60014df30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fa5f0000c00 tx=0x7fa5f0003820 comp rx=0 tx=0).stop 2024-07-24T16:36:20.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.020+0000 7fa604838640 1 -- 172.21.15.159:0/2919225407 shutdown_connections 2024-07-24T16:36:20.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.020+0000 7fa604838640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa5e0077210 0x7fa5e00796d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.020+0000 7fa604838640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6000cfb50 0x7fa6000aa040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.020+0000 7fa604838640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6000cf770 0x7fa6000a9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.020+0000 7fa604838640 1 --2- 172.21.15.159:0/2919225407 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa60006dba0 0x7fa60014df30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.020+0000 7fa604838640 1 -- 172.21.15.159:0/2919225407 >> 172.21.15.159:0/2919225407 conn(0x7fa60006c560 msgr2=0x7fa6000cb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:20.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.020+0000 7fa604838640 1 -- 172.21.15.159:0/2919225407 shutdown_connections 2024-07-24T16:36:20.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.020+0000 7fa604838640 1 -- 172.21.15.159:0/2919225407 wait complete. 2024-07-24T16:36:20.032 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir1 2024-07-24T16:36:20.032 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir2 1m 2024-07-24T16:36:20.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.137+0000 7f76d1ce9640 1 -- 172.21.15.159:0/3653268872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc06d670 msgr2=0x7f76cc06db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.137+0000 7f76d1ce9640 1 --2- 172.21.15.159:0/3653268872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc06d670 0x7f76cc06db00 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0d0430 tx=0x7f76c402a440 comp rx=0 tx=0).stop 2024-07-24T16:36:20.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.137+0000 7f76d1ce9640 1 -- 172.21.15.159:0/3653268872 shutdown_connections 2024-07-24T16:36:20.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.137+0000 7f76d1ce9640 1 --2- 172.21.15.159:0/3653268872 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc06d670 0x7f76cc06db00 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.137+0000 7f76d1ce9640 1 --2- 172.21.15.159:0/3653268872 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f76cc0b41d0 0x7f76cc0b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.137+0000 7f76d1ce9640 1 --2- 172.21.15.159:0/3653268872 >> v2:172.21.15.193:3300/0 conn(0x7f76cc150cc0 0x7f76cc15ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.137+0000 7f76d1ce9640 1 -- 172.21.15.159:0/3653268872 >> 172.21.15.159:0/3653268872 conn(0x7f76cc06c560 msgr2=0x7f76cc06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:20.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.137+0000 7f76d1ce9640 1 -- 172.21.15.159:0/3653268872 shutdown_connections 2024-07-24T16:36:20.139 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.137+0000 7f76d1ce9640 1 -- 172.21.15.159:0/3653268872 wait complete. 2024-07-24T16:36:20.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.138+0000 7f76d1ce9640 1 Processor -- start 2024-07-24T16:36:20.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.138+0000 7f76d1ce9640 1 -- start start 2024-07-24T16:36:20.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76d1ce9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76cc06d670 0x7f76cc1563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:20.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76d1ce9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f76cc0b41d0 0x7f76cc157e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:20.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76d1ce9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc150cc0 0x7f76cc072b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:20.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76d1ce9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc0cf630 con 0x7f76cc150cc0 2024-07-24T16:36:20.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76d1ce9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f76cc0cf4b0 con 0x7f76cc06d670 2024-07-24T16:36:20.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76d1ce9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f76cc0cf7b0 con 0x7f76cc0b41d0 2024-07-24T16:36:20.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc150cc0 0x7f76cc072b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:20.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76cbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc150cc0 0x7f76cc072b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53242/0 (socket says 172.21.15.159:53242) 2024-07-24T16:36:20.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76cbfff640 1 -- 172.21.15.159:0/1773455640 learned_addr learned my addr 172.21.15.159:0/1773455640 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:20.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76cb7fe640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76cc06d670 0x7f76cc1563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:20.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76caffd640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f76cc0b41d0 0x7f76cc157e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:20.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76cbfff640 1 -- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f76cc0b41d0 msgr2=0x7f76cc157e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76cbfff640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f76cc0b41d0 0x7f76cc157e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76cbfff640 1 -- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76cc06d670 msgr2=0x7f76cc1563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76cbfff640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76cc06d670 0x7f76cc1563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76cbfff640 1 -- 172.21.15.159:0/1773455640 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76cc159830 con 0x7f76cc150cc0 2024-07-24T16:36:20.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.139+0000 7f76cbfff640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc150cc0 0x7f76cc072b80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f76c40099c0 tx=0x7f76c4003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:20.143 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.140+0000 7f76b3fff640 1 -- 172.21.15.159:0/1773455640 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c403f070 con 0x7f76cc150cc0 2024-07-24T16:36:20.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.140+0000 7f76b3fff640 1 -- 172.21.15.159:0/1773455640 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76c40047a0 con 0x7f76cc150cc0 2024-07-24T16:36:20.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.140+0000 7f76b3fff640 1 -- 172.21.15.159:0/1773455640 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4035030 con 0x7f76cc150cc0 2024-07-24T16:36:20.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.140+0000 7f76d1ce9640 1 -- 172.21.15.159:0/1773455640 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76cc158790 con 0x7f76cc150cc0 2024-07-24T16:36:20.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.140+0000 7f76d1ce9640 1 -- 172.21.15.159:0/1773455640 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76cc158d50 con 0x7f76cc150cc0 2024-07-24T16:36:20.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.141+0000 7f76d1ce9640 1 -- 172.21.15.159:0/1773455640 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76cc0b3850 con 0x7f76cc150cc0 2024-07-24T16:36:20.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.141+0000 7f76b3fff640 1 -- 172.21.15.159:0/1773455640 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f76c4042070 con 0x7f76cc150cc0 2024-07-24T16:36:20.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.142+0000 7f76b3fff640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f76b8077210 0x7f76b80796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:20.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.142+0000 7f76b3fff640 1 -- 172.21.15.159:0/1773455640 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f76c40b9c00 con 0x7f76cc150cc0 2024-07-24T16:36:20.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.142+0000 7f76cb7fe640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f76b8077210 0x7f76b80796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:20.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.142+0000 7f76cb7fe640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f76b8077210 0x7f76b80796d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f76bc005fd0 tx=0x7f76bc0095e0 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:20.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.145+0000 7f76b3fff640 1 -- 172.21.15.159:0/1773455640 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f76c40c0080 con 0x7f76cc150cc0 2024-07-24T16:36:20.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.351+0000 7f76d1ce9640 1 -- 172.21.15.159:0/1773455640 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir2", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f76cc1594d0 con 0x7f76b8077210 2024-07-24T16:36:20.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.434+0000 7f76b3fff640 1 -- 172.21.15.159:0/1773455640 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f76cc1594d0 con 0x7f76b8077210 2024-07-24T16:36:20.436 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule deactivated for path /snap_test_dir1/dir2 2024-07-24T16:36:20.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.436+0000 7f76d1ce9640 1 -- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f76b8077210 msgr2=0x7f76b80796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.436+0000 7f76d1ce9640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f76b8077210 0x7f76b80796d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f76bc005fd0 tx=0x7f76bc0095e0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.437+0000 7f76d1ce9640 1 -- 172.21.15.159:0/1773455640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc150cc0 msgr2=0x7f76cc072b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.437+0000 7f76d1ce9640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc150cc0 0x7f76cc072b80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f76c40099c0 tx=0x7f76c4003960 comp rx=0 tx=0).stop 2024-07-24T16:36:20.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.437+0000 7f76d1ce9640 1 -- 172.21.15.159:0/1773455640 shutdown_connections 2024-07-24T16:36:20.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.437+0000 7f76d1ce9640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f76b8077210 0x7f76b80796d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.437+0000 7f76d1ce9640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f76cc150cc0 0x7f76cc072b80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.437+0000 7f76d1ce9640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f76cc0b41d0 0x7f76cc157e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.437+0000 7f76d1ce9640 1 --2- 172.21.15.159:0/1773455640 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f76cc06d670 0x7f76cc1563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.437+0000 7f76d1ce9640 1 -- 172.21.15.159:0/1773455640 >> 172.21.15.159:0/1773455640 conn(0x7f76cc06c560 msgr2=0x7f76cc15c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:20.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.437+0000 7f76d1ce9640 1 -- 172.21.15.159:0/1773455640 shutdown_connections 2024-07-24T16:36:20.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.437+0000 7f76d1ce9640 1 -- 172.21.15.159:0/1773455640 wait complete. 2024-07-24T16:36:20.449 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir2 2024-07-24T16:36:20.449 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir3 1m 2024-07-24T16:36:20.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.554+0000 7f9944b40640 1 -- 172.21.15.159:0/601661987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9940150cc0 msgr2=0x7f994015ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.554+0000 7f9944b40640 1 --2- 172.21.15.159:0/601661987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9940150cc0 0x7f994015ad80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f9930005fd0 tx=0x7f993002baa0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.554+0000 7f9944b40640 1 -- 172.21.15.159:0/601661987 shutdown_connections 2024-07-24T16:36:20.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.554+0000 7f9944b40640 1 --2- 172.21.15.159:0/601661987 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99400b41d0 0x7f99400b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.554+0000 7f9944b40640 1 --2- 172.21.15.159:0/601661987 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9940150cc0 0x7f994015ad80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.554+0000 7f9944b40640 1 -- 172.21.15.159:0/601661987 >> 172.21.15.159:0/601661987 conn(0x7f994006c560 msgr2=0x7f994006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:20.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.554+0000 7f9944b40640 1 -- 172.21.15.159:0/601661987 shutdown_connections 2024-07-24T16:36:20.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.554+0000 7f9944b40640 1 -- 172.21.15.159:0/601661987 wait complete. 2024-07-24T16:36:20.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.555+0000 7f9944b40640 1 Processor -- start 2024-07-24T16:36:20.557 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.555+0000 7f9944b40640 1 -- start start 2024-07-24T16:36:20.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.556+0000 7f9944b40640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f994006d670 0x7f9940140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:20.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.556+0000 7f9944b40640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99400b41d0 0x7f994014f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:20.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.556+0000 7f9944b40640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9940150cc0 0x7f994014ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:20.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.556+0000 7f9944b40640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f99400724a0 con 0x7f9940150cc0 2024-07-24T16:36:20.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.556+0000 7f9944b40640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9940072320 con 0x7f994006d670 2024-07-24T16:36:20.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.556+0000 7f9944b40640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f994006db00 con 0x7f99400b41d0 2024-07-24T16:36:20.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.556+0000 7f993ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9940150cc0 0x7f994014ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:20.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.556+0000 7f993ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9940150cc0 0x7f994014ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53272/0 (socket says 172.21.15.159:53272) 2024-07-24T16:36:20.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.556+0000 7f993ed9d640 1 -- 172.21.15.159:0/13035850 learned_addr learned my addr 172.21.15.159:0/13035850 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:20.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.556+0000 7f993dd9b640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99400b41d0 0x7f994014f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:20.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.556+0000 7f993e59c640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f994006d670 0x7f9940140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:20.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.557+0000 7f993ed9d640 1 -- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99400b41d0 msgr2=0x7f994014f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.557+0000 7f993ed9d640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99400b41d0 0x7f994014f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.557+0000 7f993ed9d640 1 -- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f994006d670 msgr2=0x7f9940140e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.557+0000 7f993ed9d640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f994006d670 0x7f9940140e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.557+0000 7f993ed9d640 1 -- 172.21.15.159:0/13035850 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99400b0b30 con 0x7f9940150cc0 2024-07-24T16:36:20.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.557+0000 7f993ed9d640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9940150cc0 0x7f994014ff30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f993800c430 tx=0x7f993800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:20.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.557+0000 7f9936ffd640 1 -- 172.21.15.159:0/13035850 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938017070 con 0x7f9940150cc0 2024-07-24T16:36:20.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.557+0000 7f9936ffd640 1 -- 172.21.15.159:0/13035850 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99380035f0 con 0x7f9940150cc0 2024-07-24T16:36:20.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.557+0000 7f9944b40640 1 -- 172.21.15.159:0/13035850 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99401e5950 con 0x7f9940150cc0 2024-07-24T16:36:20.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.557+0000 7f9936ffd640 1 -- 172.21.15.159:0/13035850 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938003a40 con 0x7f9940150cc0 2024-07-24T16:36:20.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.557+0000 7f9944b40640 1 -- 172.21.15.159:0/13035850 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99401413a0 con 0x7f9940150cc0 2024-07-24T16:36:20.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.558+0000 7f9944b40640 1 -- 172.21.15.159:0/13035850 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99400b3830 con 0x7f9940150cc0 2024-07-24T16:36:20.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.558+0000 7f9936ffd640 1 -- 172.21.15.159:0/13035850 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f993801a070 con 0x7f9940150cc0 2024-07-24T16:36:20.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.559+0000 7f9936ffd640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f9920077240 0x7f9920079700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:20.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.559+0000 7f9936ffd640 1 -- 172.21.15.159:0/13035850 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f9938098040 con 0x7f9940150cc0 2024-07-24T16:36:20.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.559+0000 7f993e59c640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f9920077240 0x7f9920079700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:20.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.560+0000 7f993e59c640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f9920077240 0x7f9920079700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9930035000 tx=0x7f9930039040 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:20.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.563+0000 7f9936ffd640 1 -- 172.21.15.159:0/13035850 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f9938060890 con 0x7f9940150cc0 2024-07-24T16:36:20.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.770+0000 7f9944b40640 1 -- 172.21.15.159:0/13035850 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir3", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f99400b0e10 con 0x7f9920077240 2024-07-24T16:36:20.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.837+0000 7f9936ffd640 1 -- 172.21.15.159:0/13035850 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f99400b0e10 con 0x7f9920077240 2024-07-24T16:36:20.840 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule deactivated for path /snap_test_dir1/dir3 2024-07-24T16:36:20.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.839+0000 7f9944b40640 1 -- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f9920077240 msgr2=0x7f9920079700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.839+0000 7f9944b40640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f9920077240 0x7f9920079700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9930035000 tx=0x7f9930039040 comp rx=0 tx=0).stop 2024-07-24T16:36:20.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.839+0000 7f9944b40640 1 -- 172.21.15.159:0/13035850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9940150cc0 msgr2=0x7f994014ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.839+0000 7f9944b40640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9940150cc0 0x7f994014ff30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f993800c430 tx=0x7f993800c8f0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.839+0000 7f9944b40640 1 -- 172.21.15.159:0/13035850 shutdown_connections 2024-07-24T16:36:20.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.839+0000 7f9944b40640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f9920077240 0x7f9920079700 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.839+0000 7f9944b40640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9940150cc0 0x7f994014ff30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.839+0000 7f9944b40640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f99400b41d0 0x7f994014f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.839+0000 7f9944b40640 1 --2- 172.21.15.159:0/13035850 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f994006d670 0x7f9940140e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.839+0000 7f9944b40640 1 -- 172.21.15.159:0/13035850 >> 172.21.15.159:0/13035850 conn(0x7f994006c560 msgr2=0x7f9940072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:20.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.839+0000 7f9944b40640 1 -- 172.21.15.159:0/13035850 shutdown_connections 2024-07-24T16:36:20.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.839+0000 7f9944b40640 1 -- 172.21.15.159:0/13035850 wait complete. 2024-07-24T16:36:20.852 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir3 2024-07-24T16:36:20.853 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir4 1m 2024-07-24T16:36:20.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.956+0000 7fdeefd72640 1 -- 172.21.15.159:0/3042571832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fded4004d40 msgr2=0x7fded40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.956+0000 7fdeefd72640 1 --2- 172.21.15.159:0/3042571832 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fded4004d40 0x7fded40051c0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fdee0005fd0 tx=0x7fded4005830 comp rx=0 tx=0).stop 2024-07-24T16:36:20.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.956+0000 7fdeee30f640 1 -- 172.21.15.159:0/3042571832 reap_dead start 2024-07-24T16:36:20.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.956+0000 7fdeefd72640 1 -- 172.21.15.159:0/3042571832 shutdown_connections 2024-07-24T16:36:20.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.956+0000 7fdeefd72640 1 -- 172.21.15.159:0/3042571832 >> 172.21.15.159:0/3042571832 conn(0x7fdee806c560 msgr2=0x7fdee806c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:20.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.956+0000 7fdeefd72640 1 -- 172.21.15.159:0/3042571832 shutdown_connections 2024-07-24T16:36:20.959 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.956+0000 7fdeefd72640 1 -- 172.21.15.159:0/3042571832 wait complete. 2024-07-24T16:36:20.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.957+0000 7fdeefd72640 1 Processor -- start 2024-07-24T16:36:20.960 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.957+0000 7fdeefd72640 1 -- start start 2024-07-24T16:36:20.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeefd72640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fded4004d40 0x7fdee81f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:20.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeefd72640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdee8150a10 0x7fdee81f0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:20.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeefd72640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdee81e4e20 0x7fdee815cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:20.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeefd72640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdee80cbfa0 con 0x7fdee8150a10 2024-07-24T16:36:20.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeefd72640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdee80cbe20 con 0x7fded4004d40 2024-07-24T16:36:20.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeefd72640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdee80aebe0 con 0x7fdee81e4e20 2024-07-24T16:36:20.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeed30d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdee8150a10 0x7fdee81f0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:20.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeed30d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdee8150a10 0x7fdee81f0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51104/0 (socket says 172.21.15.159:51104) 2024-07-24T16:36:20.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeed30d640 1 -- 172.21.15.159:0/2379914328 learned_addr learned my addr 172.21.15.159:0/2379914328 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:20.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeedb0e640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fded4004d40 0x7fdee81f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:20.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeee30f640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdee81e4e20 0x7fdee815cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:20.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeed30d640 1 -- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdee81e4e20 msgr2=0x7fdee815cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeed30d640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdee81e4e20 0x7fdee815cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeed30d640 1 -- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fded4004d40 msgr2=0x7fdee81f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:20.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeed30d640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fded4004d40 0x7fdee81f4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:20.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.958+0000 7fdeed30d640 1 -- 172.21.15.159:0/2379914328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee81e3d80 con 0x7fdee8150a10 2024-07-24T16:36:20.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.959+0000 7fdeed30d640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdee8150a10 0x7fdee81f0a80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fded8003f80 tx=0x7fded8001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:20.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.959+0000 7fdede7fc640 1 -- 172.21.15.159:0/2379914328 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8015070 con 0x7fdee8150a10 2024-07-24T16:36:20.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.959+0000 7fdede7fc640 1 -- 172.21.15.159:0/2379914328 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fded8011840 con 0x7fdee8150a10 2024-07-24T16:36:20.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.959+0000 7fdede7fc640 1 -- 172.21.15.159:0/2379914328 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fded8011c50 con 0x7fdee8150a10 2024-07-24T16:36:20.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.959+0000 7fdeefd72640 1 -- 172.21.15.159:0/2379914328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdee81e4060 con 0x7fdee8150a10 2024-07-24T16:36:20.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.959+0000 7fdeefd72640 1 -- 172.21.15.159:0/2379914328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdee81e4620 con 0x7fdee8150a10 2024-07-24T16:36:20.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.960+0000 7fdeefd72640 1 -- 172.21.15.159:0/2379914328 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdee815b4b0 con 0x7fdee8150a10 2024-07-24T16:36:20.964 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.960+0000 7fdede7fc640 1 -- 172.21.15.159:0/2379914328 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7fded8018070 con 0x7fdee8150a10 2024-07-24T16:36:20.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.961+0000 7fdede7fc640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fdecc077210 0x7fdecc0796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:20.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.961+0000 7fdede7fc640 1 -- 172.21.15.159:0/2379914328 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7fded8099a50 con 0x7fdee8150a10 2024-07-24T16:36:20.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.961+0000 7fdeedb0e640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fdecc077210 0x7fdecc0796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:20.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.962+0000 7fdeedb0e640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fdecc077210 0x7fdecc0796d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdee815e510 tx=0x7fdee40067d0 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:20.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:20.965+0000 7fdede7fc640 1 -- 172.21.15.159:0/2379914328 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fded80620e0 con 0x7fdee8150a10 2024-07-24T16:36:21.173 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.170+0000 7fdeefd72640 1 -- 172.21.15.159:0/2379914328 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir4", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fdee8151280 con 0x7fdecc077210 2024-07-24T16:36:21.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.242+0000 7fdede7fc640 1 -- 172.21.15.159:0/2379914328 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fdee40016f0 con 0x7fdecc077210 2024-07-24T16:36:21.245 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule deactivated for path /snap_test_dir1/dir4 2024-07-24T16:36:21.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.244+0000 7fdeefd72640 1 -- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fdecc077210 msgr2=0x7fdecc0796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:21.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.244+0000 7fdeefd72640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fdecc077210 0x7fdecc0796d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdee815e510 tx=0x7fdee40067d0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.244+0000 7fdeefd72640 1 -- 172.21.15.159:0/2379914328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdee8150a10 msgr2=0x7fdee81f0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:21.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.244+0000 7fdeefd72640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdee8150a10 0x7fdee81f0a80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fded8003f80 tx=0x7fded8001630 comp rx=0 tx=0).stop 2024-07-24T16:36:21.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.244+0000 7fdeefd72640 1 -- 172.21.15.159:0/2379914328 shutdown_connections 2024-07-24T16:36:21.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.244+0000 7fdeefd72640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fdecc077210 0x7fdecc0796d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.244+0000 7fdeefd72640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdee81e4e20 0x7fdee815cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.245+0000 7fdeefd72640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdee8150a10 0x7fdee81f0a80 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.245+0000 7fdeefd72640 1 --2- 172.21.15.159:0/2379914328 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fded4004d40 0x7fdee81f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.245+0000 7fdeefd72640 1 -- 172.21.15.159:0/2379914328 >> 172.21.15.159:0/2379914328 conn(0x7fdee806c560 msgr2=0x7fdee80cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:21.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.245+0000 7fdeefd72640 1 -- 172.21.15.159:0/2379914328 shutdown_connections 2024-07-24T16:36:21.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.245+0000 7fdeefd72640 1 -- 172.21.15.159:0/2379914328 wait complete. 2024-07-24T16:36:21.258 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir4 2024-07-24T16:36:21.258 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir5 1m 2024-07-24T16:36:21.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.363+0000 7feb7cd01640 1 -- 172.21.15.159:0/3837276802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb60003a00 msgr2=0x7feb60003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:21.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.363+0000 7feb7cd01640 1 --2- 172.21.15.159:0/3837276802 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb60003a00 0x7feb60003e20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7feb7815e510 tx=0x7feb60005830 comp rx=0 tx=0).stop 2024-07-24T16:36:21.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.363+0000 7feb76d9d640 1 -- 172.21.15.159:0/3837276802 reap_dead start 2024-07-24T16:36:21.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.363+0000 7feb7cd01640 1 -- 172.21.15.159:0/3837276802 shutdown_connections 2024-07-24T16:36:21.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.363+0000 7feb7cd01640 1 -- 172.21.15.159:0/3837276802 >> 172.21.15.159:0/3837276802 conn(0x7feb7806c560 msgr2=0x7feb7806c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:21.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.363+0000 7feb7cd01640 1 -- 172.21.15.159:0/3837276802 shutdown_connections 2024-07-24T16:36:21.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.363+0000 7feb7cd01640 1 -- 172.21.15.159:0/3837276802 wait complete. 2024-07-24T16:36:21.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.365+0000 7feb7cd01640 1 Processor -- start 2024-07-24T16:36:21.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.365+0000 7feb7cd01640 1 -- start start 2024-07-24T16:36:21.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb7cd01640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb60003a00 0x7feb78147050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:21.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb7cd01640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb7815ccf0 0x7feb7815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:21.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb7cd01640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb781484f0 0x7feb78148970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:21.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb7cd01640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7feb780ae650 con 0x7feb7815ccf0 2024-07-24T16:36:21.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb7cd01640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7feb780ae4d0 con 0x7feb781484f0 2024-07-24T16:36:21.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb7cd01640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7feb780ae7d0 con 0x7feb60003a00 2024-07-24T16:36:21.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb75d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb7815ccf0 0x7feb7815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:21.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb75d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb7815ccf0 0x7feb7815d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51132/0 (socket says 172.21.15.159:51132) 2024-07-24T16:36:21.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb75d9b640 1 -- 172.21.15.159:0/32380146 learned_addr learned my addr 172.21.15.159:0/32380146 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:21.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb76d9d640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb781484f0 0x7feb78148970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:21.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb7659c640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb60003a00 0x7feb78147050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:21.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb75d9b640 1 -- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb60003a00 msgr2=0x7feb78147050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:21.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb75d9b640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb60003a00 0x7feb78147050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb75d9b640 1 -- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb781484f0 msgr2=0x7feb78148970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:21.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb75d9b640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb781484f0 0x7feb78148970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb75d9b640 1 -- 172.21.15.159:0/32380146 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb78147750 con 0x7feb7815ccf0 2024-07-24T16:36:21.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb75d9b640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb7815ccf0 0x7feb7815d170 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00b5e0 tx=0x7feb6c00baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:21.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb66ffd640 1 -- 172.21.15.159:0/32380146 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c005220 con 0x7feb7815ccf0 2024-07-24T16:36:21.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb66ffd640 1 -- 172.21.15.159:0/32380146 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feb6c0053c0 con 0x7feb7815ccf0 2024-07-24T16:36:21.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb66ffd640 1 -- 172.21.15.159:0/32380146 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb6c0047a0 con 0x7feb7815ccf0 2024-07-24T16:36:21.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb7cd01640 1 -- 172.21.15.159:0/32380146 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb78154580 con 0x7feb7815ccf0 2024-07-24T16:36:21.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.366+0000 7feb7cd01640 1 -- 172.21.15.159:0/32380146 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb78147a10 con 0x7feb7815ccf0 2024-07-24T16:36:21.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.367+0000 7feb7cd01640 1 -- 172.21.15.159:0/32380146 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb7815d6b0 con 0x7feb7815ccf0 2024-07-24T16:36:21.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.368+0000 7feb66ffd640 1 -- 172.21.15.159:0/32380146 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7feb6c004960 con 0x7feb7815ccf0 2024-07-24T16:36:21.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.368+0000 7feb66ffd640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7feb58077240 0x7feb58079700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:21.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.368+0000 7feb66ffd640 1 -- 172.21.15.159:0/32380146 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7feb6c099700 con 0x7feb7815ccf0 2024-07-24T16:36:21.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.368+0000 7feb7659c640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7feb58077240 0x7feb58079700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:21.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.369+0000 7feb7659c640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7feb58077240 0x7feb58079700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feb68033000 tx=0x7feb68038040 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:21.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.372+0000 7feb66ffd640 1 -- 172.21.15.159:0/32380146 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7feb6c061ea0 con 0x7feb7815ccf0 2024-07-24T16:36:21.585 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.582+0000 7feb7cd01640 1 -- 172.21.15.159:0/32380146 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir5", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7feb780ceff0 con 0x7feb58077240 2024-07-24T16:36:21.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.653+0000 7feb66ffd640 1 -- 172.21.15.159:0/32380146 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7feb780ceff0 con 0x7feb58077240 2024-07-24T16:36:21.656 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule deactivated for path /snap_test_dir1/dir5 2024-07-24T16:36:21.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.656+0000 7feb7cd01640 1 -- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7feb58077240 msgr2=0x7feb58079700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:21.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.656+0000 7feb7cd01640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7feb58077240 0x7feb58079700 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7feb68033000 tx=0x7feb68038040 comp rx=0 tx=0).stop 2024-07-24T16:36:21.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.656+0000 7feb7cd01640 1 -- 172.21.15.159:0/32380146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb7815ccf0 msgr2=0x7feb7815d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:21.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.656+0000 7feb7cd01640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb7815ccf0 0x7feb7815d170 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7feb6c00b5e0 tx=0x7feb6c00baa0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.656+0000 7feb7cd01640 1 -- 172.21.15.159:0/32380146 shutdown_connections 2024-07-24T16:36:21.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.656+0000 7feb7cd01640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7feb58077240 0x7feb58079700 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.656+0000 7feb7cd01640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7feb781484f0 0x7feb78148970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.656+0000 7feb7cd01640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7feb7815ccf0 0x7feb7815d170 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.656+0000 7feb7cd01640 1 --2- 172.21.15.159:0/32380146 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7feb60003a00 0x7feb78147050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.656+0000 7feb7cd01640 1 -- 172.21.15.159:0/32380146 >> 172.21.15.159:0/32380146 conn(0x7feb7806c560 msgr2=0x7feb78072780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:21.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.656+0000 7feb7cd01640 1 -- 172.21.15.159:0/32380146 shutdown_connections 2024-07-24T16:36:21.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.656+0000 7feb7cd01640 1 -- 172.21.15.159:0/32380146 wait complete. 2024-07-24T16:36:21.669 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir5 2024-07-24T16:36:21.669 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir6 1m 2024-07-24T16:36:21.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.773+0000 7f14c31ed640 1 -- 172.21.15.159:0/78703497 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14bc06f890 msgr2=0x7f14bc0cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:21.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.773+0000 7f14c31ed640 1 --2- 172.21.15.159:0/78703497 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14bc06f890 0x7f14bc0cf320 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f14a8005fd0 tx=0x7f14a802a5d0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.773+0000 7f14c31ed640 1 -- 172.21.15.159:0/78703497 shutdown_connections 2024-07-24T16:36:21.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.773+0000 7f14c31ed640 1 --2- 172.21.15.159:0/78703497 >> v2:172.21.15.193:3300/0 conn(0x7f14bc0cf860 0x7f14bc15bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.773+0000 7f14c31ed640 1 --2- 172.21.15.159:0/78703497 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14bc06f890 0x7f14bc0cf320 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.773+0000 7f14c31ed640 1 -- 172.21.15.159:0/78703497 >> 172.21.15.159:0/78703497 conn(0x7f14bc06c560 msgr2=0x7f14bc06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:21.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.773+0000 7f14c31ed640 1 -- 172.21.15.159:0/78703497 shutdown_connections 2024-07-24T16:36:21.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.773+0000 7f14c31ed640 1 -- 172.21.15.159:0/78703497 wait complete. 2024-07-24T16:36:21.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.774+0000 7f14c31ed640 1 Processor -- start 2024-07-24T16:36:21.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.774+0000 7f14c31ed640 1 -- start start 2024-07-24T16:36:21.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14c31ed640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14bc06f890 0x7f14bc150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:21.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14c31ed640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14bc0cf860 0x7f14bc1536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:21.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14c31ed640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14bc158fe0 0x7f14bc1599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:21.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14c31ed640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc159540 con 0x7f14bc0cf860 2024-07-24T16:36:21.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14c31ed640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc1593c0 con 0x7f14bc158fe0 2024-07-24T16:36:21.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14c31ed640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f14bc15c4d0 con 0x7f14bc06f890 2024-07-24T16:36:21.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14bbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14bc0cf860 0x7f14bc1536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:21.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14bbfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14bc0cf860 0x7f14bc1536e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51134/0 (socket says 172.21.15.159:51134) 2024-07-24T16:36:21.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14c178a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14bc158fe0 0x7f14bc1599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:21.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14bbfff640 1 -- 172.21.15.159:0/828266504 learned_addr learned my addr 172.21.15.159:0/828266504 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:21.779 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14c0f89640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14bc06f890 0x7f14bc150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:21.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14bbfff640 1 -- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14bc06f890 msgr2=0x7f14bc150bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:21.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14bbfff640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14bc06f890 0x7f14bc150bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14bbfff640 1 -- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14bc158fe0 msgr2=0x7f14bc1599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:21.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14bbfff640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14bc158fe0 0x7f14bc1599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:21.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14bbfff640 1 -- 172.21.15.159:0/828266504 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14bc153d30 con 0x7f14bc0cf860 2024-07-24T16:36:21.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14c178a640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14bc158fe0 0x7f14bc1599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:36:21.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.775+0000 7f14bbfff640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14bc0cf860 0x7f14bc1536e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f14a8000c00 tx=0x7f14a8003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:21.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.776+0000 7f14b97fa640 1 -- 172.21.15.159:0/828266504 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a803f070 con 0x7f14bc0cf860 2024-07-24T16:36:21.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.776+0000 7f14b97fa640 1 -- 172.21.15.159:0/828266504 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14a8005600 con 0x7f14bc0cf860 2024-07-24T16:36:21.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.776+0000 7f14c31ed640 1 -- 172.21.15.159:0/828266504 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14bc1f5740 con 0x7f14bc0cf860 2024-07-24T16:36:21.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.776+0000 7f14b97fa640 1 -- 172.21.15.159:0/828266504 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a8035030 con 0x7f14bc0cf860 2024-07-24T16:36:21.780 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.776+0000 7f14c31ed640 1 -- 172.21.15.159:0/828266504 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14bc1f5d00 con 0x7f14bc0cf860 2024-07-24T16:36:21.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.777+0000 7f14c31ed640 1 -- 172.21.15.159:0/828266504 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14bc15c9b0 con 0x7f14bc0cf860 2024-07-24T16:36:21.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.777+0000 7f14b97fa640 1 -- 172.21.15.159:0/828266504 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f14a8042070 con 0x7f14bc0cf860 2024-07-24T16:36:21.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.778+0000 7f14b97fa640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f14a0077210 0x7f14a00796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:21.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.778+0000 7f14b97fa640 1 -- 172.21.15.159:0/828266504 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f14a80b9950 con 0x7f14bc0cf860 2024-07-24T16:36:21.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.778+0000 7f14c0f89640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f14a0077210 0x7f14a00796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:21.782 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.778+0000 7f14c0f89640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f14a0077210 0x7f14a00796d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f14b0001720 tx=0x7f14b0009040 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:21.784 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.782+0000 7f14b97fa640 1 -- 172.21.15.159:0/828266504 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f14a8082010 con 0x7f14bc0cf860 2024-07-24T16:36:21.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:21.989+0000 7f14c31ed640 1 -- 172.21.15.159:0/828266504 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir6", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f14bc15ef10 con 0x7f14a0077210 2024-07-24T16:36:22.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.062+0000 7f14b97fa640 1 -- 172.21.15.159:0/828266504 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f14bc15ef10 con 0x7f14a0077210 2024-07-24T16:36:22.065 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule deactivated for path /snap_test_dir1/dir6 2024-07-24T16:36:22.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.064+0000 7f14c31ed640 1 -- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f14a0077210 msgr2=0x7f14a00796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.064+0000 7f14c31ed640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f14a0077210 0x7f14a00796d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f14b0001720 tx=0x7f14b0009040 comp rx=0 tx=0).stop 2024-07-24T16:36:22.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.064+0000 7f14c31ed640 1 -- 172.21.15.159:0/828266504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14bc0cf860 msgr2=0x7f14bc1536e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.064+0000 7f14c31ed640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14bc0cf860 0x7f14bc1536e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f14a8000c00 tx=0x7f14a8003820 comp rx=0 tx=0).stop 2024-07-24T16:36:22.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.064+0000 7f14c31ed640 1 -- 172.21.15.159:0/828266504 shutdown_connections 2024-07-24T16:36:22.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.064+0000 7f14c31ed640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f14a0077210 0x7f14a00796d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.064+0000 7f14c31ed640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f14bc158fe0 0x7f14bc1599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.064+0000 7f14c31ed640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f14bc0cf860 0x7f14bc1536e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.064+0000 7f14c31ed640 1 --2- 172.21.15.159:0/828266504 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f14bc06f890 0x7f14bc150bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.064+0000 7f14c31ed640 1 -- 172.21.15.159:0/828266504 >> 172.21.15.159:0/828266504 conn(0x7f14bc06c560 msgr2=0x7f14bc06d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:22.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.064+0000 7f14c31ed640 1 -- 172.21.15.159:0/828266504 shutdown_connections 2024-07-24T16:36:22.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.064+0000 7f14c31ed640 1 -- 172.21.15.159:0/828266504 wait complete. 2024-07-24T16:36:22.078 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir6 2024-07-24T16:36:22.078 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir7 1m 2024-07-24T16:36:22.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.180+0000 7f5ae31e8640 1 -- 172.21.15.159:0/4148900465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5adc1524f0 msgr2=0x7f5adc0af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.183 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.180+0000 7f5ae31e8640 1 --2- 172.21.15.159:0/4148900465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5adc1524f0 0x7f5adc0af020 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f5acc005fd0 tx=0x7f5acc02a5d0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.181+0000 7f5ae31e8640 1 -- 172.21.15.159:0/4148900465 shutdown_connections 2024-07-24T16:36:22.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.181+0000 7f5ae31e8640 1 --2- 172.21.15.159:0/4148900465 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5adc1524f0 0x7f5adc0af020 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.181+0000 7f5ae31e8640 1 -- 172.21.15.159:0/4148900465 >> 172.21.15.159:0/4148900465 conn(0x7f5adc06d450 msgr2=0x7f5adc06d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:22.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.181+0000 7f5ae31e8640 1 -- 172.21.15.159:0/4148900465 shutdown_connections 2024-07-24T16:36:22.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.181+0000 7f5ae31e8640 1 -- 172.21.15.159:0/4148900465 wait complete. 2024-07-24T16:36:22.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.182+0000 7f5ae31e8640 1 Processor -- start 2024-07-24T16:36:22.184 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.182+0000 7f5ae31e8640 1 -- start start 2024-07-24T16:36:22.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae31e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5adc0cd130 0x7f5adc15ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:22.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae31e8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5adc0cf840 0x7f5adc1f2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:22.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae31e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5adc1524f0 0x7f5adc143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:22.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae31e8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc0b4760 con 0x7f5adc1524f0 2024-07-24T16:36:22.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae31e8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5adc0b45e0 con 0x7f5adc0cd130 2024-07-24T16:36:22.186 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae31e8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5adc0b48e0 con 0x7f5adc0cf840 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae1785640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5adc1524f0 0x7f5adc143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae1785640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5adc1524f0 0x7f5adc143d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51158/0 (socket says 172.21.15.159:51158) 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae1785640 1 -- 172.21.15.159:0/1099164769 learned_addr learned my addr 172.21.15.159:0/1099164769 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae0f84640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5adc0cd130 0x7f5adc15ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5adbfff640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5adc0cf840 0x7f5adc1f2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae1785640 1 -- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5adc0cf840 msgr2=0x7f5adc1f2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae1785640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5adc0cf840 0x7f5adc1f2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae1785640 1 -- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5adc0cd130 msgr2=0x7f5adc15ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae1785640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5adc0cd130 0x7f5adc15ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae1785640 1 -- 172.21.15.159:0/1099164769 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5adc1f2e80 con 0x7f5adc1524f0 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5adbfff640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5adc0cf840 0x7f5adc1f2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae0f84640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5adc0cd130 0x7f5adc15ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae1785640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5adc1524f0 0x7f5adc143d50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400c780 tx=0x7f5ad400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:22.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ad97fa640 1 -- 172.21.15.159:0/1099164769 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4004b60 con 0x7f5adc1524f0 2024-07-24T16:36:22.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ad97fa640 1 -- 172.21.15.159:0/1099164769 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ad4004df0 con 0x7f5adc1524f0 2024-07-24T16:36:22.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae31e8640 1 -- 172.21.15.159:0/1099164769 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5adc144290 con 0x7f5adc1524f0 2024-07-24T16:36:22.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ad97fa640 1 -- 172.21.15.159:0/1099164769 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400aa90 con 0x7f5adc1524f0 2024-07-24T16:36:22.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.183+0000 7f5ae31e8640 1 -- 172.21.15.159:0/1099164769 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5adc146990 con 0x7f5adc1524f0 2024-07-24T16:36:22.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.184+0000 7f5ae31e8640 1 -- 172.21.15.159:0/1099164769 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5adc0cdf90 con 0x7f5adc1524f0 2024-07-24T16:36:22.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.185+0000 7f5ad97fa640 1 -- 172.21.15.159:0/1099164769 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f5ad400ac30 con 0x7f5adc1524f0 2024-07-24T16:36:22.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.185+0000 7f5ad97fa640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5ac8077210 0x7f5ac80796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:22.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.185+0000 7f5ad97fa640 1 -- 172.21.15.159:0/1099164769 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f5ad4099230 con 0x7f5adc1524f0 2024-07-24T16:36:22.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.186+0000 7f5ae0f84640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5ac8077210 0x7f5ac80796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:22.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.186+0000 7f5ae0f84640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5ac8077210 0x7f5ac80796d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5acc033000 tx=0x7f5acc004730 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:22.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.189+0000 7f5ad97fa640 1 -- 172.21.15.159:0/1099164769 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f5adc0cdf90 con 0x7f5adc1524f0 2024-07-24T16:36:22.399 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.396+0000 7f5ae31e8640 1 -- 172.21.15.159:0/1099164769 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir7", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f5adc0cf160 con 0x7f5ac8077210 2024-07-24T16:36:22.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.470+0000 7f5ad97fa640 1 -- 172.21.15.159:0/1099164769 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f5adc0cf160 con 0x7f5ac8077210 2024-07-24T16:36:22.473 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule deactivated for path /snap_test_dir1/dir7 2024-07-24T16:36:22.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.472+0000 7f5ae31e8640 1 -- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5ac8077210 msgr2=0x7f5ac80796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.472+0000 7f5ae31e8640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5ac8077210 0x7f5ac80796d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f5acc033000 tx=0x7f5acc004730 comp rx=0 tx=0).stop 2024-07-24T16:36:22.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.472+0000 7f5ae31e8640 1 -- 172.21.15.159:0/1099164769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5adc1524f0 msgr2=0x7f5adc143d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.472+0000 7f5ae31e8640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5adc1524f0 0x7f5adc143d50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400c780 tx=0x7f5ad400cc40 comp rx=0 tx=0).stop 2024-07-24T16:36:22.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.472+0000 7f5ae31e8640 1 -- 172.21.15.159:0/1099164769 shutdown_connections 2024-07-24T16:36:22.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.472+0000 7f5ae31e8640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5ac8077210 0x7f5ac80796d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.472+0000 7f5ae31e8640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5adc1524f0 0x7f5adc143d50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.472+0000 7f5ae31e8640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5adc0cf840 0x7f5adc1f2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.472+0000 7f5ae31e8640 1 --2- 172.21.15.159:0/1099164769 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5adc0cd130 0x7f5adc15ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.472+0000 7f5ae31e8640 1 -- 172.21.15.159:0/1099164769 >> 172.21.15.159:0/1099164769 conn(0x7f5adc06d450 msgr2=0x7f5adc154cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:22.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.472+0000 7f5ae31e8640 1 -- 172.21.15.159:0/1099164769 shutdown_connections 2024-07-24T16:36:22.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.472+0000 7f5ae31e8640 1 -- 172.21.15.159:0/1099164769 wait complete. 2024-07-24T16:36:22.486 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir7 2024-07-24T16:36:22.486 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir8 1m 2024-07-24T16:36:22.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.588+0000 7f3b241e8640 1 -- 172.21.15.159:0/563751857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1c15d950 msgr2=0x7f3b1c161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.588+0000 7f3b241e8640 1 --2- 172.21.15.159:0/563751857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1c15d950 0x7f3b1c161f20 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f3b10005fd0 tx=0x7f3b1002a5b0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.588+0000 7f3b241e8640 1 -- 172.21.15.159:0/563751857 shutdown_connections 2024-07-24T16:36:22.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.588+0000 7f3b241e8640 1 --2- 172.21.15.159:0/563751857 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b1c0cf770 0x7f3b1c0cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.588+0000 7f3b241e8640 1 --2- 172.21.15.159:0/563751857 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1c15d950 0x7f3b1c161f20 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.588+0000 7f3b241e8640 1 -- 172.21.15.159:0/563751857 >> 172.21.15.159:0/563751857 conn(0x7f3b1c09cd30 msgr2=0x7f3b1c0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:22.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.589+0000 7f3b241e8640 1 -- 172.21.15.159:0/563751857 shutdown_connections 2024-07-24T16:36:22.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.589+0000 7f3b241e8640 1 -- 172.21.15.159:0/563751857 wait complete. 2024-07-24T16:36:22.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.590+0000 7f3b241e8640 1 Processor -- start 2024-07-24T16:36:22.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.590+0000 7f3b241e8640 1 -- start start 2024-07-24T16:36:22.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.590+0000 7f3b241e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1c0b2ae0 0x7f3b1c15c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:22.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.590+0000 7f3b241e8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b1c0cf770 0x7f3b1c15dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:22.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.590+0000 7f3b241e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b1c15d950 0x7f3b1c1f4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:22.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.590+0000 7f3b241e8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c0d0460 con 0x7f3b1c0b2ae0 2024-07-24T16:36:22.594 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.590+0000 7f3b241e8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b1c0d02e0 con 0x7f3b1c15d950 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.590+0000 7f3b241e8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3b1c0d05e0 con 0x7f3b1c0cf770 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b21f84640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1c0b2ae0 0x7f3b1c15c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b21f84640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1c0b2ae0 0x7f3b1c15c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51164/0 (socket says 172.21.15.159:51164) 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b21f84640 1 -- 172.21.15.159:0/4274523421 learned_addr learned my addr 172.21.15.159:0/4274523421 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b22785640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b1c15d950 0x7f3b1c1f4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b21783640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b1c0cf770 0x7f3b1c15dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b21f84640 1 -- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b1c0cf770 msgr2=0x7f3b1c15dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b21f84640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b1c0cf770 0x7f3b1c15dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b21f84640 1 -- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b1c15d950 msgr2=0x7f3b1c1f4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b21f84640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b1c15d950 0x7f3b1c1f4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b21f84640 1 -- 172.21.15.159:0/4274523421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b1c160e80 con 0x7f3b1c0b2ae0 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b21f84640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1c0b2ae0 0x7f3b1c15c040 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3b10000c00 tx=0x7f3b10003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b0e7fc640 1 -- 172.21.15.159:0/4274523421 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1003e030 con 0x7f3b1c0b2ae0 2024-07-24T16:36:22.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b0e7fc640 1 -- 172.21.15.159:0/4274523421 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b10003e60 con 0x7f3b1c0b2ae0 2024-07-24T16:36:22.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b241e8640 1 -- 172.21.15.159:0/4274523421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b1c160830 con 0x7f3b1c0b2ae0 2024-07-24T16:36:22.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b0e7fc640 1 -- 172.21.15.159:0/4274523421 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b10035040 con 0x7f3b1c0b2ae0 2024-07-24T16:36:22.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.591+0000 7f3b241e8640 1 -- 172.21.15.159:0/4274523421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b1c160270 con 0x7f3b1c0b2ae0 2024-07-24T16:36:22.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.592+0000 7f3b241e8640 1 -- 172.21.15.159:0/4274523421 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b1c0d0a90 con 0x7f3b1c0b2ae0 2024-07-24T16:36:22.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.593+0000 7f3b0e7fc640 1 -- 172.21.15.159:0/4274523421 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f3b10041030 con 0x7f3b1c0b2ae0 2024-07-24T16:36:22.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.593+0000 7f3b0e7fc640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f3b00077210 0x7f3b000796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:22.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.593+0000 7f3b0e7fc640 1 -- 172.21.15.159:0/4274523421 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f3b100b95b0 con 0x7f3b1c0b2ae0 2024-07-24T16:36:22.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.593+0000 7f3b21783640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f3b00077210 0x7f3b000796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:22.597 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.594+0000 7f3b21783640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f3b00077210 0x7f3b000796d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b18004f60 tx=0x7f3b18007e30 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:22.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.597+0000 7f3b0e7fc640 1 -- 172.21.15.159:0/4274523421 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f3b10081cf0 con 0x7f3b1c0b2ae0 2024-07-24T16:36:22.804 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.802+0000 7f3b241e8640 1 -- 172.21.15.159:0/4274523421 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir8", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f3b1c06d7a0 con 0x7f3b00077210 2024-07-24T16:36:22.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.873+0000 7f3b0e7fc640 1 -- 172.21.15.159:0/4274523421 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f3b1c06d7a0 con 0x7f3b00077210 2024-07-24T16:36:22.875 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule deactivated for path /snap_test_dir1/dir8 2024-07-24T16:36:22.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.875+0000 7f3b241e8640 1 -- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f3b00077210 msgr2=0x7f3b000796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.875+0000 7f3b241e8640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f3b00077210 0x7f3b000796d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3b18004f60 tx=0x7f3b18007e30 comp rx=0 tx=0).stop 2024-07-24T16:36:22.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.875+0000 7f3b241e8640 1 -- 172.21.15.159:0/4274523421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1c0b2ae0 msgr2=0x7f3b1c15c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.875+0000 7f3b241e8640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1c0b2ae0 0x7f3b1c15c040 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f3b10000c00 tx=0x7f3b10003970 comp rx=0 tx=0).stop 2024-07-24T16:36:22.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.875+0000 7f3b241e8640 1 -- 172.21.15.159:0/4274523421 shutdown_connections 2024-07-24T16:36:22.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.875+0000 7f3b241e8640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f3b00077210 0x7f3b000796d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.875+0000 7f3b241e8640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b1c15d950 0x7f3b1c1f4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.875+0000 7f3b241e8640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b1c0cf770 0x7f3b1c15dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.875+0000 7f3b241e8640 1 --2- 172.21.15.159:0/4274523421 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1c0b2ae0 0x7f3b1c15c040 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.875+0000 7f3b241e8640 1 -- 172.21.15.159:0/4274523421 >> 172.21.15.159:0/4274523421 conn(0x7f3b1c09cd30 msgr2=0x7f3b1c0b71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:22.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.875+0000 7f3b241e8640 1 -- 172.21.15.159:0/4274523421 shutdown_connections 2024-07-24T16:36:22.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.875+0000 7f3b241e8640 1 -- 172.21.15.159:0/4274523421 wait complete. 2024-07-24T16:36:22.888 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir8 2024-07-24T16:36:22.888 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule deactivate /snap_test_dir1/dir9 1m 2024-07-24T16:36:22.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.992+0000 7ff08164e640 1 -- 172.21.15.159:0/1872667875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c0b58a0 msgr2=0x7ff07c0b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.992+0000 7ff08164e640 1 --2- 172.21.15.159:0/1872667875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c0b58a0 0x7ff07c0b5d50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7ff07c06e390 tx=0x7ff07402a560 comp rx=0 tx=0).stop 2024-07-24T16:36:22.995 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.992+0000 7ff08164e640 1 -- 172.21.15.159:0/1872667875 shutdown_connections 2024-07-24T16:36:22.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.992+0000 7ff08164e640 1 --2- 172.21.15.159:0/1872667875 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c0b58a0 0x7ff07c0b5d50 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.992+0000 7ff08164e640 1 --2- 172.21.15.159:0/1872667875 >> v2:172.21.15.193:3300/0 conn(0x7ff07c06c560 0x7ff07c06c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.992+0000 7ff08164e640 1 --2- 172.21.15.159:0/1872667875 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff07c15b470 0x7ff07c15f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.992+0000 7ff08164e640 1 -- 172.21.15.159:0/1872667875 >> 172.21.15.159:0/1872667875 conn(0x7ff07c071140 msgr2=0x7ff07c06d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:22.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.992+0000 7ff08164e640 1 -- 172.21.15.159:0/1872667875 shutdown_connections 2024-07-24T16:36:22.996 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.992+0000 7ff08164e640 1 -- 172.21.15.159:0/1872667875 wait complete. 2024-07-24T16:36:22.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.993+0000 7ff08164e640 1 Processor -- start 2024-07-24T16:36:22.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.993+0000 7ff08164e640 1 -- start start 2024-07-24T16:36:22.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.994+0000 7ff08164e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff07c06c560 0x7ff07c14b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:22.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.994+0000 7ff08164e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c0b58a0 0x7ff07c141f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:22.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.994+0000 7ff08164e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff07c15b470 0x7ff07c1f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:22.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.994+0000 7ff08164e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c072c00 con 0x7ff07c0b58a0 2024-07-24T16:36:22.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.994+0000 7ff08164e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c072a80 con 0x7ff07c15b470 2024-07-24T16:36:22.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.994+0000 7ff08164e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff07c0b6290 con 0x7ff07c06c560 2024-07-24T16:36:22.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.994+0000 7ff07a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c0b58a0 0x7ff07c141f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:22.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.994+0000 7ff07a7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c0b58a0 0x7ff07c141f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51180/0 (socket says 172.21.15.159:51180) 2024-07-24T16:36:22.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.994+0000 7ff07a7fc640 1 -- 172.21.15.159:0/417265911 learned_addr learned my addr 172.21.15.159:0/417265911 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:22.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.994+0000 7ff07b7fe640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff07c15b470 0x7ff07c1f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:22.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.994+0000 7ff07affd640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff07c06c560 0x7ff07c14b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:22.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.995+0000 7ff07a7fc640 1 -- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff07c06c560 msgr2=0x7ff07c14b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.995+0000 7ff07a7fc640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff07c06c560 0x7ff07c14b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.995+0000 7ff07a7fc640 1 -- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff07c15b470 msgr2=0x7ff07c1f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:22.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.995+0000 7ff07a7fc640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff07c15b470 0x7ff07c1f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:22.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.995+0000 7ff07a7fc640 1 -- 172.21.15.159:0/417265911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07c14bef0 con 0x7ff07c0b58a0 2024-07-24T16:36:22.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.995+0000 7ff07a7fc640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c0b58a0 0x7ff07c141f70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff06400e9c0 tx=0x7ff06400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:22.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.995+0000 7ff0737fe640 1 -- 172.21.15.159:0/417265911 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06400cd80 con 0x7ff07c0b58a0 2024-07-24T16:36:22.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.995+0000 7ff0737fe640 1 -- 172.21.15.159:0/417265911 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff064004020 con 0x7ff07c0b58a0 2024-07-24T16:36:22.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.995+0000 7ff08164e640 1 -- 172.21.15.159:0/417265911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff07c1f2de0 con 0x7ff07c0b58a0 2024-07-24T16:36:22.999 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.995+0000 7ff0737fe640 1 -- 172.21.15.159:0/417265911 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff064004450 con 0x7ff07c0b58a0 2024-07-24T16:36:23.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.995+0000 7ff08164e640 1 -- 172.21.15.159:0/417265911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07c1579d0 con 0x7ff07c0b58a0 2024-07-24T16:36:23.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.996+0000 7ff08164e640 1 -- 172.21.15.159:0/417265911 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff07c0c5e00 con 0x7ff07c0b58a0 2024-07-24T16:36:23.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.997+0000 7ff0737fe640 1 -- 172.21.15.159:0/417265911 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7ff0640035f0 con 0x7ff07c0b58a0 2024-07-24T16:36:23.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.997+0000 7ff0737fe640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7ff05c077210 0x7ff05c0796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:23.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.997+0000 7ff0737fe640 1 -- 172.21.15.159:0/417265911 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7ff064099930 con 0x7ff07c0b58a0 2024-07-24T16:36:23.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.997+0000 7ff07affd640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7ff05c077210 0x7ff05c0796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:23.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:22.998+0000 7ff07affd640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7ff05c077210 0x7ff05c0796d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff07c15ae80 tx=0x7ff06c0095e0 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:23.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.001+0000 7ff0737fe640 1 -- 172.21.15.159:0/417265911 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7ff064061eb0 con 0x7ff07c0b58a0 2024-07-24T16:36:23.215 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.212+0000 7ff08164e640 1 -- 172.21.15.159:0/417265911 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule deactivate", "path": "/snap_test_dir1/dir9", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7ff07c0b5d50 con 0x7ff05c077210 2024-07-24T16:36:23.284 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.282+0000 7ff0737fe640 1 -- 172.21.15.159:0/417265911 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7ff07c0b5d50 con 0x7ff05c077210 2024-07-24T16:36:23.284 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule deactivated for path /snap_test_dir1/dir9 2024-07-24T16:36:23.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.284+0000 7ff08164e640 1 -- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7ff05c077210 msgr2=0x7ff05c0796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:23.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.284+0000 7ff08164e640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7ff05c077210 0x7ff05c0796d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff07c15ae80 tx=0x7ff06c0095e0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.284+0000 7ff08164e640 1 -- 172.21.15.159:0/417265911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c0b58a0 msgr2=0x7ff07c141f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:23.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.284+0000 7ff08164e640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c0b58a0 0x7ff07c141f70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff06400e9c0 tx=0x7ff06400ee80 comp rx=0 tx=0).stop 2024-07-24T16:36:23.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.284+0000 7ff08164e640 1 -- 172.21.15.159:0/417265911 shutdown_connections 2024-07-24T16:36:23.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.284+0000 7ff08164e640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7ff05c077210 0x7ff05c0796d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.284+0000 7ff08164e640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff07c15b470 0x7ff07c1f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.284+0000 7ff08164e640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff07c0b58a0 0x7ff07c141f70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.287 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.284+0000 7ff08164e640 1 --2- 172.21.15.159:0/417265911 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff07c06c560 0x7ff07c14b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.284+0000 7ff08164e640 1 -- 172.21.15.159:0/417265911 >> 172.21.15.159:0/417265911 conn(0x7ff07c071140 msgr2=0x7ff07c0b4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:23.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.284+0000 7ff08164e640 1 -- 172.21.15.159:0/417265911 shutdown_connections 2024-07-24T16:36:23.288 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.284+0000 7ff08164e640 1 -- 172.21.15.159:0/417265911 wait complete. 2024-07-24T16:36:23.298 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule deactivated for path /snap_test_dir1/dir9 2024-07-24T16:36:23.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:23.298 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2024-07-24T16:36:23.315 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:23.315 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:23.316 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:23.316 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:23.316 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:23.316 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:23.316 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:23.316 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:23.316 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:23.316 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:23.316 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:23.316 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-07-24-16_26_00_UTC', 'scheduled-2024-07-24-16_27_00_UTC', 'scheduled-2024-07-24-16_28_00_UTC', 'scheduled-2024-07-24-16_29_00_UTC', 'scheduled-2024-07-24-16_30_00_UTC', 'scheduled-2024-07-24-16_31_00_UTC', 'scheduled-2024-07-24-16_32_00_UTC', 'scheduled-2024-07-24-16_33_00_UTC', 'scheduled-2024-07-24-16_34_00_UTC', 'scheduled-2024-07-24-16_35_00_UTC', 'scheduled-2024-07-24-16_36_00_UTC'] 2024-07-24T16:36:23.316 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir0 2024-07-24T16:36:23.460 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.457+0000 7f2ddc2be640 1 -- 172.21.15.159:0/4129609455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd4157510 msgr2=0x7f2dd40cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:23.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.457+0000 7f2ddc2be640 1 --2- 172.21.15.159:0/4129609455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd4157510 0x7f2dd40cfa40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2dd40b3000 tx=0x7f2dc402a4d0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.458+0000 7f2ddc2be640 1 -- 172.21.15.159:0/4129609455 shutdown_connections 2024-07-24T16:36:23.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.458+0000 7f2ddc2be640 1 --2- 172.21.15.159:0/4129609455 >> v2:172.21.15.193:3300/0 conn(0x7f2dd406e360 0x7f2dd4159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.458+0000 7f2ddc2be640 1 --2- 172.21.15.159:0/4129609455 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd4157510 0x7f2dd40cfa40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.458+0000 7f2ddc2be640 1 --2- 172.21.15.159:0/4129609455 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2dd4157130 0x7f2dd40cf500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.458+0000 7f2ddc2be640 1 -- 172.21.15.159:0/4129609455 >> 172.21.15.159:0/4129609455 conn(0x7f2dd406c560 msgr2=0x7f2dd406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:23.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.458+0000 7f2ddc2be640 1 -- 172.21.15.159:0/4129609455 shutdown_connections 2024-07-24T16:36:23.461 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.458+0000 7f2ddc2be640 1 -- 172.21.15.159:0/4129609455 wait complete. 2024-07-24T16:36:23.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.459+0000 7f2ddc2be640 1 Processor -- start 2024-07-24T16:36:23.463 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.459+0000 7f2ddc2be640 1 -- start start 2024-07-24T16:36:23.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.459+0000 7f2ddc2be640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dd406e360 0x7f2dd40cb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:23.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.459+0000 7f2ddc2be640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2dd4157130 0x7f2dd40cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:23.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.459+0000 7f2ddc2be640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd4157510 0x7f2dd415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:23.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.459+0000 7f2ddc2be640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd4142620 con 0x7f2dd4157510 2024-07-24T16:36:23.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.459+0000 7f2ddc2be640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f2dd415a7e0 con 0x7f2dd406e360 2024-07-24T16:36:23.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.459+0000 7f2ddc2be640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f2dd41427a0 con 0x7f2dd4157130 2024-07-24T16:36:23.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dda85b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd4157510 0x7f2dd415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:23.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dda85b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd4157510 0x7f2dd415adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51206/0 (socket says 172.21.15.159:51206) 2024-07-24T16:36:23.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dda85b640 1 -- 172.21.15.159:0/3163827596 learned_addr learned my addr 172.21.15.159:0/3163827596 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:23.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dd9859640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2dd4157130 0x7f2dd40cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:23.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dda05a640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dd406e360 0x7f2dd40cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:23.464 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dda85b640 1 -- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2dd4157130 msgr2=0x7f2dd40cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:23.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dda85b640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2dd4157130 0x7f2dd40cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dda85b640 1 -- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dd406e360 msgr2=0x7f2dd40cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:23.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dda85b640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dd406e360 0x7f2dd40cb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dda85b640 1 -- 172.21.15.159:0/3163827596 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dd40ce190 con 0x7f2dd4157510 2024-07-24T16:36:23.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dda85b640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd4157510 0x7f2dd415adf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00cce0 tx=0x7f2dcc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:23.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dcaffd640 1 -- 172.21.15.159:0/3163827596 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00f450 con 0x7f2dd4157510 2024-07-24T16:36:23.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dcaffd640 1 -- 172.21.15.159:0/3163827596 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dcc00f610 con 0x7f2dd4157510 2024-07-24T16:36:23.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2ddc2be640 1 -- 172.21.15.159:0/3163827596 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dd40ce470 con 0x7f2dd4157510 2024-07-24T16:36:23.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2dcaffd640 1 -- 172.21.15.159:0/3163827596 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc00fa60 con 0x7f2dd4157510 2024-07-24T16:36:23.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.460+0000 7f2ddc2be640 1 -- 172.21.15.159:0/3163827596 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dd41f3110 con 0x7f2dd4157510 2024-07-24T16:36:23.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.461+0000 7f2ddc2be640 1 -- 172.21.15.159:0/3163827596 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dd40cbcc0 con 0x7f2dd4157510 2024-07-24T16:36:23.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.462+0000 7f2dcaffd640 1 -- 172.21.15.159:0/3163827596 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f2dcc00fc00 con 0x7f2dd4157510 2024-07-24T16:36:23.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.462+0000 7f2dcaffd640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f2db8077240 0x7f2db8079700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:23.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.462+0000 7f2dcaffd640 1 -- 172.21.15.159:0/3163827596 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f2dcc099a40 con 0x7f2dd4157510 2024-07-24T16:36:23.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.462+0000 7f2dda05a640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f2db8077240 0x7f2db8079700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:23.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.463+0000 7f2dda05a640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f2db8077240 0x7f2db8079700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009990 tx=0x7f2dd0009110 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:23.469 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.466+0000 7f2dcaffd640 1 -- 172.21.15.159:0/3163827596 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f2dcc014030 con 0x7f2dd4157510 2024-07-24T16:36:23.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.668+0000 7f2ddc2be640 1 -- 172.21.15.159:0/3163827596 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir0", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2dd4159d80 con 0x7f2db8077240 2024-07-24T16:36:23.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.678+0000 7f2dcaffd640 1 -- 172.21.15.159:0/3163827596 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f2dd4159d80 con 0x7f2db8077240 2024-07-24T16:36:23.681 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:23.681 INFO:teuthology.orchestra.run.smithi159.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:14", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:23.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.681+0000 7f2ddc2be640 1 -- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f2db8077240 msgr2=0x7f2db8079700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:23.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.681+0000 7f2ddc2be640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f2db8077240 0x7f2db8079700 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2dd0009990 tx=0x7f2dd0009110 comp rx=0 tx=0).stop 2024-07-24T16:36:23.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.681+0000 7f2ddc2be640 1 -- 172.21.15.159:0/3163827596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd4157510 msgr2=0x7f2dd415adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:23.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.681+0000 7f2ddc2be640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd4157510 0x7f2dd415adf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc00cce0 tx=0x7f2dcc00a620 comp rx=0 tx=0).stop 2024-07-24T16:36:23.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.681+0000 7f2ddc2be640 1 -- 172.21.15.159:0/3163827596 shutdown_connections 2024-07-24T16:36:23.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.681+0000 7f2ddc2be640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f2db8077240 0x7f2db8079700 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.681+0000 7f2ddc2be640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2dd4157510 0x7f2dd415adf0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.681+0000 7f2ddc2be640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2dd4157130 0x7f2dd40cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.681+0000 7f2ddc2be640 1 --2- 172.21.15.159:0/3163827596 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f2dd406e360 0x7f2dd40cb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.681+0000 7f2ddc2be640 1 -- 172.21.15.159:0/3163827596 >> 172.21.15.159:0/3163827596 conn(0x7f2dd406c560 msgr2=0x7f2dd40b43c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:23.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.681+0000 7f2ddc2be640 1 -- 172.21.15.159:0/3163827596 shutdown_connections 2024-07-24T16:36:23.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.681+0000 7f2ddc2be640 1 -- 172.21.15.159:0/3163827596 wait complete. 2024-07-24T16:36:23.694 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir0", "rel_path": "/snap_test_dir1/dir0", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:14", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:23.694 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir0', 'rel_path': '/snap_test_dir1/dir0', 'schedule': '1m', 'retention': {}, 'start': '2024-07-24T00:00:00', 'created': '2024-07-24T16:25:14', 'first': '2024-07-24T16:26:00', 'last': '2024-07-24T16:36:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-07-24T16:36:23.694 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-07-24T16:36:23.694 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-07-24T16:36:23.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:23.695 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2024-07-24T16:36:23.711 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:23.711 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:23.711 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:23.711 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:23.711 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:23.711 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:23.711 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:23.712 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:23.712 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:23.712 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:23.712 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:23.712 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-07-24-16_26_00_UTC', 'scheduled-2024-07-24-16_27_00_UTC', 'scheduled-2024-07-24-16_28_00_UTC', 'scheduled-2024-07-24-16_29_00_UTC', 'scheduled-2024-07-24-16_30_00_UTC', 'scheduled-2024-07-24-16_31_00_UTC', 'scheduled-2024-07-24-16_32_00_UTC', 'scheduled-2024-07-24-16_33_00_UTC', 'scheduled-2024-07-24-16_34_00_UTC', 'scheduled-2024-07-24-16_35_00_UTC', 'scheduled-2024-07-24-16_36_00_UTC'] 2024-07-24T16:36:23.712 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir1 2024-07-24T16:36:23.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.852+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1120971584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8af40cf840 msgr2=0x7f8af40cca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:23.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.852+0000 7f8afc7e8640 1 --2- 172.21.15.159:0/1120971584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8af40cf840 0x7f8af40cca20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f8ae4005fd0 tx=0x7f8ae402a4a0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.853+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1120971584 shutdown_connections 2024-07-24T16:36:23.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.853+0000 7f8afc7e8640 1 --2- 172.21.15.159:0/1120971584 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8af40cf840 0x7f8af40cca20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.853+0000 7f8afc7e8640 1 --2- 172.21.15.159:0/1120971584 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8af41524f0 0x7f8af40af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.853+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1120971584 >> 172.21.15.159:0/1120971584 conn(0x7f8af406d450 msgr2=0x7f8af406d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:23.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.853+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1120971584 shutdown_connections 2024-07-24T16:36:23.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.853+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1120971584 wait complete. 2024-07-24T16:36:23.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.854+0000 7f8afc7e8640 1 Processor -- start 2024-07-24T16:36:23.856 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.854+0000 7f8afc7e8640 1 -- start start 2024-07-24T16:36:23.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.854+0000 7f8afc7e8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8af40ccf60 0x7f8af406ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:23.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.854+0000 7f8afc7e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8af40cf840 0x7f8af4146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:23.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.854+0000 7f8afc7e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8af41524f0 0x7f8af40ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:23.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.854+0000 7f8afc7e8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8af415cc60 con 0x7f8af41524f0 2024-07-24T16:36:23.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.854+0000 7f8afc7e8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8af415cae0 con 0x7f8af40cf840 2024-07-24T16:36:23.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.854+0000 7f8afc7e8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8af415f6d0 con 0x7f8af40ccf60 2024-07-24T16:36:23.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8afad85640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8af41524f0 0x7f8af40ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:23.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8afad85640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8af41524f0 0x7f8af40ad890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51222/0 (socket says 172.21.15.159:51222) 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8afad85640 1 -- 172.21.15.159:0/1497979406 learned_addr learned my addr 172.21.15.159:0/1497979406 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8afa584640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8af40ccf60 0x7f8af406ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8af9d83640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8af40cf840 0x7f8af4146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8afad85640 1 -- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8af40ccf60 msgr2=0x7f8af406ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8afad85640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8af40ccf60 0x7f8af406ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8afad85640 1 -- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8af40cf840 msgr2=0x7f8af4146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8afad85640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8af40cf840 0x7f8af4146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8afad85640 1 -- 172.21.15.159:0/1497979406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af406f170 con 0x7f8af41524f0 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8afad85640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8af41524f0 0x7f8af40ad890 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00c780 tx=0x7f8aec00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8aeaffd640 1 -- 172.21.15.159:0/1497979406 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec004b60 con 0x7f8af41524f0 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1497979406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af4072180 con 0x7f8af41524f0 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8aeaffd640 1 -- 172.21.15.159:0/1497979406 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8aec004df0 con 0x7f8af41524f0 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8aeaffd640 1 -- 172.21.15.159:0/1497979406 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8aec00aa10 con 0x7f8af41524f0 2024-07-24T16:36:23.859 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.855+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1497979406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af4072a00 con 0x7f8af41524f0 2024-07-24T16:36:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.856+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1497979406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af415fbd0 con 0x7f8af41524f0 2024-07-24T16:36:23.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.857+0000 7f8aeaffd640 1 -- 172.21.15.159:0/1497979406 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f8aec00abb0 con 0x7f8af41524f0 2024-07-24T16:36:23.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.857+0000 7f8aeaffd640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f8ad8077210 0x7f8ad80796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:23.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.857+0000 7f8aeaffd640 1 -- 172.21.15.159:0/1497979406 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f8aec0990f0 con 0x7f8af41524f0 2024-07-24T16:36:23.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.858+0000 7f8afa584640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f8ad8077210 0x7f8ad80796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:23.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.858+0000 7f8afa584640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f8ad8077210 0x7f8ad80796d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8af0004630 tx=0x7f8af000b2e0 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:23.864 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:23.861+0000 7f8aeaffd640 1 -- 172.21.15.159:0/1497979406 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f8aec020070 con 0x7f8af41524f0 2024-07-24T16:36:24.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.065+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1497979406 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir1", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8af40b4890 con 0x7f8ad8077210 2024-07-24T16:36:24.076 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.074+0000 7f8aeaffd640 1 -- 172.21.15.159:0/1497979406 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f8af40b4890 con 0x7f8ad8077210 2024-07-24T16:36:24.077 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:24.077 INFO:teuthology.orchestra.run.smithi159.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:14", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:24.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.076+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f8ad8077210 msgr2=0x7f8ad80796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:24.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.076+0000 7f8afc7e8640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f8ad8077210 0x7f8ad80796d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8af0004630 tx=0x7f8af000b2e0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.076+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1497979406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8af41524f0 msgr2=0x7f8af40ad890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:24.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.076+0000 7f8afc7e8640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8af41524f0 0x7f8af40ad890 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00c780 tx=0x7f8aec00cc40 comp rx=0 tx=0).stop 2024-07-24T16:36:24.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.076+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1497979406 shutdown_connections 2024-07-24T16:36:24.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.076+0000 7f8afc7e8640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f8ad8077210 0x7f8ad80796d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.076+0000 7f8afc7e8640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8af41524f0 0x7f8af40ad890 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.076+0000 7f8afc7e8640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8af40cf840 0x7f8af4146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.076+0000 7f8afc7e8640 1 --2- 172.21.15.159:0/1497979406 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8af40ccf60 0x7f8af406ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.079 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.076+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1497979406 >> 172.21.15.159:0/1497979406 conn(0x7f8af406d450 msgr2=0x7f8af406d830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:24.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.076+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1497979406 shutdown_connections 2024-07-24T16:36:24.080 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.076+0000 7f8afc7e8640 1 -- 172.21.15.159:0/1497979406 wait complete. 2024-07-24T16:36:24.089 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir1", "rel_path": "/snap_test_dir1/dir1", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:14", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:24.090 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir1', 'rel_path': '/snap_test_dir1/dir1', 'schedule': '1m', 'retention': {}, 'start': '2024-07-24T00:00:00', 'created': '2024-07-24T16:25:14', 'first': '2024-07-24T16:26:00', 'last': '2024-07-24T16:36:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-07-24T16:36:24.090 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-07-24T16:36:24.090 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-07-24T16:36:24.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:24.090 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2024-07-24T16:36:24.106 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:24.107 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:24.107 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:24.107 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:24.107 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:24.107 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:24.107 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:24.107 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:24.107 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_01_UTC 2024-07-24T16:36:24.107 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:24.107 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:24.107 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-07-24-16_26_00_UTC', 'scheduled-2024-07-24-16_27_00_UTC', 'scheduled-2024-07-24-16_28_00_UTC', 'scheduled-2024-07-24-16_29_00_UTC', 'scheduled-2024-07-24-16_30_00_UTC', 'scheduled-2024-07-24-16_31_00_UTC', 'scheduled-2024-07-24-16_32_00_UTC', 'scheduled-2024-07-24-16_33_00_UTC', 'scheduled-2024-07-24-16_34_01_UTC', 'scheduled-2024-07-24-16_35_00_UTC', 'scheduled-2024-07-24-16_36_00_UTC'] 2024-07-24T16:36:24.108 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir2 2024-07-24T16:36:24.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.249+0000 7f1d1b055640 1 -- 172.21.15.159:0/1986468840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc0053c0 msgr2=0x7f1cfc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:24.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.249+0000 7f1d1b055640 1 --2- 172.21.15.159:0/1986468840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc0053c0 0x7f1cfc00b9c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c001dc0 tx=0x7f1cfc005830 comp rx=0 tx=0).stop 2024-07-24T16:36:24.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.249+0000 7f1d1b055640 1 -- 172.21.15.159:0/1986468840 shutdown_connections 2024-07-24T16:36:24.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.249+0000 7f1d1b055640 1 --2- 172.21.15.159:0/1986468840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1cfc0053c0 0x7f1cfc00b9c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.249+0000 7f1d1b055640 1 -- 172.21.15.159:0/1986468840 >> 172.21.15.159:0/1986468840 conn(0x7f1d140b2230 msgr2=0x7f1d140b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:24.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.249+0000 7f1d1b055640 1 -- 172.21.15.159:0/1986468840 shutdown_connections 2024-07-24T16:36:24.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.249+0000 7f1d1b055640 1 -- 172.21.15.159:0/1986468840 wait complete. 2024-07-24T16:36:24.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.250+0000 7f1d1b055640 1 Processor -- start 2024-07-24T16:36:24.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.250+0000 7f1d1b055640 1 -- start start 2024-07-24T16:36:24.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.251+0000 7f1d1b055640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cfc0053c0 0x7f1d14154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:24.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.251+0000 7f1d1b055640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d1414f430 0x7f1d1414b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:24.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.251+0000 7f1d1b055640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1d14152f90 0x7f1d14154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.251+0000 7f1d1b055640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1d14070070 con 0x7f1d1414f430 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.251+0000 7f1d1b055640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1d140d0240 con 0x7f1cfc0053c0 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.251+0000 7f1d1b055640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1d140701f0 con 0x7f1d14152f90 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.251+0000 7f1d0bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d1414f430 0x7f1d1414b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.251+0000 7f1d0bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d1414f430 0x7f1d1414b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51248/0 (socket says 172.21.15.159:51248) 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.251+0000 7f1d0bfff640 1 -- 172.21.15.159:0/2645091658 learned_addr learned my addr 172.21.15.159:0/2645091658 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.252+0000 7f1d18df1640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cfc0053c0 0x7f1d14154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.252+0000 7f1d195f2640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1d14152f90 0x7f1d14154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.252+0000 7f1d0bfff640 1 -- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1d14152f90 msgr2=0x7f1d14154c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.252+0000 7f1d0bfff640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1d14152f90 0x7f1d14154c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.252+0000 7f1d0bfff640 1 -- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cfc0053c0 msgr2=0x7f1d14154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.252+0000 7f1d0bfff640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cfc0053c0 0x7f1d14154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.252+0000 7f1d0bfff640 1 -- 172.21.15.159:0/2645091658 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d14153680 con 0x7f1d1414f430 2024-07-24T16:36:24.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.252+0000 7f1d0bfff640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d1414f430 0x7f1d1414b120 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1d040066b0 tx=0x7f1d040039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:24.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.252+0000 7f1d097fa640 1 -- 172.21.15.159:0/2645091658 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04011700 con 0x7f1d1414f430 2024-07-24T16:36:24.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.252+0000 7f1d097fa640 1 -- 172.21.15.159:0/2645091658 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1d04016020 con 0x7f1d1414f430 2024-07-24T16:36:24.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.252+0000 7f1d1b055640 1 -- 172.21.15.159:0/2645091658 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d14153960 con 0x7f1d1414f430 2024-07-24T16:36:24.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.252+0000 7f1d097fa640 1 -- 172.21.15.159:0/2645091658 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d04011b40 con 0x7f1d1414f430 2024-07-24T16:36:24.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.252+0000 7f1d1b055640 1 -- 172.21.15.159:0/2645091658 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d1414eee0 con 0x7f1d1414f430 2024-07-24T16:36:24.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.253+0000 7f1d1b055640 1 -- 172.21.15.159:0/2645091658 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d14072c30 con 0x7f1d1414f430 2024-07-24T16:36:24.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.254+0000 7f1d097fa640 1 -- 172.21.15.159:0/2645091658 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f1d04011ce0 con 0x7f1d1414f430 2024-07-24T16:36:24.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.254+0000 7f1d097fa640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f1d00077210 0x7f1d000796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:24.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.254+0000 7f1d097fa640 1 -- 172.21.15.159:0/2645091658 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f1d040996b0 con 0x7f1d1414f430 2024-07-24T16:36:24.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.255+0000 7f1d18df1640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f1d00077210 0x7f1d000796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:24.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.255+0000 7f1d18df1640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f1d00077210 0x7f1d000796d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1d10005fd0 tx=0x7f1d1000d360 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:24.261 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.259+0000 7f1d097fa640 1 -- 172.21.15.159:0/2645091658 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f1d04020030 con 0x7f1d1414f430 2024-07-24T16:36:24.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.463+0000 7f1d1b055640 1 -- 172.21.15.159:0/2645091658 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir2", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1d140b0d50 con 0x7f1d00077210 2024-07-24T16:36:24.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.472+0000 7f1d097fa640 1 -- 172.21.15.159:0/2645091658 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f1d140b0d50 con 0x7f1d00077210 2024-07-24T16:36:24.475 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:24.475 INFO:teuthology.orchestra.run.smithi159.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:15", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.474+0000 7f1d1b055640 1 -- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f1d00077210 msgr2=0x7f1d000796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.474+0000 7f1d1b055640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f1d00077210 0x7f1d000796d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1d10005fd0 tx=0x7f1d1000d360 comp rx=0 tx=0).stop 2024-07-24T16:36:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.474+0000 7f1d1b055640 1 -- 172.21.15.159:0/2645091658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d1414f430 msgr2=0x7f1d1414b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.474+0000 7f1d1b055640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d1414f430 0x7f1d1414b120 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f1d040066b0 tx=0x7f1d040039c0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.474+0000 7f1d1b055640 1 -- 172.21.15.159:0/2645091658 shutdown_connections 2024-07-24T16:36:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.474+0000 7f1d1b055640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f1d00077210 0x7f1d000796d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.474+0000 7f1d1b055640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1d14152f90 0x7f1d14154c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.474+0000 7f1d1b055640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1d1414f430 0x7f1d1414b120 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.474+0000 7f1d1b055640 1 --2- 172.21.15.159:0/2645091658 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1cfc0053c0 0x7f1d14154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.474+0000 7f1d1b055640 1 -- 172.21.15.159:0/2645091658 >> 172.21.15.159:0/2645091658 conn(0x7f1d140b2230 msgr2=0x7f1d140cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:24.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.474+0000 7f1d1b055640 1 -- 172.21.15.159:0/2645091658 shutdown_connections 2024-07-24T16:36:24.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.474+0000 7f1d1b055640 1 -- 172.21.15.159:0/2645091658 wait complete. 2024-07-24T16:36:24.488 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir2", "rel_path": "/snap_test_dir1/dir2", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:15", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:24.488 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir2', 'rel_path': '/snap_test_dir1/dir2', 'schedule': '1m', 'retention': {}, 'start': '2024-07-24T00:00:00', 'created': '2024-07-24T16:25:15', 'first': '2024-07-24T16:26:00', 'last': '2024-07-24T16:36:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-07-24T16:36:24.488 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-07-24T16:36:24.488 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-07-24T16:36:24.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:24.488 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2024-07-24T16:36:24.505 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:24.505 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:24.505 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:24.505 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:24.505 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:24.505 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:24.505 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:24.505 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:24.505 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:24.505 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:24.505 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:24.506 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-07-24-16_26_00_UTC', 'scheduled-2024-07-24-16_27_00_UTC', 'scheduled-2024-07-24-16_28_00_UTC', 'scheduled-2024-07-24-16_29_00_UTC', 'scheduled-2024-07-24-16_30_00_UTC', 'scheduled-2024-07-24-16_31_00_UTC', 'scheduled-2024-07-24-16_32_00_UTC', 'scheduled-2024-07-24-16_33_00_UTC', 'scheduled-2024-07-24-16_34_00_UTC', 'scheduled-2024-07-24-16_35_00_UTC', 'scheduled-2024-07-24-16_36_00_UTC'] 2024-07-24T16:36:24.506 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir3 2024-07-24T16:36:24.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.647+0000 7f98014cb640 1 -- 172.21.15.159:0/2473665231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97fc0b5290 msgr2=0x7f97fc0b5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:24.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.647+0000 7f98014cb640 1 --2- 172.21.15.159:0/2473665231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97fc0b5290 0x7f97fc0b5670 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f97fc0b6290 tx=0x7f97ec02a980 comp rx=0 tx=0).stop 2024-07-24T16:36:24.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.647+0000 7f98014cb640 1 -- 172.21.15.159:0/2473665231 shutdown_connections 2024-07-24T16:36:24.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.647+0000 7f98014cb640 1 --2- 172.21.15.159:0/2473665231 >> v2:172.21.15.193:3300/0 conn(0x7f97fc0b7fe0 0x7f97fc0ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.647+0000 7f98014cb640 1 --2- 172.21.15.159:0/2473665231 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97fc0b5290 0x7f97fc0b5670 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.647+0000 7f98014cb640 1 -- 172.21.15.159:0/2473665231 >> 172.21.15.159:0/2473665231 conn(0x7f97fc0d3810 msgr2=0x7f97fc0d3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:24.650 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.647+0000 7f98014cb640 1 -- 172.21.15.159:0/2473665231 shutdown_connections 2024-07-24T16:36:24.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.647+0000 7f98014cb640 1 -- 172.21.15.159:0/2473665231 wait complete. 2024-07-24T16:36:24.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.648+0000 7f98014cb640 1 Processor -- start 2024-07-24T16:36:24.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.649+0000 7f98014cb640 1 -- start start 2024-07-24T16:36:24.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.649+0000 7f98014cb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97fc0b5290 0x7f97fc1f7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:24.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.649+0000 7f98014cb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97fc0b7fe0 0x7f97fc0c9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:24.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.649+0000 7f98014cb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97fc0d2270 0x7f97fc0ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:24.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.649+0000 7f98014cb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc0d3040 con 0x7f97fc0b7fe0 2024-07-24T16:36:24.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.649+0000 7f98014cb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f97fc0cee40 con 0x7f97fc0d2270 2024-07-24T16:36:24.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.649+0000 7f98014cb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f97fc0d1350 con 0x7f97fc0b5290 2024-07-24T16:36:24.653 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.649+0000 7f97fa7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97fc0b7fe0 0x7f97fc0c9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:24.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.649+0000 7f97fa7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97fc0b7fe0 0x7f97fc0c9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51264/0 (socket says 172.21.15.159:51264) 2024-07-24T16:36:24.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.649+0000 7f97fa7fc640 1 -- 172.21.15.159:0/2874996059 learned_addr learned my addr 172.21.15.159:0/2874996059 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:24.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.649+0000 7f97faffd640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97fc0b5290 0x7f97fc1f7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:24.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.650+0000 7f97fb7fe640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97fc0d2270 0x7f97fc0ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:24.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.650+0000 7f97fa7fc640 1 -- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97fc0b5290 msgr2=0x7f97fc1f7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:24.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.650+0000 7f97fa7fc640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97fc0b5290 0x7f97fc1f7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.650+0000 7f97fa7fc640 1 -- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97fc0d2270 msgr2=0x7f97fc0ca110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:24.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.650+0000 7f97fa7fc640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97fc0d2270 0x7f97fc0ca110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.650+0000 7f97fa7fc640 1 -- 172.21.15.159:0/2874996059 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97fc146ee0 con 0x7f97fc0b7fe0 2024-07-24T16:36:24.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.650+0000 7f97fa7fc640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97fc0b7fe0 0x7f97fc0c9bd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f97e400b3f0 tx=0x7f97e400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:24.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.650+0000 7f97f37fe640 1 -- 172.21.15.159:0/2874996059 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4015020 con 0x7f97fc0b7fe0 2024-07-24T16:36:24.654 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.650+0000 7f97f37fe640 1 -- 172.21.15.159:0/2874996059 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97e4011920 con 0x7f97fc0b7fe0 2024-07-24T16:36:24.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.650+0000 7f98014cb640 1 -- 172.21.15.159:0/2874996059 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97fc1471c0 con 0x7f97fc0b7fe0 2024-07-24T16:36:24.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.650+0000 7f97f37fe640 1 -- 172.21.15.159:0/2874996059 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e4011d70 con 0x7f97fc0b7fe0 2024-07-24T16:36:24.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.650+0000 7f98014cb640 1 -- 172.21.15.159:0/2874996059 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97fc149d70 con 0x7f97fc0b7fe0 2024-07-24T16:36:24.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.651+0000 7f98014cb640 1 -- 172.21.15.159:0/2874996059 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97fc0d46b0 con 0x7f97fc0b7fe0 2024-07-24T16:36:24.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.652+0000 7f97f37fe640 1 -- 172.21.15.159:0/2874996059 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f97e4018020 con 0x7f97fc0b7fe0 2024-07-24T16:36:24.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.652+0000 7f97f37fe640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f97dc077210 0x7f97dc0796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:24.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.652+0000 7f97f37fe640 1 -- 172.21.15.159:0/2874996059 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f97e4098a50 con 0x7f97fc0b7fe0 2024-07-24T16:36:24.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.652+0000 7f97faffd640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f97dc077210 0x7f97dc0796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:24.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.653+0000 7f97faffd640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f97dc077210 0x7f97dc0796d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97ec035000 tx=0x7f97ec03c040 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:24.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.656+0000 7f97f37fe640 1 -- 172.21.15.159:0/2874996059 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f97fc0d46b0 con 0x7f97fc0b7fe0 2024-07-24T16:36:24.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.859+0000 7f98014cb640 1 -- 172.21.15.159:0/2874996059 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir3", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97fc0b5670 con 0x7f97dc077210 2024-07-24T16:36:24.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.868+0000 7f97f37fe640 1 -- 172.21.15.159:0/2874996059 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f97fc0b5670 con 0x7f97dc077210 2024-07-24T16:36:24.870 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:24.871 INFO:teuthology.orchestra.run.smithi159.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:15", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:24.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.870+0000 7f98014cb640 1 -- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f97dc077210 msgr2=0x7f97dc0796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:24.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.870+0000 7f98014cb640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f97dc077210 0x7f97dc0796d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f97ec035000 tx=0x7f97ec03c040 comp rx=0 tx=0).stop 2024-07-24T16:36:24.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.870+0000 7f98014cb640 1 -- 172.21.15.159:0/2874996059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97fc0b7fe0 msgr2=0x7f97fc0c9bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:24.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.870+0000 7f98014cb640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97fc0b7fe0 0x7f97fc0c9bd0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f97e400b3f0 tx=0x7f97e400b8b0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.870+0000 7f98014cb640 1 -- 172.21.15.159:0/2874996059 shutdown_connections 2024-07-24T16:36:24.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.870+0000 7f98014cb640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f97dc077210 0x7f97dc0796d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.870+0000 7f98014cb640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f97fc0d2270 0x7f97fc0ca110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.870+0000 7f98014cb640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f97fc0b7fe0 0x7f97fc0c9bd0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.870+0000 7f98014cb640 1 --2- 172.21.15.159:0/2874996059 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f97fc0b5290 0x7f97fc1f7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:24.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.870+0000 7f98014cb640 1 -- 172.21.15.159:0/2874996059 >> 172.21.15.159:0/2874996059 conn(0x7f97fc0d3810 msgr2=0x7f97fc15bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:24.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.870+0000 7f98014cb640 1 -- 172.21.15.159:0/2874996059 shutdown_connections 2024-07-24T16:36:24.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:24.870+0000 7f98014cb640 1 -- 172.21.15.159:0/2874996059 wait complete. 2024-07-24T16:36:24.883 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir3", "rel_path": "/snap_test_dir1/dir3", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:15", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:24.883 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir3', 'rel_path': '/snap_test_dir1/dir3', 'schedule': '1m', 'retention': {}, 'start': '2024-07-24T00:00:00', 'created': '2024-07-24T16:25:15', 'first': '2024-07-24T16:26:00', 'last': '2024-07-24T16:36:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-07-24T16:36:24.883 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-07-24T16:36:24.883 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-07-24T16:36:24.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:24.884 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2024-07-24T16:36:24.900 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:24.900 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:24.900 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:24.900 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:24.900 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:24.900 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:24.901 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:24.901 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:24.901 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:24.901 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:24.901 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:24.901 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-07-24-16_26_00_UTC', 'scheduled-2024-07-24-16_27_00_UTC', 'scheduled-2024-07-24-16_28_00_UTC', 'scheduled-2024-07-24-16_29_00_UTC', 'scheduled-2024-07-24-16_30_00_UTC', 'scheduled-2024-07-24-16_31_00_UTC', 'scheduled-2024-07-24-16_32_00_UTC', 'scheduled-2024-07-24-16_33_00_UTC', 'scheduled-2024-07-24-16_34_00_UTC', 'scheduled-2024-07-24-16_35_00_UTC', 'scheduled-2024-07-24-16_36_00_UTC'] 2024-07-24T16:36:24.901 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir4 2024-07-24T16:36:25.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.042+0000 7f67a998b640 1 -- 172.21.15.159:0/1056443764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a40b2ae0 msgr2=0x7f67a40b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:25.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.042+0000 7f67a998b640 1 --2- 172.21.15.159:0/1056443764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a40b2ae0 0x7f67a40b0620 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f67a40cf250 tx=0x7f679802a560 comp rx=0 tx=0).stop 2024-07-24T16:36:25.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.042+0000 7f67a998b640 1 -- 172.21.15.159:0/1056443764 shutdown_connections 2024-07-24T16:36:25.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.042+0000 7f67a998b640 1 --2- 172.21.15.159:0/1056443764 >> v2:172.21.15.193:3300/0 conn(0x7f67a40b0b60 0x7f67a40cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.042+0000 7f67a998b640 1 --2- 172.21.15.159:0/1056443764 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a40b2ae0 0x7f67a40b0620 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.042+0000 7f67a998b640 1 --2- 172.21.15.159:0/1056443764 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f67a415d950 0x7f67a4161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.042+0000 7f67a998b640 1 -- 172.21.15.159:0/1056443764 >> 172.21.15.159:0/1056443764 conn(0x7f67a409cd30 msgr2=0x7f67a40d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:25.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.042+0000 7f67a998b640 1 -- 172.21.15.159:0/1056443764 shutdown_connections 2024-07-24T16:36:25.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.042+0000 7f67a998b640 1 -- 172.21.15.159:0/1056443764 wait complete. 2024-07-24T16:36:25.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.043+0000 7f67a998b640 1 Processor -- start 2024-07-24T16:36:25.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.043+0000 7f67a998b640 1 -- start start 2024-07-24T16:36:25.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a998b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f67a40b0b60 0x7f67a4159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:25.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a998b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67a40b2ae0 0x7f67a40b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:25.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a998b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a415d950 0x7f67a4146780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:25.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a998b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f67a40d0040 con 0x7f67a415d950 2024-07-24T16:36:25.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a998b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f67a40cfec0 con 0x7f67a40b2ae0 2024-07-24T16:36:25.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a998b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f67a40d02e0 con 0x7f67a40b0b60 2024-07-24T16:36:25.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a37fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a415d950 0x7f67a4146780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:25.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a37fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a415d950 0x7f67a4146780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51288/0 (socket says 172.21.15.159:51288) 2024-07-24T16:36:25.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a37fe640 1 -- 172.21.15.159:0/214059312 learned_addr learned my addr 172.21.15.159:0/214059312 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:25.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a27fc640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67a40b2ae0 0x7f67a40b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:25.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a2ffd640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f67a40b0b60 0x7f67a4159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:25.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a37fe640 1 -- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f67a40b0b60 msgr2=0x7f67a4159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:25.048 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a37fe640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f67a40b0b60 0x7f67a4159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a37fe640 1 -- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67a40b2ae0 msgr2=0x7f67a40b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:25.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a37fe640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67a40b2ae0 0x7f67a40b4fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.044+0000 7f67a37fe640 1 -- 172.21.15.159:0/214059312 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67a40b3f10 con 0x7f67a415d950 2024-07-24T16:36:25.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.045+0000 7f67a37fe640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a415d950 0x7f67a4146780 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f679c00cab0 tx=0x7f679c00cf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:25.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.045+0000 7f678bfff640 1 -- 172.21.15.159:0/214059312 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c00ae20 con 0x7f67a415d950 2024-07-24T16:36:25.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.045+0000 7f678bfff640 1 -- 172.21.15.159:0/214059312 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f679c003970 con 0x7f67a415d950 2024-07-24T16:36:25.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.045+0000 7f67a998b640 1 -- 172.21.15.159:0/214059312 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67a40b41f0 con 0x7f67a415d950 2024-07-24T16:36:25.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.045+0000 7f678bfff640 1 -- 172.21.15.159:0/214059312 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f679c003d80 con 0x7f67a415d950 2024-07-24T16:36:25.049 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.045+0000 7f67a998b640 1 -- 172.21.15.159:0/214059312 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67a40b47b0 con 0x7f67a415d950 2024-07-24T16:36:25.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.046+0000 7f67a998b640 1 -- 172.21.15.159:0/214059312 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67a40b0620 con 0x7f67a415d950 2024-07-24T16:36:25.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.046+0000 7f678bfff640 1 -- 172.21.15.159:0/214059312 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f679c004030 con 0x7f67a415d950 2024-07-24T16:36:25.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.047+0000 7f678bfff640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6790077210 0x7f67900796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:25.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.047+0000 7f678bfff640 1 -- 172.21.15.159:0/214059312 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f679c099690 con 0x7f67a415d950 2024-07-24T16:36:25.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.047+0000 7f67a2ffd640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6790077210 0x7f67900796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:25.050 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.048+0000 7f67a2ffd640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6790077210 0x7f67900796d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6794005fd0 tx=0x7f679400a250 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:25.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.051+0000 7f678bfff640 1 -- 172.21.15.159:0/214059312 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f679c014070 con 0x7f67a415d950 2024-07-24T16:36:25.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.254+0000 7f67a998b640 1 -- 172.21.15.159:0/214059312 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir4", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67a415a090 con 0x7f6790077210 2024-07-24T16:36:25.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.263+0000 7f678bfff640 1 -- 172.21.15.159:0/214059312 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f67a415a090 con 0x7f6790077210 2024-07-24T16:36:25.265 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:25.265 INFO:teuthology.orchestra.run.smithi159.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:15", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:25.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.265+0000 7f67a998b640 1 -- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6790077210 msgr2=0x7f67900796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:25.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.265+0000 7f67a998b640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6790077210 0x7f67900796d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6794005fd0 tx=0x7f679400a250 comp rx=0 tx=0).stop 2024-07-24T16:36:25.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.265+0000 7f67a998b640 1 -- 172.21.15.159:0/214059312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a415d950 msgr2=0x7f67a4146780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:25.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.265+0000 7f67a998b640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a415d950 0x7f67a4146780 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f679c00cab0 tx=0x7f679c00cf70 comp rx=0 tx=0).stop 2024-07-24T16:36:25.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.265+0000 7f67a998b640 1 -- 172.21.15.159:0/214059312 shutdown_connections 2024-07-24T16:36:25.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.265+0000 7f67a998b640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6790077210 0x7f67900796d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.265+0000 7f67a998b640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67a415d950 0x7f67a4146780 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.265+0000 7f67a998b640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67a40b2ae0 0x7f67a40b4fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.265+0000 7f67a998b640 1 --2- 172.21.15.159:0/214059312 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f67a40b0b60 0x7f67a4159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.265+0000 7f67a998b640 1 -- 172.21.15.159:0/214059312 >> 172.21.15.159:0/214059312 conn(0x7f67a409cd30 msgr2=0x7f67a40b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:25.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.265+0000 7f67a998b640 1 -- 172.21.15.159:0/214059312 shutdown_connections 2024-07-24T16:36:25.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.265+0000 7f67a998b640 1 -- 172.21.15.159:0/214059312 wait complete. 2024-07-24T16:36:25.278 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir4", "rel_path": "/snap_test_dir1/dir4", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:15", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:25.278 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir4', 'rel_path': '/snap_test_dir1/dir4', 'schedule': '1m', 'retention': {}, 'start': '2024-07-24T00:00:00', 'created': '2024-07-24T16:25:15', 'first': '2024-07-24T16:26:00', 'last': '2024-07-24T16:36:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-07-24T16:36:25.278 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-07-24T16:36:25.278 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-07-24T16:36:25.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:25.279 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2024-07-24T16:36:25.295 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:25.295 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:25.295 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:25.295 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:25.295 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:25.295 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:25.295 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:25.296 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:25.296 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:25.296 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:25.296 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:25.296 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-07-24-16_26_00_UTC', 'scheduled-2024-07-24-16_27_00_UTC', 'scheduled-2024-07-24-16_28_00_UTC', 'scheduled-2024-07-24-16_29_00_UTC', 'scheduled-2024-07-24-16_30_00_UTC', 'scheduled-2024-07-24-16_31_00_UTC', 'scheduled-2024-07-24-16_32_00_UTC', 'scheduled-2024-07-24-16_33_00_UTC', 'scheduled-2024-07-24-16_34_00_UTC', 'scheduled-2024-07-24-16_35_00_UTC', 'scheduled-2024-07-24-16_36_00_UTC'] 2024-07-24T16:36:25.296 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir5 2024-07-24T16:36:25.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.438+0000 7fbce4ae1640 1 -- 172.21.15.159:0/1340285789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce00cfb50 msgr2=0x7fbce00cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.438+0000 7fbce4ae1640 1 --2- 172.21.15.159:0/1340285789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce00cfb50 0x7fbce00cbc10 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbce0073bb0 tx=0x7fbcd802aa30 comp rx=0 tx=0).stop 2024-07-24T16:36:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.438+0000 7fbce4ae1640 1 -- 172.21.15.159:0/1340285789 shutdown_connections 2024-07-24T16:36:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.438+0000 7fbce4ae1640 1 --2- 172.21.15.159:0/1340285789 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce00cfb50 0x7fbce00cbc10 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.438+0000 7fbce4ae1640 1 --2- 172.21.15.159:0/1340285789 >> v2:172.21.15.193:3300/0 conn(0x7fbce00cf770 0x7fbce015b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.438+0000 7fbce4ae1640 1 -- 172.21.15.159:0/1340285789 >> 172.21.15.159:0/1340285789 conn(0x7fbce006c560 msgr2=0x7fbce006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.438+0000 7fbce4ae1640 1 -- 172.21.15.159:0/1340285789 shutdown_connections 2024-07-24T16:36:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.438+0000 7fbce4ae1640 1 -- 172.21.15.159:0/1340285789 wait complete. 2024-07-24T16:36:25.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.439+0000 7fbce4ae1640 1 Processor -- start 2024-07-24T16:36:25.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.439+0000 7fbce4ae1640 1 -- start start 2024-07-24T16:36:25.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbce4ae1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce006dba0 0x7fbce013ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:25.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbce4ae1640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbce00cf770 0x7fbce01e42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:25.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbce4ae1640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbce00cfb50 0x7fbce014d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:25.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbce4ae1640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbce00aea50 con 0x7fbce006dba0 2024-07-24T16:36:25.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbce4ae1640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbce00ae8d0 con 0x7fbce00cfb50 2024-07-24T16:36:25.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbce4ae1640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbce00aebd0 con 0x7fbce00cf770 2024-07-24T16:36:25.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbcde59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce006dba0 0x7fbce013ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:25.444 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbcde59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce006dba0 0x7fbce013ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51314/0 (socket says 172.21.15.159:51314) 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbcde59c640 1 -- 172.21.15.159:0/4122220874 learned_addr learned my addr 172.21.15.159:0/4122220874 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbcded9d640 1 --2- 172.21.15.159:0/4122220874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbce00cfb50 0x7fbce014d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbcde59c640 1 -- 172.21.15.159:0/4122220874 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbce00cf770 msgr2=0x7fbce01e42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbcde59c640 1 --2- 172.21.15.159:0/4122220874 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbce00cf770 0x7fbce01e42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbcde59c640 1 -- 172.21.15.159:0/4122220874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbce00cfb50 msgr2=0x7fbce014d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbcde59c640 1 --2- 172.21.15.159:0/4122220874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbce00cfb50 0x7fbce014d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.440+0000 7fbcde59c640 1 -- 172.21.15.159:0/4122220874 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbce013cd70 con 0x7fbce006dba0 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.441+0000 7fbcde59c640 1 --2- 172.21.15.159:0/4122220874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce006dba0 0x7fbce013ad40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000c9a0 tx=0x7fbcd000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.441+0000 7fbcd77fe640 1 -- 172.21.15.159:0/4122220874 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0007bb0 con 0x7fbce006dba0 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.441+0000 7fbcd77fe640 1 -- 172.21.15.159:0/4122220874 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbcd0005020 con 0x7fbce006dba0 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.441+0000 7fbce4ae1640 1 -- 172.21.15.159:0/4122220874 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbce013d020 con 0x7fbce006dba0 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.441+0000 7fbcd77fe640 1 -- 172.21.15.159:0/4122220874 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd0007e60 con 0x7fbce006dba0 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.441+0000 7fbce4ae1640 1 -- 172.21.15.159:0/4122220874 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbce013d5e0 con 0x7fbce006dba0 2024-07-24T16:36:25.445 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.442+0000 7fbce4ae1640 1 -- 172.21.15.159:0/4122220874 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbce015b4b0 con 0x7fbce006dba0 2024-07-24T16:36:25.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.442+0000 7fbcd77fe640 1 -- 172.21.15.159:0/4122220874 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7fbcd0005470 con 0x7fbce006dba0 2024-07-24T16:36:25.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.443+0000 7fbcd77fe640 1 --2- 172.21.15.159:0/4122220874 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fbcc0077210 0x7fbcc00796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:25.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.443+0000 7fbcd77fe640 1 -- 172.21.15.159:0/4122220874 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7fbcd0099510 con 0x7fbce006dba0 2024-07-24T16:36:25.446 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.443+0000 7fbcd5d9b640 1 --2- 172.21.15.159:0/4122220874 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fbcc0077210 0x7fbcc00796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:25.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.444+0000 7fbcd5d9b640 1 --2- 172.21.15.159:0/4122220874 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fbcc0077210 0x7fbcc00796d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbce0141450 tx=0x7fbcc8007990 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:25.449 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.447+0000 7fbcd77fe640 1 -- 172.21.15.159:0/4122220874 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fbcd0014030 con 0x7fbce006dba0 2024-07-24T16:36:25.651 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.648+0000 7fbce4ae1640 1 -- 172.21.15.159:0/4122220874 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir5", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbce015a300 con 0x7fbcc0077210 2024-07-24T16:36:25.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.658+0000 7fbcd77fe640 1 -- 172.21.15.159:0/4122220874 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7fbce015a300 con 0x7fbcc0077210 2024-07-24T16:36:25.660 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:25.660 INFO:teuthology.orchestra.run.smithi159.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:16", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:25.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.660+0000 7fbce4ae1640 1 -- 172.21.15.159:0/4122220874 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fbcc0077210 msgr2=0x7fbcc00796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:25.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.660+0000 7fbce4ae1640 1 --2- 172.21.15.159:0/4122220874 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fbcc0077210 0x7fbcc00796d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbce0141450 tx=0x7fbcc8007990 comp rx=0 tx=0).stop 2024-07-24T16:36:25.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.660+0000 7fbce4ae1640 1 -- 172.21.15.159:0/4122220874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce006dba0 msgr2=0x7fbce013ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:25.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.660+0000 7fbce4ae1640 1 --2- 172.21.15.159:0/4122220874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce006dba0 0x7fbce013ad40 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbcd000c9a0 tx=0x7fbcd000ce60 comp rx=0 tx=0).stop 2024-07-24T16:36:25.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.660+0000 7fbce4ae1640 1 -- 172.21.15.159:0/4122220874 shutdown_connections 2024-07-24T16:36:25.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.660+0000 7fbce4ae1640 1 --2- 172.21.15.159:0/4122220874 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fbcc0077210 0x7fbcc00796d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.660+0000 7fbce4ae1640 1 --2- 172.21.15.159:0/4122220874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbce00cfb50 0x7fbce014d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.660+0000 7fbce4ae1640 1 --2- 172.21.15.159:0/4122220874 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbce00cf770 0x7fbce01e42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.660+0000 7fbce4ae1640 1 --2- 172.21.15.159:0/4122220874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbce006dba0 0x7fbce013ad40 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.660+0000 7fbce4ae1640 1 -- 172.21.15.159:0/4122220874 >> 172.21.15.159:0/4122220874 conn(0x7fbce006c560 msgr2=0x7fbce0153ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:25.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.660+0000 7fbce4ae1640 1 -- 172.21.15.159:0/4122220874 shutdown_connections 2024-07-24T16:36:25.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.660+0000 7fbce4ae1640 1 -- 172.21.15.159:0/4122220874 wait complete. 2024-07-24T16:36:25.673 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir5", "rel_path": "/snap_test_dir1/dir5", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:16", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:25.673 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir5', 'rel_path': '/snap_test_dir1/dir5', 'schedule': '1m', 'retention': {}, 'start': '2024-07-24T00:00:00', 'created': '2024-07-24T16:25:16', 'first': '2024-07-24T16:26:00', 'last': '2024-07-24T16:36:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-07-24T16:36:25.673 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-07-24T16:36:25.673 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-07-24T16:36:25.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:25.674 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2024-07-24T16:36:25.689 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:25.689 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:25.689 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:25.689 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:25.690 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:25.690 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:25.690 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:25.690 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:25.690 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:25.690 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:25.690 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:25.691 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-07-24-16_26_00_UTC', 'scheduled-2024-07-24-16_27_00_UTC', 'scheduled-2024-07-24-16_28_00_UTC', 'scheduled-2024-07-24-16_29_00_UTC', 'scheduled-2024-07-24-16_30_00_UTC', 'scheduled-2024-07-24-16_31_00_UTC', 'scheduled-2024-07-24-16_32_00_UTC', 'scheduled-2024-07-24-16_33_00_UTC', 'scheduled-2024-07-24-16_34_00_UTC', 'scheduled-2024-07-24-16_35_00_UTC', 'scheduled-2024-07-24-16_36_00_UTC'] 2024-07-24T16:36:25.694 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir6 2024-07-24T16:36:25.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.833+0000 7faf5b49a640 1 -- 172.21.15.159:0/2564847272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf540cf770 msgr2=0x7faf540cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:25.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.833+0000 7faf5b49a640 1 --2- 172.21.15.159:0/2564847272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf540cf770 0x7faf540cfbc0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7faf5408c710 tx=0x7faf4c02a5f0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.833+0000 7faf5b49a640 1 -- 172.21.15.159:0/2564847272 shutdown_connections 2024-07-24T16:36:25.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.833+0000 7faf5b49a640 1 --2- 172.21.15.159:0/2564847272 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf540cf770 0x7faf540cfbc0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.833+0000 7faf5b49a640 1 --2- 172.21.15.159:0/2564847272 >> v2:172.21.15.193:3300/0 conn(0x7faf5415d950 0x7faf54161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.836 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.833+0000 7faf5b49a640 1 -- 172.21.15.159:0/2564847272 >> 172.21.15.159:0/2564847272 conn(0x7faf5409cd30 msgr2=0x7faf540d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:25.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.833+0000 7faf5b49a640 1 -- 172.21.15.159:0/2564847272 shutdown_connections 2024-07-24T16:36:25.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.833+0000 7faf5b49a640 1 -- 172.21.15.159:0/2564847272 wait complete. 2024-07-24T16:36:25.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.835+0000 7faf5b49a640 1 Processor -- start 2024-07-24T16:36:25.837 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.835+0000 7faf5b49a640 1 -- start start 2024-07-24T16:36:25.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.835+0000 7faf5b49a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf540b2ae0 0x7faf541f4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:25.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.835+0000 7faf5b49a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf540cf770 0x7faf541f35e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:25.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.835+0000 7faf5b49a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf5415d950 0x7faf541f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:25.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.835+0000 7faf5b49a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7faf540d02e0 con 0x7faf540cf770 2024-07-24T16:36:25.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.835+0000 7faf5b49a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7faf5415de40 con 0x7faf540b2ae0 2024-07-24T16:36:25.839 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.835+0000 7faf5b49a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7faf540d0460 con 0x7faf5415d950 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.835+0000 7faf58a35640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf540cf770 0x7faf541f35e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf58a35640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf540cf770 0x7faf541f35e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51338/0 (socket says 172.21.15.159:51338) 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf58a35640 1 -- 172.21.15.159:0/1636677858 learned_addr learned my addr 172.21.15.159:0/1636677858 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf59236640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf540b2ae0 0x7faf541f4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf59a37640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf5415d950 0x7faf541f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf58a35640 1 -- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf5415d950 msgr2=0x7faf541f3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf58a35640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf5415d950 0x7faf541f3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf58a35640 1 -- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf540b2ae0 msgr2=0x7faf541f4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf58a35640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf540b2ae0 0x7faf541f4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf58a35640 1 -- 172.21.15.159:0/1636677858 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf540c8ba0 con 0x7faf540cf770 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf58a35640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf540cf770 0x7faf541f35e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7faf4800c430 tx=0x7faf4800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf51ffb640 1 -- 172.21.15.159:0/1636677858 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf48011790 con 0x7faf540cf770 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf51ffb640 1 -- 172.21.15.159:0/1636677858 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faf48017070 con 0x7faf540cf770 2024-07-24T16:36:25.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf5b49a640 1 -- 172.21.15.159:0/1636677858 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf540c8e80 con 0x7faf540cf770 2024-07-24T16:36:25.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf51ffb640 1 -- 172.21.15.159:0/1636677858 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf48011d00 con 0x7faf540cf770 2024-07-24T16:36:25.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.836+0000 7faf5b49a640 1 -- 172.21.15.159:0/1636677858 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf540c9440 con 0x7faf540cf770 2024-07-24T16:36:25.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.837+0000 7faf5b49a640 1 -- 172.21.15.159:0/1636677858 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf540cfbc0 con 0x7faf540cf770 2024-07-24T16:36:25.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.838+0000 7faf51ffb640 1 -- 172.21.15.159:0/1636677858 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7faf4801c460 con 0x7faf540cf770 2024-07-24T16:36:25.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.838+0000 7faf51ffb640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7faf40077210 0x7faf400796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:25.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.838+0000 7faf51ffb640 1 -- 172.21.15.159:0/1636677858 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7faf48098c10 con 0x7faf540cf770 2024-07-24T16:36:25.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.839+0000 7faf59236640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7faf40077210 0x7faf400796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:25.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.839+0000 7faf59236640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7faf40077210 0x7faf400796d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf4400ae50 tx=0x7faf4400a540 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:25.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:25.843+0000 7faf51ffb640 1 -- 172.21.15.159:0/1636677858 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7faf480613b0 con 0x7faf540cf770 2024-07-24T16:36:26.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.044+0000 7faf5b49a640 1 -- 172.21.15.159:0/1636677858 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir6", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7faf540b1b80 con 0x7faf40077210 2024-07-24T16:36:26.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.053+0000 7faf51ffb640 1 -- 172.21.15.159:0/1636677858 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7faf540b1b80 con 0x7faf40077210 2024-07-24T16:36:26.055 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:26.055 INFO:teuthology.orchestra.run.smithi159.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:16", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:26.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.055+0000 7faf5b49a640 1 -- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7faf40077210 msgr2=0x7faf400796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:26.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.055+0000 7faf5b49a640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7faf40077210 0x7faf400796d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7faf4400ae50 tx=0x7faf4400a540 comp rx=0 tx=0).stop 2024-07-24T16:36:26.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.055+0000 7faf5b49a640 1 -- 172.21.15.159:0/1636677858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf540cf770 msgr2=0x7faf541f35e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:26.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.055+0000 7faf5b49a640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf540cf770 0x7faf541f35e0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7faf4800c430 tx=0x7faf4800c8f0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.055+0000 7faf5b49a640 1 -- 172.21.15.159:0/1636677858 shutdown_connections 2024-07-24T16:36:26.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.055+0000 7faf5b49a640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7faf40077210 0x7faf400796d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.055+0000 7faf5b49a640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7faf5415d950 0x7faf541f3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.055+0000 7faf5b49a640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7faf540cf770 0x7faf541f35e0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.055+0000 7faf5b49a640 1 --2- 172.21.15.159:0/1636677858 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7faf540b2ae0 0x7faf541f4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.055+0000 7faf5b49a640 1 -- 172.21.15.159:0/1636677858 >> 172.21.15.159:0/1636677858 conn(0x7faf5409cd30 msgr2=0x7faf540d4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:26.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.055+0000 7faf5b49a640 1 -- 172.21.15.159:0/1636677858 shutdown_connections 2024-07-24T16:36:26.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.055+0000 7faf5b49a640 1 -- 172.21.15.159:0/1636677858 wait complete. 2024-07-24T16:36:26.068 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir6", "rel_path": "/snap_test_dir1/dir6", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:16", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:26.068 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir6', 'rel_path': '/snap_test_dir1/dir6', 'schedule': '1m', 'retention': {}, 'start': '2024-07-24T00:00:00', 'created': '2024-07-24T16:25:16', 'first': '2024-07-24T16:26:00', 'last': '2024-07-24T16:36:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-07-24T16:36:26.068 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-07-24T16:36:26.068 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-07-24T16:36:26.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:26.069 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2024-07-24T16:36:26.085 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:26.085 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:26.085 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:26.085 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:26.085 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:26.085 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:26.085 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:26.085 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:26.085 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:26.086 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:26.086 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:26.086 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-07-24-16_26_00_UTC', 'scheduled-2024-07-24-16_27_00_UTC', 'scheduled-2024-07-24-16_28_00_UTC', 'scheduled-2024-07-24-16_29_00_UTC', 'scheduled-2024-07-24-16_30_00_UTC', 'scheduled-2024-07-24-16_31_00_UTC', 'scheduled-2024-07-24-16_32_00_UTC', 'scheduled-2024-07-24-16_33_00_UTC', 'scheduled-2024-07-24-16_34_00_UTC', 'scheduled-2024-07-24-16_35_00_UTC', 'scheduled-2024-07-24-16_36_00_UTC'] 2024-07-24T16:36:26.086 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir7 2024-07-24T16:36:26.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.229+0000 7f7bb27bb640 1 -- 172.21.15.159:0/3988675680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac0b2ae0 msgr2=0x7f7bac0b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:26.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.229+0000 7f7bb27bb640 1 --2- 172.21.15.159:0/3988675680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac0b2ae0 0x7f7bac0b0620 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7bac08c710 tx=0x7f7ba002a5d0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.229+0000 7f7bb27bb640 1 -- 172.21.15.159:0/3988675680 shutdown_connections 2024-07-24T16:36:26.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.229+0000 7f7bb27bb640 1 --2- 172.21.15.159:0/3988675680 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac0b2ae0 0x7f7bac0b0620 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.229+0000 7f7bb27bb640 1 --2- 172.21.15.159:0/3988675680 >> v2:172.21.15.193:3300/0 conn(0x7f7bac15d950 0x7f7bac161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.229+0000 7f7bb27bb640 1 -- 172.21.15.159:0/3988675680 >> 172.21.15.159:0/3988675680 conn(0x7f7bac09cd30 msgr2=0x7f7bac0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:26.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.229+0000 7f7bb27bb640 1 -- 172.21.15.159:0/3988675680 shutdown_connections 2024-07-24T16:36:26.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.229+0000 7f7bb27bb640 1 -- 172.21.15.159:0/3988675680 wait complete. 2024-07-24T16:36:26.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.230+0000 7f7bb27bb640 1 Processor -- start 2024-07-24T16:36:26.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.230+0000 7f7bb27bb640 1 -- start start 2024-07-24T16:36:26.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.231+0000 7f7bb27bb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac0b0b60 0x7f7bac0ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:26.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.231+0000 7f7bb27bb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bac0b2ae0 0x7f7bac146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:26.236 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.231+0000 7f7bb27bb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bac15d950 0x7f7bac1f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:26.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.231+0000 7f7bb27bb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac0d02e0 con 0x7f7bac0b0b60 2024-07-24T16:36:26.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.231+0000 7f7bb27bb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7bac0d0090 con 0x7f7bac0b2ae0 2024-07-24T16:36:26.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.231+0000 7f7bb27bb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7bac0d0460 con 0x7f7bac15d950 2024-07-24T16:36:26.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.231+0000 7f7babfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac0b0b60 0x7f7bac0ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:26.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.231+0000 7f7babfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac0b0b60 0x7f7bac0ccc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51358/0 (socket says 172.21.15.159:51358) 2024-07-24T16:36:26.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.231+0000 7f7babfff640 1 -- 172.21.15.159:0/13388938 learned_addr learned my addr 172.21.15.159:0/13388938 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:26.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.231+0000 7f7bab7fe640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bac0b2ae0 0x7f7bac146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:26.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.231+0000 7f7bb0d58640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bac15d950 0x7f7bac1f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:26.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.232+0000 7f7babfff640 1 -- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bac15d950 msgr2=0x7f7bac1f18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:26.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.232+0000 7f7babfff640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bac15d950 0x7f7bac1f18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.232+0000 7f7babfff640 1 -- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bac0b2ae0 msgr2=0x7f7bac146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:26.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.232+0000 7f7babfff640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bac0b2ae0 0x7f7bac146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.232+0000 7f7babfff640 1 -- 172.21.15.159:0/13388938 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bac0cd2d0 con 0x7f7bac0b0b60 2024-07-24T16:36:26.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.232+0000 7f7bb0d58640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bac15d950 0x7f7bac1f18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:36:26.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.232+0000 7f7bab7fe640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bac0b2ae0 0x7f7bac146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:36:26.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.232+0000 7f7babfff640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac0b0b60 0x7f7bac0ccc30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00b410 tx=0x7f7b9c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:26.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.232+0000 7f7ba8ff9640 1 -- 172.21.15.159:0/13388938 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c015020 con 0x7f7bac0b0b60 2024-07-24T16:36:26.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.232+0000 7f7ba8ff9640 1 -- 172.21.15.159:0/13388938 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b9c011940 con 0x7f7bac0b0b60 2024-07-24T16:36:26.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.232+0000 7f7bb27bb640 1 -- 172.21.15.159:0/13388938 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bac0cd5b0 con 0x7f7bac0b0b60 2024-07-24T16:36:26.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.232+0000 7f7ba8ff9640 1 -- 172.21.15.159:0/13388938 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c011d90 con 0x7f7bac0b0b60 2024-07-24T16:36:26.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.232+0000 7f7bb27bb640 1 -- 172.21.15.159:0/13388938 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bac0cdb70 con 0x7f7bac0b0b60 2024-07-24T16:36:26.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.233+0000 7f7bb27bb640 1 -- 172.21.15.159:0/13388938 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bac0d09a0 con 0x7f7bac0b0b60 2024-07-24T16:36:26.238 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.233+0000 7f7ba8ff9640 1 -- 172.21.15.159:0/13388938 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f7b9c018020 con 0x7f7bac0b0b60 2024-07-24T16:36:26.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.234+0000 7f7ba8ff9640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f7b98077210 0x7f7b980796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:26.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.234+0000 7f7ba8ff9640 1 -- 172.21.15.159:0/13388938 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f7b9c098f00 con 0x7f7bac0b0b60 2024-07-24T16:36:26.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.234+0000 7f7bab7fe640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f7b98077210 0x7f7b980796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:26.239 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.235+0000 7f7bab7fe640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f7b98077210 0x7f7b980796d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0034000 tx=0x7f7ba0004730 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:26.240 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.238+0000 7f7ba8ff9640 1 -- 172.21.15.159:0/13388938 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f7b9c01f020 con 0x7f7bac0b0b60 2024-07-24T16:36:26.447 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.444+0000 7f7bb27bb640 1 -- 172.21.15.159:0/13388938 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir7", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7bac06d1a0 con 0x7f7b98077210 2024-07-24T16:36:26.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.454+0000 7f7ba8ff9640 1 -- 172.21.15.159:0/13388938 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f7bac06d1a0 con 0x7f7b98077210 2024-07-24T16:36:26.456 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:26.456 INFO:teuthology.orchestra.run.smithi159.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:17", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:26.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.456+0000 7f7bb27bb640 1 -- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f7b98077210 msgr2=0x7f7b980796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:26.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.456+0000 7f7bb27bb640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f7b98077210 0x7f7b980796d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7ba0034000 tx=0x7f7ba0004730 comp rx=0 tx=0).stop 2024-07-24T16:36:26.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.456+0000 7f7bb27bb640 1 -- 172.21.15.159:0/13388938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac0b0b60 msgr2=0x7f7bac0ccc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:26.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.456+0000 7f7bb27bb640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac0b0b60 0x7f7bac0ccc30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c00b410 tx=0x7f7b9c00b8d0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.456+0000 7f7bb27bb640 1 -- 172.21.15.159:0/13388938 shutdown_connections 2024-07-24T16:36:26.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.456+0000 7f7bb27bb640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f7b98077210 0x7f7b980796d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.456+0000 7f7bb27bb640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7bac15d950 0x7f7bac1f18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.456+0000 7f7bb27bb640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7bac0b2ae0 0x7f7bac146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.456+0000 7f7bb27bb640 1 --2- 172.21.15.159:0/13388938 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7bac0b0b60 0x7f7bac0ccc30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.456+0000 7f7bb27bb640 1 -- 172.21.15.159:0/13388938 >> 172.21.15.159:0/13388938 conn(0x7f7bac09cd30 msgr2=0x7f7bac0d3860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:26.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.456+0000 7f7bb27bb640 1 -- 172.21.15.159:0/13388938 shutdown_connections 2024-07-24T16:36:26.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.456+0000 7f7bb27bb640 1 -- 172.21.15.159:0/13388938 wait complete. 2024-07-24T16:36:26.469 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir7", "rel_path": "/snap_test_dir1/dir7", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:17", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:26.469 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir7', 'rel_path': '/snap_test_dir1/dir7', 'schedule': '1m', 'retention': {}, 'start': '2024-07-24T00:00:00', 'created': '2024-07-24T16:25:17', 'first': '2024-07-24T16:26:00', 'last': '2024-07-24T16:36:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-07-24T16:36:26.469 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-07-24T16:36:26.469 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-07-24T16:36:26.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:26.470 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2024-07-24T16:36:26.486 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:26.486 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:26.486 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:26.486 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:26.486 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:26.486 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:26.486 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:26.486 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:26.487 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:26.487 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:26.487 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:26.487 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-07-24-16_26_00_UTC', 'scheduled-2024-07-24-16_27_00_UTC', 'scheduled-2024-07-24-16_28_00_UTC', 'scheduled-2024-07-24-16_29_00_UTC', 'scheduled-2024-07-24-16_30_00_UTC', 'scheduled-2024-07-24-16_31_00_UTC', 'scheduled-2024-07-24-16_32_00_UTC', 'scheduled-2024-07-24-16_33_00_UTC', 'scheduled-2024-07-24-16_34_00_UTC', 'scheduled-2024-07-24-16_35_00_UTC', 'scheduled-2024-07-24-16_36_00_UTC'] 2024-07-24T16:36:26.487 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir8 2024-07-24T16:36:26.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.629+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3120033042 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bac073260 msgr2=0x7f3bac0cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:26.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.629+0000 7f3bb3b4b640 1 --2- 172.21.15.159:0/3120033042 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bac073260 0x7f3bac0cfed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0005fd0 tx=0x7f3ba002a5d0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.629+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3120033042 shutdown_connections 2024-07-24T16:36:26.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.629+0000 7f3bb3b4b640 1 --2- 172.21.15.159:0/3120033042 >> v2:172.21.15.193:3300/0 conn(0x7f3bac0b4e70 0x7f3bac070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.629+0000 7f3bb3b4b640 1 --2- 172.21.15.159:0/3120033042 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bac073260 0x7f3bac0cfed0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.629+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3120033042 >> 172.21.15.159:0/3120033042 conn(0x7f3bac0b2230 msgr2=0x7f3bac0b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:26.632 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.629+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3120033042 shutdown_connections 2024-07-24T16:36:26.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.629+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3120033042 wait complete. 2024-07-24T16:36:26.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.630+0000 7f3bb3b4b640 1 Processor -- start 2024-07-24T16:36:26.633 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.630+0000 7f3bb3b4b640 1 -- start start 2024-07-24T16:36:26.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.631+0000 7f3bb3b4b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bac073260 0x7f3bac155600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:26.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.631+0000 7f3bb3b4b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bac0b4e70 0x7f3bac151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:26.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.631+0000 7f3bb3b4b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3bac15a330 0x7f3bac06c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:26.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.631+0000 7f3bb3b4b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3bac0cd6f0 con 0x7f3bac073260 2024-07-24T16:36:26.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.631+0000 7f3bb3b4b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3bac0cd570 con 0x7f3bac15a330 2024-07-24T16:36:26.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.631+0000 7f3bb3b4b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3bac0cd870 con 0x7f3bac0b4e70 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.631+0000 7f3bb18e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bac073260 0x7f3bac155600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.631+0000 7f3bb18e7640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bac073260 0x7f3bac155600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51364/0 (socket says 172.21.15.159:51364) 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.631+0000 7f3bb18e7640 1 -- 172.21.15.159:0/3538840656 learned_addr learned my addr 172.21.15.159:0/3538840656 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.632+0000 7f3bb20e8640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3bac15a330 0x7f3bac06c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.632+0000 7f3bb10e6640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bac0b4e70 0x7f3bac151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.632+0000 7f3bb18e7640 1 -- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bac0b4e70 msgr2=0x7f3bac151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.632+0000 7f3bb18e7640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bac0b4e70 0x7f3bac151960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.632+0000 7f3bb18e7640 1 -- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3bac15a330 msgr2=0x7f3bac06c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.632+0000 7f3bb18e7640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3bac15a330 0x7f3bac06c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.632+0000 7f3bb18e7640 1 -- 172.21.15.159:0/3538840656 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bac155b40 con 0x7f3bac073260 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.632+0000 7f3bb18e7640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bac073260 0x7f3bac155600 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c3a0 tx=0x7f3ba400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.632+0000 7f3baa7fc640 1 -- 172.21.15.159:0/3538840656 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4017070 con 0x7f3bac073260 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.632+0000 7f3baa7fc640 1 -- 172.21.15.159:0/3538840656 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ba40053c0 con 0x7f3bac073260 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.632+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3538840656 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bac15abf0 con 0x7f3bac073260 2024-07-24T16:36:26.636 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.632+0000 7f3baa7fc640 1 -- 172.21.15.159:0/3538840656 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4003850 con 0x7f3bac073260 2024-07-24T16:36:26.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.632+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3538840656 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bac15b1b0 con 0x7f3bac073260 2024-07-24T16:36:26.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.633+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3538840656 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bac15b8d0 con 0x7f3bac073260 2024-07-24T16:36:26.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.634+0000 7f3baa7fc640 1 -- 172.21.15.159:0/3538840656 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f3ba401a070 con 0x7f3bac073260 2024-07-24T16:36:26.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.634+0000 7f3baa7fc640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f3b98077210 0x7f3b980796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:26.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.634+0000 7f3baa7fc640 1 -- 172.21.15.159:0/3538840656 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f3ba4098360 con 0x7f3bac073260 2024-07-24T16:36:26.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.634+0000 7f3bb10e6640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f3b98077210 0x7f3b980796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:26.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.635+0000 7f3bb10e6640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f3b98077210 0x7f3b980796d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0033000 tx=0x7f3ba0004730 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:26.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.638+0000 7f3baa7fc640 1 -- 172.21.15.159:0/3538840656 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f3ba4061040 con 0x7f3bac073260 2024-07-24T16:36:26.843 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.841+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3538840656 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir8", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3bac0cdd90 con 0x7f3b98077210 2024-07-24T16:36:26.851 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.849+0000 7f3baa7fc640 1 -- 172.21.15.159:0/3538840656 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f3bac0cdd90 con 0x7f3b98077210 2024-07-24T16:36:26.852 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:26.852 INFO:teuthology.orchestra.run.smithi159.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:17", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:26.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.851+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f3b98077210 msgr2=0x7f3b980796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:26.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.851+0000 7f3bb3b4b640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f3b98077210 0x7f3b980796d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3ba0033000 tx=0x7f3ba0004730 comp rx=0 tx=0).stop 2024-07-24T16:36:26.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.851+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3538840656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bac073260 msgr2=0x7f3bac155600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:26.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.851+0000 7f3bb3b4b640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bac073260 0x7f3bac155600 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400c3a0 tx=0x7f3ba400c860 comp rx=0 tx=0).stop 2024-07-24T16:36:26.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.851+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3538840656 shutdown_connections 2024-07-24T16:36:26.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.851+0000 7f3bb3b4b640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f3b98077210 0x7f3b980796d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.851+0000 7f3bb3b4b640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3bac15a330 0x7f3bac06c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.854 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.851+0000 7f3bb3b4b640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3bac0b4e70 0x7f3bac151960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.851+0000 7f3bb3b4b640 1 --2- 172.21.15.159:0/3538840656 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3bac073260 0x7f3bac155600 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:26.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.851+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3538840656 >> 172.21.15.159:0/3538840656 conn(0x7f3bac0b2230 msgr2=0x7f3bac1594a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:26.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.851+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3538840656 shutdown_connections 2024-07-24T16:36:26.855 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:26.851+0000 7f3bb3b4b640 1 -- 172.21.15.159:0/3538840656 wait complete. 2024-07-24T16:36:26.865 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir8", "rel_path": "/snap_test_dir1/dir8", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:17", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:26.865 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir8', 'rel_path': '/snap_test_dir1/dir8', 'schedule': '1m', 'retention': {}, 'start': '2024-07-24T00:00:00', 'created': '2024-07-24T16:25:17', 'first': '2024-07-24T16:26:00', 'last': '2024-07-24T16:36:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-07-24T16:36:26.865 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-07-24T16:36:26.865 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-07-24T16:36:26.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:26.865 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2024-07-24T16:36:26.882 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:26.882 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:26.882 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:26.882 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:26.882 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:26.882 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:26.882 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:26.882 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:26.882 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:26.883 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:26.883 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:26.883 DEBUG:tasks.cephfs.test_snap_schedules:snapshots: ['scheduled-2024-07-24-16_26_00_UTC', 'scheduled-2024-07-24-16_27_00_UTC', 'scheduled-2024-07-24-16_28_00_UTC', 'scheduled-2024-07-24-16_29_00_UTC', 'scheduled-2024-07-24-16_30_00_UTC', 'scheduled-2024-07-24-16_31_00_UTC', 'scheduled-2024-07-24-16_32_00_UTC', 'scheduled-2024-07-24-16_33_00_UTC', 'scheduled-2024-07-24-16_34_00_UTC', 'scheduled-2024-07-24-16_35_00_UTC', 'scheduled-2024-07-24-16_36_00_UTC'] 2024-07-24T16:36:26.883 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule status --format json /snap_test_dir1/dir9 2024-07-24T16:36:27.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.024+0000 7f67c1148640 1 -- 172.21.15.159:0/3140324843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67bc15d950 msgr2=0x7f67bc161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:27.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.024+0000 7f67c1148640 1 --2- 172.21.15.159:0/3140324843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67bc15d950 0x7f67bc161f20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009830 tx=0x7f67b402a5a0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.024+0000 7f67c1148640 1 -- 172.21.15.159:0/3140324843 shutdown_connections 2024-07-24T16:36:27.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.024+0000 7f67c1148640 1 --2- 172.21.15.159:0/3140324843 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67bc15d950 0x7f67bc161f20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.024+0000 7f67c1148640 1 -- 172.21.15.159:0/3140324843 >> 172.21.15.159:0/3140324843 conn(0x7f67bc09cd30 msgr2=0x7f67bc0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:27.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.024+0000 7f67c1148640 1 -- 172.21.15.159:0/3140324843 shutdown_connections 2024-07-24T16:36:27.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.024+0000 7f67c1148640 1 -- 172.21.15.159:0/3140324843 wait complete. 2024-07-24T16:36:27.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.026+0000 7f67c1148640 1 Processor -- start 2024-07-24T16:36:27.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.026+0000 7f67c1148640 1 -- start start 2024-07-24T16:36:27.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.026+0000 7f67c1148640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f67bc0b2ae0 0x7f67bc15efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:27.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.026+0000 7f67c1148640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67bc0cf770 0x7f67bc0ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:27.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.026+0000 7f67c1148640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67bc15d950 0x7f67bc15ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:27.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.026+0000 7f67c1148640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc0d0b70 con 0x7f67bc15d950 2024-07-24T16:36:27.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.026+0000 7f67c1148640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f67bc0d09f0 con 0x7f67bc0cf770 2024-07-24T16:36:27.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.026+0000 7f67c1148640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f67bc0cfbc0 con 0x7f67bc0b2ae0 2024-07-24T16:36:27.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67bb59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67bc15d950 0x7f67bc15ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:27.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67bb59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67bc15d950 0x7f67bc15ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51374/0 (socket says 172.21.15.159:51374) 2024-07-24T16:36:27.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67bb59e640 1 -- 172.21.15.159:0/2702501243 learned_addr learned my addr 172.21.15.159:0/2702501243 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:27.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67ba59c640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67bc0cf770 0x7f67bc0ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:27.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67bad9d640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f67bc0b2ae0 0x7f67bc15efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:27.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67bb59e640 1 -- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f67bc0b2ae0 msgr2=0x7f67bc15efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:27.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67bb59e640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f67bc0b2ae0 0x7f67bc15efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67bb59e640 1 -- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67bc0cf770 msgr2=0x7f67bc0ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:27.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67bb59e640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67bc0cf770 0x7f67bc0ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67bb59e640 1 -- 172.21.15.159:0/2702501243 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67bc0cc4c0 con 0x7f67bc15d950 2024-07-24T16:36:27.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67bb59e640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67bc15d950 0x7f67bc15ac70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00c780 tx=0x7f67ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:27.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67b37fe640 1 -- 172.21.15.159:0/2702501243 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac004b60 con 0x7f67bc15d950 2024-07-24T16:36:27.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67b37fe640 1 -- 172.21.15.159:0/2702501243 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67ac004df0 con 0x7f67bc15d950 2024-07-24T16:36:27.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67b37fe640 1 -- 172.21.15.159:0/2702501243 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac00aa90 con 0x7f67bc15d950 2024-07-24T16:36:27.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67c1148640 1 -- 172.21.15.159:0/2702501243 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67bc0cbf00 con 0x7f67bc15d950 2024-07-24T16:36:27.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.027+0000 7f67c1148640 1 -- 172.21.15.159:0/2702501243 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67bc15ea80 con 0x7f67bc15d950 2024-07-24T16:36:27.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.028+0000 7f67c1148640 1 -- 172.21.15.159:0/2702501243 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67bc15ec80 con 0x7f67bc15d950 2024-07-24T16:36:27.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.029+0000 7f67b37fe640 1 -- 172.21.15.159:0/2702501243 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f67ac00ac30 con 0x7f67bc15d950 2024-07-24T16:36:27.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.029+0000 7f67b37fe640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f679c077210 0x7f679c0796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:27.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.030+0000 7f67b37fe640 1 -- 172.21.15.159:0/2702501243 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f67ac098fd0 con 0x7f67bc15d950 2024-07-24T16:36:27.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.030+0000 7f67bad9d640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f679c077210 0x7f679c0796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:27.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.030+0000 7f67bad9d640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f679c077210 0x7f679c0796d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f67b4034000 tx=0x7f67b4004730 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:27.036 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.034+0000 7f67b37fe640 1 -- 172.21.15.159:0/2702501243 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f67bc15ec80 con 0x7f67bc15d950 2024-07-24T16:36:27.241 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.239+0000 7f67c1148640 1 -- 172.21.15.159:0/2702501243 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "path": "/snap_test_dir1/dir9", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f67bc161f20 con 0x7f679c077210 2024-07-24T16:36:27.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.247+0000 7f67b37fe640 1 -- 172.21.15.159:0/2702501243 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f67bc161f20 con 0x7f679c077210 2024-07-24T16:36:27.250 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:27.250 INFO:teuthology.orchestra.run.smithi159.stdout:[{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:18", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:27.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.250+0000 7f67c1148640 1 -- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f679c077210 msgr2=0x7f679c0796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:27.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.250+0000 7f67c1148640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f679c077210 0x7f679c0796d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f67b4034000 tx=0x7f67b4004730 comp rx=0 tx=0).stop 2024-07-24T16:36:27.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.250+0000 7f67c1148640 1 -- 172.21.15.159:0/2702501243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67bc15d950 msgr2=0x7f67bc15ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:27.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.250+0000 7f67c1148640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67bc15d950 0x7f67bc15ac70 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00c780 tx=0x7f67ac00cc40 comp rx=0 tx=0).stop 2024-07-24T16:36:27.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.250+0000 7f67c1148640 1 -- 172.21.15.159:0/2702501243 shutdown_connections 2024-07-24T16:36:27.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.250+0000 7f67c1148640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f679c077210 0x7f679c0796d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.250+0000 7f67c1148640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f67bc15d950 0x7f67bc15ac70 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.250+0000 7f67c1148640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f67bc0cf770 0x7f67bc0ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.250+0000 7f67c1148640 1 --2- 172.21.15.159:0/2702501243 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f67bc0b2ae0 0x7f67bc15efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.250+0000 7f67c1148640 1 -- 172.21.15.159:0/2702501243 >> 172.21.15.159:0/2702501243 conn(0x7f67bc09cd30 msgr2=0x7f67bc0b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:27.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.250+0000 7f67c1148640 1 -- 172.21.15.159:0/2702501243 shutdown_connections 2024-07-24T16:36:27.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.250+0000 7f67c1148640 1 -- 172.21.15.159:0/2702501243 wait complete. 2024-07-24T16:36:27.263 DEBUG:tasks.cephfs.test_snap_schedules:res= [{"fs": "cephfs", "subvol": null, "group": null, "path": "/snap_test_dir1/dir9", "rel_path": "/snap_test_dir1/dir9", "schedule": "1m", "retention": {}, "start": "2024-07-24T00:00:00", "created": "2024-07-24T16:25:18", "first": "2024-07-24T16:26:00", "last": "2024-07-24T16:36:00", "last_pruned": null, "created_count": 11, "pruned_count": 0, "active": false}] 2024-07-24T16:36:27.264 DEBUG:tasks.cephfs.test_snap_schedules:json_res: {'fs': 'cephfs', 'subvol': None, 'group': None, 'path': '/snap_test_dir1/dir9', 'rel_path': '/snap_test_dir1/dir9', 'schedule': '1m', 'retention': {}, 'start': '2024-07-24T00:00:00', 'created': '2024-07-24T16:25:18', 'first': '2024-07-24T16:26:00', 'last': '2024-07-24T16:36:00', 'last_pruned': None, 'created_count': 11, 'pruned_count': 0, 'active': False} 2024-07-24T16:36:27.264 DEBUG:tasks.cephfs.test_snap_schedules:fs_count: 11 2024-07-24T16:36:27.264 DEBUG:tasks.cephfs.test_snap_schedules:db_count: 11 2024-07-24T16:36:27.264 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir0 1m 2024-07-24T16:36:27.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.370+0000 7f4d224db640 1 -- 172.21.15.159:0/769783514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d04003a00 msgr2=0x7f4d04003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:27.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.370+0000 7f4d224db640 1 --2- 172.21.15.159:0/769783514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d04003a00 0x7f4d04003e00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00bb20 tx=0x7f4d04005830 comp rx=0 tx=0).stop 2024-07-24T16:36:27.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.370+0000 7f4d224db640 1 -- 172.21.15.159:0/769783514 shutdown_connections 2024-07-24T16:36:27.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.370+0000 7f4d224db640 1 --2- 172.21.15.159:0/769783514 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d04003a00 0x7f4d04003e00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.370+0000 7f4d224db640 1 -- 172.21.15.159:0/769783514 >> 172.21.15.159:0/769783514 conn(0x7f4d1c09cd30 msgr2=0x7f4d1c0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:27.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.370+0000 7f4d224db640 1 -- 172.21.15.159:0/769783514 shutdown_connections 2024-07-24T16:36:27.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.370+0000 7f4d224db640 1 -- 172.21.15.159:0/769783514 wait complete. 2024-07-24T16:36:27.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.372+0000 7f4d224db640 1 Processor -- start 2024-07-24T16:36:27.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.372+0000 7f4d224db640 1 -- start start 2024-07-24T16:36:27.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.372+0000 7f4d224db640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d04003a00 0x7f4d1c0c7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:27.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d224db640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d1c0b8630 0x7f4d1c1f5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:27.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d224db640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d1c0c8c60 0x7f4d1c1f7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:27.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d224db640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c1622b0 con 0x7f4d1c0c8c60 2024-07-24T16:36:27.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d224db640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1c162130 con 0x7f4d04003a00 2024-07-24T16:36:27.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d224db640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4d1c0ce450 con 0x7f4d1c0b8630 2024-07-24T16:36:27.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d20a78640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d1c0c8c60 0x7f4d1c1f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:27.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d20a78640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d1c0c8c60 0x7f4d1c1f7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51388/0 (socket says 172.21.15.159:51388) 2024-07-24T16:36:27.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d20a78640 1 -- 172.21.15.159:0/3933201172 learned_addr learned my addr 172.21.15.159:0/3933201172 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:27.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d1bfff640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d04003a00 0x7f4d1c0c7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:27.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d1b7fe640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d1c0b8630 0x7f4d1c1f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:27.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d20a78640 1 -- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d1c0b8630 msgr2=0x7f4d1c1f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:27.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d20a78640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d1c0b8630 0x7f4d1c1f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d20a78640 1 -- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d04003a00 msgr2=0x7f4d1c0c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:27.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d20a78640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d04003a00 0x7f4d1c0c7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d20a78640 1 -- 172.21.15.159:0/3933201172 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d1c0ca300 con 0x7f4d1c0c8c60 2024-07-24T16:36:27.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d1bfff640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d04003a00 0x7f4d1c0c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:36:27.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d20a78640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d1c0c8c60 0x7f4d1c1f7080 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0d3210 tx=0x7f4d1400da10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:27.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d18ff9640 1 -- 172.21.15.159:0/3933201172 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d14014070 con 0x7f4d1c0c8c60 2024-07-24T16:36:27.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d18ff9640 1 -- 172.21.15.159:0/3933201172 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d1400f990 con 0x7f4d1c0c8c60 2024-07-24T16:36:27.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d224db640 1 -- 172.21.15.159:0/3933201172 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d1c0b6a10 con 0x7f4d1c0c8c60 2024-07-24T16:36:27.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d18ff9640 1 -- 172.21.15.159:0/3933201172 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1400fde0 con 0x7f4d1c0c8c60 2024-07-24T16:36:27.378 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.373+0000 7f4d224db640 1 -- 172.21.15.159:0/3933201172 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d1c0b6fd0 con 0x7f4d1c0c8c60 2024-07-24T16:36:27.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.374+0000 7f4d224db640 1 -- 172.21.15.159:0/3933201172 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d1c0cff40 con 0x7f4d1c0c8c60 2024-07-24T16:36:27.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.375+0000 7f4d18ff9640 1 -- 172.21.15.159:0/3933201172 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f4d14017070 con 0x7f4d1c0c8c60 2024-07-24T16:36:27.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.375+0000 7f4d18ff9640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f4d08077240 0x7f4d08079700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:27.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.376+0000 7f4d18ff9640 1 -- 172.21.15.159:0/3933201172 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f4d14099110 con 0x7f4d1c0c8c60 2024-07-24T16:36:27.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.376+0000 7f4d1bfff640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f4d08077240 0x7f4d08079700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:27.380 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.376+0000 7f4d1bfff640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f4d08077240 0x7f4d08079700 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c036000 tx=0x7f4d0c0046c0 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:27.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.380+0000 7f4d18ff9640 1 -- 172.21.15.159:0/3933201172 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f4d14061df0 con 0x7f4d1c0c8c60 2024-07-24T16:36:27.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.585+0000 7f4d224db640 1 -- 172.21.15.159:0/3933201172 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir0", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f4d1c1ea130 con 0x7f4d08077240 2024-07-24T16:36:27.668 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.666+0000 7f4d18ff9640 1 -- 172.21.15.159:0/3933201172 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f4d1c1ea130 con 0x7f4d08077240 2024-07-24T16:36:27.669 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule removed for path /snap_test_dir1/dir0 2024-07-24T16:36:27.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.668+0000 7f4d224db640 1 -- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f4d08077240 msgr2=0x7f4d08079700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:27.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.668+0000 7f4d224db640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f4d08077240 0x7f4d08079700 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c036000 tx=0x7f4d0c0046c0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.668+0000 7f4d224db640 1 -- 172.21.15.159:0/3933201172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d1c0c8c60 msgr2=0x7f4d1c1f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:27.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.668+0000 7f4d224db640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d1c0c8c60 0x7f4d1c1f7080 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0d3210 tx=0x7f4d1400da10 comp rx=0 tx=0).stop 2024-07-24T16:36:27.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.668+0000 7f4d224db640 1 -- 172.21.15.159:0/3933201172 shutdown_connections 2024-07-24T16:36:27.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.668+0000 7f4d224db640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f4d08077240 0x7f4d08079700 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.668+0000 7f4d224db640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d1c0c8c60 0x7f4d1c1f7080 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.668+0000 7f4d224db640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d1c0b8630 0x7f4d1c1f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.668+0000 7f4d224db640 1 --2- 172.21.15.159:0/3933201172 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d04003a00 0x7f4d1c0c7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:27.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.668+0000 7f4d224db640 1 -- 172.21.15.159:0/3933201172 >> 172.21.15.159:0/3933201172 conn(0x7f4d1c09cd30 msgr2=0x7f4d1c15cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:27.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.668+0000 7f4d224db640 1 -- 172.21.15.159:0/3933201172 shutdown_connections 2024-07-24T16:36:27.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:27.668+0000 7f4d224db640 1 -- 172.21.15.159:0/3933201172 wait complete. 2024-07-24T16:36:27.681 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir0 2024-07-24T16:36:27.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:27.682 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir0/.snap) 2024-07-24T16:36:27.698 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:27.698 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:27.698 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:27.699 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:27.699 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:27.699 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:27.699 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:27.699 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:27.699 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:27.699 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:27.699 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:27.699 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:27.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:27.699 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_26_00_UTC) 2024-07-24T16:36:27.760 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:27.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:27.760 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_27_00_UTC) 2024-07-24T16:36:27.821 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:27.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:27.821 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_28_00_UTC) 2024-07-24T16:36:27.883 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:27.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:27.883 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_29_00_UTC) 2024-07-24T16:36:27.945 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:27.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:27.946 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_30_00_UTC) 2024-07-24T16:36:28.009 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:28.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:28.009 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_31_00_UTC) 2024-07-24T16:36:28.070 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:28.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:28.070 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_32_00_UTC) 2024-07-24T16:36:28.134 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:28.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:28.134 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_33_00_UTC) 2024-07-24T16:36:28.195 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:28.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:28.195 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_34_00_UTC) 2024-07-24T16:36:28.256 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:28.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:28.256 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_35_00_UTC) 2024-07-24T16:36:28.318 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:28.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:28.318 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0/.snap/scheduled-2024-07-24-16_36_00_UTC) 2024-07-24T16:36:28.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:28.380 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir0) 2024-07-24T16:36:28.440 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir1 1m 2024-07-24T16:36:28.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.583+0000 7fb9a4912640 1 -- 172.21.15.159:0/2578242370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a015b4d0 msgr2=0x7fb9a0070750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:28.586 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.583+0000 7fb9a4912640 1 --2- 172.21.15.159:0/2578242370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a015b4d0 0x7fb9a0070750 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb990009830 tx=0x7fb99002a640 comp rx=0 tx=0).stop 2024-07-24T16:36:28.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.584+0000 7fb9a4912640 1 -- 172.21.15.159:0/2578242370 shutdown_connections 2024-07-24T16:36:28.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.584+0000 7fb9a4912640 1 --2- 172.21.15.159:0/2578242370 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a015b4d0 0x7fb9a0070750 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:28.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.584+0000 7fb9a4912640 1 -- 172.21.15.159:0/2578242370 >> 172.21.15.159:0/2578242370 conn(0x7fb9a009aa20 msgr2=0x7fb9a00d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:28.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.584+0000 7fb9a4912640 1 -- 172.21.15.159:0/2578242370 shutdown_connections 2024-07-24T16:36:28.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.584+0000 7fb9a4912640 1 -- 172.21.15.159:0/2578242370 wait complete. 2024-07-24T16:36:28.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.585+0000 7fb9a4912640 1 Processor -- start 2024-07-24T16:36:28.587 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.585+0000 7fb9a4912640 1 -- start start 2024-07-24T16:36:28.589 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb9a4912640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9a009af50 0x7fb9a00b33c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:28.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb9a4912640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a015b4d0 0x7fb9a00b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:28.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb9a4912640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9a015f9a0 0x7fb9a00b6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:28.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb9a4912640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a00af050 con 0x7fb9a015b4d0 2024-07-24T16:36:28.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb9a4912640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb9a015bc10 con 0x7fb9a015f9a0 2024-07-24T16:36:28.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb9a4912640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb9a00af1d0 con 0x7fb9a009af50 2024-07-24T16:36:28.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb997fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a015b4d0 0x7fb9a00b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:28.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb997fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a015b4d0 0x7fb9a00b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51412/0 (socket says 172.21.15.159:51412) 2024-07-24T16:36:28.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb997fff640 1 -- 172.21.15.159:0/2415238030 learned_addr learned my addr 172.21.15.159:0/2415238030 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:28.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb99ed9d640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9a015f9a0 0x7fb9a00b6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:28.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb99e59c640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9a009af50 0x7fb9a00b33c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:28.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb997fff640 1 -- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9a009af50 msgr2=0x7fb9a00b33c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:28.590 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb997fff640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9a009af50 0x7fb9a00b33c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb997fff640 1 -- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9a015f9a0 msgr2=0x7fb9a00b6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb997fff640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9a015f9a0 0x7fb9a00b6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb997fff640 1 -- 172.21.15.159:0/2415238030 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9a01565d0 con 0x7fb9a015b4d0 2024-07-24T16:36:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb997fff640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a015b4d0 0x7fb9a00b5f40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb98800c400 tx=0x7fb98800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.586+0000 7fb996ffd640 1 -- 172.21.15.159:0/2415238030 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988017070 con 0x7fb9a015b4d0 2024-07-24T16:36:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.587+0000 7fb996ffd640 1 -- 172.21.15.159:0/2415238030 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9880053c0 con 0x7fb9a015b4d0 2024-07-24T16:36:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.587+0000 7fb9a4912640 1 -- 172.21.15.159:0/2415238030 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9a00b4a30 con 0x7fb9a015b4d0 2024-07-24T16:36:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.587+0000 7fb996ffd640 1 -- 172.21.15.159:0/2415238030 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988003850 con 0x7fb9a015b4d0 2024-07-24T16:36:28.591 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.587+0000 7fb9a4912640 1 -- 172.21.15.159:0/2415238030 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9a00b6ab0 con 0x7fb9a015b4d0 2024-07-24T16:36:28.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.588+0000 7fb9a4912640 1 -- 172.21.15.159:0/2415238030 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9a0070750 con 0x7fb9a015b4d0 2024-07-24T16:36:28.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.588+0000 7fb996ffd640 1 -- 172.21.15.159:0/2415238030 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7fb98801a070 con 0x7fb9a015b4d0 2024-07-24T16:36:28.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.588+0000 7fb996ffd640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb980077210 0x7fb9800796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:28.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.589+0000 7fb996ffd640 1 -- 172.21.15.159:0/2415238030 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7fb988098200 con 0x7fb9a015b4d0 2024-07-24T16:36:28.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.589+0000 7fb99e59c640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb980077210 0x7fb9800796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:28.592 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.589+0000 7fb99e59c640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb980077210 0x7fb9800796d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb990034000 tx=0x7fb990004730 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:28.595 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.593+0000 7fb996ffd640 1 -- 172.21.15.159:0/2415238030 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fb9880609c0 con 0x7fb9a015b4d0 2024-07-24T16:36:28.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.795+0000 7fb9a4912640 1 -- 172.21.15.159:0/2415238030 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir1", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fb9a00b7800 con 0x7fb980077210 2024-07-24T16:36:28.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.888+0000 7fb996ffd640 1 -- 172.21.15.159:0/2415238030 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fb9a00b7800 con 0x7fb980077210 2024-07-24T16:36:28.890 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule removed for path /snap_test_dir1/dir1 2024-07-24T16:36:28.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.890+0000 7fb9a4912640 1 -- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb980077210 msgr2=0x7fb9800796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:28.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.890+0000 7fb9a4912640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb980077210 0x7fb9800796d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb990034000 tx=0x7fb990004730 comp rx=0 tx=0).stop 2024-07-24T16:36:28.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.890+0000 7fb9a4912640 1 -- 172.21.15.159:0/2415238030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a015b4d0 msgr2=0x7fb9a00b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:28.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.890+0000 7fb9a4912640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a015b4d0 0x7fb9a00b5f40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb98800c400 tx=0x7fb98800c8c0 comp rx=0 tx=0).stop 2024-07-24T16:36:28.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.890+0000 7fb9a4912640 1 -- 172.21.15.159:0/2415238030 shutdown_connections 2024-07-24T16:36:28.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.890+0000 7fb9a4912640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb980077210 0x7fb9800796d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:28.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.890+0000 7fb9a4912640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb9a015f9a0 0x7fb9a00b6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:28.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.890+0000 7fb9a4912640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb9a015b4d0 0x7fb9a00b5f40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:28.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.890+0000 7fb9a4912640 1 --2- 172.21.15.159:0/2415238030 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb9a009af50 0x7fb9a00b33c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:28.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.890+0000 7fb9a4912640 1 -- 172.21.15.159:0/2415238030 >> 172.21.15.159:0/2415238030 conn(0x7fb9a009aa20 msgr2=0x7fb9a00d1810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:28.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.890+0000 7fb9a4912640 1 -- 172.21.15.159:0/2415238030 shutdown_connections 2024-07-24T16:36:28.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:28.890+0000 7fb9a4912640 1 -- 172.21.15.159:0/2415238030 wait complete. 2024-07-24T16:36:28.903 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir1 2024-07-24T16:36:28.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:28.904 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir1/.snap) 2024-07-24T16:36:28.920 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:28.920 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:28.920 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:28.920 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:28.920 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:28.920 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:28.920 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:28.920 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:28.920 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:28.920 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:28.921 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:28.921 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:28.921 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:28.921 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_26_00_UTC) 2024-07-24T16:36:28.983 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:28.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:28.984 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_27_00_UTC) 2024-07-24T16:36:29.047 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:29.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:29.048 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_28_00_UTC) 2024-07-24T16:36:29.109 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:29.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:29.109 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_29_00_UTC) 2024-07-24T16:36:29.174 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:29.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:29.174 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_30_00_UTC) 2024-07-24T16:36:29.235 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:29.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:29.236 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_31_00_UTC) 2024-07-24T16:36:29.297 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:29.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:29.297 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_32_00_UTC) 2024-07-24T16:36:29.360 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:29.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:29.360 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_33_00_UTC) 2024-07-24T16:36:29.422 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:29.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:29.423 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_34_00_UTC) 2024-07-24T16:36:29.484 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:29.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:29.484 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_35_00_UTC) 2024-07-24T16:36:29.545 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:29.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:29.546 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1/.snap/scheduled-2024-07-24-16_36_00_UTC) 2024-07-24T16:36:29.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:29.606 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir1) 2024-07-24T16:36:29.665 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir2 1m 2024-07-24T16:36:29.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.808+0000 7f1f7cf79640 1 -- 172.21.15.159:0/4274353033 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f7815ad80 msgr2=0x7f1f780b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:29.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.808+0000 7f1f7cf79640 1 --2- 172.21.15.159:0/4274353033 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f7815ad80 0x7f1f780b41d0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000a940 tx=0x7f1f6002b730 comp rx=0 tx=0).stop 2024-07-24T16:36:29.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.808+0000 7f1f7cf79640 1 -- 172.21.15.159:0/4274353033 shutdown_connections 2024-07-24T16:36:29.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.808+0000 7f1f7cf79640 1 --2- 172.21.15.159:0/4274353033 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f7815ad80 0x7f1f780b41d0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:29.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.808+0000 7f1f7cf79640 1 -- 172.21.15.159:0/4274353033 >> 172.21.15.159:0/4274353033 conn(0x7f1f7806c560 msgr2=0x7f1f7806c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:29.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.808+0000 7f1f7cf79640 1 -- 172.21.15.159:0/4274353033 shutdown_connections 2024-07-24T16:36:29.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.808+0000 7f1f7cf79640 1 -- 172.21.15.159:0/4274353033 wait complete. 2024-07-24T16:36:29.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.809+0000 7f1f7cf79640 1 Processor -- start 2024-07-24T16:36:29.812 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.809+0000 7f1f7cf79640 1 -- start start 2024-07-24T16:36:29.813 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f7cf79640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f7806d670 0x7f1f7815c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:29.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f7cf79640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f78150cc0 0x7f1f781548e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:29.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f7cf79640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f7815ad80 0x7f1f78152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:29.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f7cf79640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f1f780724e0 con 0x7f1f78150cc0 2024-07-24T16:36:29.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f7cf79640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f1f78072360 con 0x7f1f7815ad80 2024-07-24T16:36:29.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f7cf79640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f1f7806dae0 con 0x7f1f7806d670 2024-07-24T16:36:29.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f75d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f78150cc0 0x7f1f781548e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:29.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f75d9b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f78150cc0 0x7f1f781548e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:51430/0 (socket says 172.21.15.159:51430) 2024-07-24T16:36:29.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f75d9b640 1 -- 172.21.15.159:0/1305710066 learned_addr learned my addr 172.21.15.159:0/1305710066 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:29.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f76d9d640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f7815ad80 0x7f1f78152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:29.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f7659c640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f7806d670 0x7f1f7815c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:29.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f75d9b640 1 -- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f7806d670 msgr2=0x7f1f7815c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:29.814 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f75d9b640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f7806d670 0x7f1f7815c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:29.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f75d9b640 1 -- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f7815ad80 msgr2=0x7f1f78152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:29.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f75d9b640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f7815ad80 0x7f1f78152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:29.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.810+0000 7f1f75d9b640 1 -- 172.21.15.159:0/1305710066 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f781533f0 con 0x7f1f78150cc0 2024-07-24T16:36:29.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.811+0000 7f1f75d9b640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f78150cc0 0x7f1f781548e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000aa60 tx=0x7f1f600042d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:29.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.811+0000 7f1f6effd640 1 -- 172.21.15.159:0/1305710066 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f60040030 con 0x7f1f78150cc0 2024-07-24T16:36:29.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.811+0000 7f1f6effd640 1 -- 172.21.15.159:0/1305710066 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f60005020 con 0x7f1f78150cc0 2024-07-24T16:36:29.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.811+0000 7f1f7cf79640 1 -- 172.21.15.159:0/1305710066 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f78152e90 con 0x7f1f78150cc0 2024-07-24T16:36:29.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.811+0000 7f1f6effd640 1 -- 172.21.15.159:0/1305710066 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f60005470 con 0x7f1f78150cc0 2024-07-24T16:36:29.815 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.811+0000 7f1f7cf79640 1 -- 172.21.15.159:0/1305710066 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f781583a0 con 0x7f1f78150cc0 2024-07-24T16:36:29.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.812+0000 7f1f7cf79640 1 -- 172.21.15.159:0/1305710066 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f780b41d0 con 0x7f1f78150cc0 2024-07-24T16:36:29.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.812+0000 7f1f6effd640 1 -- 172.21.15.159:0/1305710066 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f1f60043070 con 0x7f1f78150cc0 2024-07-24T16:36:29.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.813+0000 7f1f6effd640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f1f58077240 0x7f1f58079700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:29.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.813+0000 7f1f6effd640 1 -- 172.21.15.159:0/1305710066 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f1f600b9f90 con 0x7f1f78150cc0 2024-07-24T16:36:29.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.813+0000 7f1f7659c640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f1f58077240 0x7f1f58079700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:29.816 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.814+0000 7f1f7659c640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f1f58077240 0x7f1f58079700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1f68001db0 tx=0x7f1f68009040 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:29.819 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:29.817+0000 7f1f6effd640 1 -- 172.21.15.159:0/1305710066 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f1f78152e90 con 0x7f1f78150cc0 2024-07-24T16:36:30.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.022+0000 7f1f7cf79640 1 -- 172.21.15.159:0/1305710066 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir2", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f1f781e4340 con 0x7f1f58077240 2024-07-24T16:36:30.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.109+0000 7f1f6effd640 1 -- 172.21.15.159:0/1305710066 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f1f781e4340 con 0x7f1f58077240 2024-07-24T16:36:30.111 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule removed for path /snap_test_dir1/dir2 2024-07-24T16:36:30.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.111+0000 7f1f7cf79640 1 -- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f1f58077240 msgr2=0x7f1f58079700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:30.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.111+0000 7f1f7cf79640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f1f58077240 0x7f1f58079700 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1f68001db0 tx=0x7f1f68009040 comp rx=0 tx=0).stop 2024-07-24T16:36:30.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.111+0000 7f1f7cf79640 1 -- 172.21.15.159:0/1305710066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f78150cc0 msgr2=0x7f1f781548e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:30.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.111+0000 7f1f7cf79640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f78150cc0 0x7f1f781548e0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1f6000aa60 tx=0x7f1f600042d0 comp rx=0 tx=0).stop 2024-07-24T16:36:30.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.111+0000 7f1f7cf79640 1 -- 172.21.15.159:0/1305710066 shutdown_connections 2024-07-24T16:36:30.114 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.111+0000 7f1f7cf79640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f1f58077240 0x7f1f58079700 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:30.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.111+0000 7f1f7cf79640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f1f7815ad80 0x7f1f78152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:30.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.111+0000 7f1f7cf79640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f1f78150cc0 0x7f1f781548e0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:30.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.111+0000 7f1f7cf79640 1 --2- 172.21.15.159:0/1305710066 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f1f7806d670 0x7f1f7815c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:30.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.111+0000 7f1f7cf79640 1 -- 172.21.15.159:0/1305710066 >> 172.21.15.159:0/1305710066 conn(0x7f1f7806c560 msgr2=0x7f1f78150020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:30.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.111+0000 7f1f7cf79640 1 -- 172.21.15.159:0/1305710066 shutdown_connections 2024-07-24T16:36:30.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:30.111+0000 7f1f7cf79640 1 -- 172.21.15.159:0/1305710066 wait complete. 2024-07-24T16:36:30.124 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir2 2024-07-24T16:36:30.125 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:30.125 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir2/.snap) 2024-07-24T16:36:30.141 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:30.141 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:30.141 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:30.141 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:30.142 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:30.142 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:30.142 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:30.142 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:30.142 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_01_UTC 2024-07-24T16:36:30.142 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:30.142 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:30.142 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:30.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:30.142 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_26_00_UTC) 2024-07-24T16:36:30.203 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:30.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:30.203 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_27_00_UTC) 2024-07-24T16:36:30.265 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:30.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:30.265 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_28_00_UTC) 2024-07-24T16:36:30.327 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:30.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:30.327 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_29_00_UTC) 2024-07-24T16:36:30.389 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:30.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:30.389 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_30_00_UTC) 2024-07-24T16:36:30.453 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:30.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:30.454 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_31_00_UTC) 2024-07-24T16:36:30.514 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:30.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:30.515 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_32_00_UTC) 2024-07-24T16:36:30.576 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:30.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:30.576 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_33_00_UTC) 2024-07-24T16:36:30.637 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_34_01_UTC 2024-07-24T16:36:30.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:30.637 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_34_01_UTC) 2024-07-24T16:36:30.698 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:30.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:30.699 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_35_00_UTC) 2024-07-24T16:36:30.760 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:30.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:30.760 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2/.snap/scheduled-2024-07-24-16_36_00_UTC) 2024-07-24T16:36:30.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:30.821 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir2) 2024-07-24T16:36:30.879 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir3 1m 2024-07-24T16:36:31.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.023+0000 7f51c9f01640 1 -- 172.21.15.159:0/960317570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c406dba0 msgr2=0x7f51c40cb500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:31.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.023+0000 7f51c9f01640 1 --2- 172.21.15.159:0/960317570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c406dba0 0x7f51c40cb500 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f51b8009830 tx=0x7f51b802a510 comp rx=0 tx=0).stop 2024-07-24T16:36:31.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.023+0000 7f51c9f01640 1 -- 172.21.15.159:0/960317570 shutdown_connections 2024-07-24T16:36:31.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.023+0000 7f51c9f01640 1 --2- 172.21.15.159:0/960317570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c406dba0 0x7f51c40cb500 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:31.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.023+0000 7f51c9f01640 1 --2- 172.21.15.159:0/960317570 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f51c40cf770 0x7f51c415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:31.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.023+0000 7f51c9f01640 1 -- 172.21.15.159:0/960317570 >> 172.21.15.159:0/960317570 conn(0x7f51c406c560 msgr2=0x7f51c406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:31.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.023+0000 7f51c9f01640 1 -- 172.21.15.159:0/960317570 shutdown_connections 2024-07-24T16:36:31.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.023+0000 7f51c9f01640 1 -- 172.21.15.159:0/960317570 wait complete. 2024-07-24T16:36:31.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.025+0000 7f51c9f01640 1 Processor -- start 2024-07-24T16:36:31.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.025+0000 7f51c9f01640 1 -- start start 2024-07-24T16:36:31.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.025+0000 7f51c9f01640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f51c406dba0 0x7f51c4146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:31.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.025+0000 7f51c9f01640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51c40cf770 0x7f51c4152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:31.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.025+0000 7f51c9f01640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40cfb50 0x7f51c41550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:31.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.025+0000 7f51c9f01640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f51c40aea60 con 0x7f51c40cfb50 2024-07-24T16:36:31.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.025+0000 7f51c9f01640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f51c40ae8e0 con 0x7f51c40cf770 2024-07-24T16:36:31.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.025+0000 7f51c9f01640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f51c40aebe0 con 0x7f51c406dba0 2024-07-24T16:36:31.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40cfb50 0x7f51c41550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:31.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40cfb50 0x7f51c41550a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34346/0 (socket says 172.21.15.159:34346) 2024-07-24T16:36:31.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51c3fff640 1 -- 172.21.15.159:0/3899312490 learned_addr learned my addr 172.21.15.159:0/3899312490 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:31.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51c37fe640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f51c406dba0 0x7f51c4146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:31.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51c2ffd640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51c40cf770 0x7f51c4152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:31.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51c3fff640 1 -- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f51c406dba0 msgr2=0x7f51c4146040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:31.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51c3fff640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f51c406dba0 0x7f51c4146040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:31.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51c3fff640 1 -- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51c40cf770 msgr2=0x7f51c4152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:31.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51c3fff640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51c40cf770 0x7f51c4152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:31.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51c3fff640 1 -- 172.21.15.159:0/3899312490 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c4153480 con 0x7f51c40cfb50 2024-07-24T16:36:31.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51c3fff640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40cfb50 0x7f51c41550a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00cb10 tx=0x7f51bc00cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:31.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51abfff640 1 -- 172.21.15.159:0/3899312490 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc016020 con 0x7f51c40cfb50 2024-07-24T16:36:31.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51abfff640 1 -- 172.21.15.159:0/3899312490 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51bc00ac40 con 0x7f51c40cfb50 2024-07-24T16:36:31.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51abfff640 1 -- 172.21.15.159:0/3899312490 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc012680 con 0x7f51c40cfb50 2024-07-24T16:36:31.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51c9f01640 1 -- 172.21.15.159:0/3899312490 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c4153760 con 0x7f51c40cfb50 2024-07-24T16:36:31.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.026+0000 7f51c9f01640 1 -- 172.21.15.159:0/3899312490 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c4153d20 con 0x7f51c40cfb50 2024-07-24T16:36:31.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.027+0000 7f51c9f01640 1 -- 172.21.15.159:0/3899312490 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51c406f6a0 con 0x7f51c40cfb50 2024-07-24T16:36:31.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.028+0000 7f51abfff640 1 -- 172.21.15.159:0/3899312490 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f51bc019020 con 0x7f51c40cfb50 2024-07-24T16:36:31.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.028+0000 7f51abfff640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f51b0077210 0x7f51b00796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:31.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.028+0000 7f51abfff640 1 -- 172.21.15.159:0/3899312490 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6388+0+0 (secure 0 0 0) 0x7f51bc0990e0 con 0x7f51c40cfb50 2024-07-24T16:36:31.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.028+0000 7f51c37fe640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f51b0077210 0x7f51b00796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:31.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.029+0000 7f51c37fe640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f51b0077210 0x7f51b00796d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009990 tx=0x7f51b4009110 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:31.035 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.033+0000 7f51abfff640 1 -- 172.21.15.159:0/3899312490 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f51c406f6a0 con 0x7f51c40cfb50 2024-07-24T16:36:31.245 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.243+0000 7f51c9f01640 1 -- 172.21.15.159:0/3899312490 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir3", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f51c406fc00 con 0x7f51b0077210 2024-07-24T16:36:31.325 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.322+0000 7f51abfff640 1 -- 172.21.15.159:0/3899312490 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f51c406fc00 con 0x7f51b0077210 2024-07-24T16:36:31.325 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule removed for path /snap_test_dir1/dir3 2024-07-24T16:36:31.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.324+0000 7f51c9f01640 1 -- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f51b0077210 msgr2=0x7f51b00796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:31.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.324+0000 7f51c9f01640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f51b0077210 0x7f51b00796d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009990 tx=0x7f51b4009110 comp rx=0 tx=0).stop 2024-07-24T16:36:31.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.324+0000 7f51c9f01640 1 -- 172.21.15.159:0/3899312490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40cfb50 msgr2=0x7f51c41550a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:31.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.324+0000 7f51c9f01640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40cfb50 0x7f51c41550a0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f51bc00cb10 tx=0x7f51bc00cf10 comp rx=0 tx=0).stop 2024-07-24T16:36:31.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.324+0000 7f51c9f01640 1 -- 172.21.15.159:0/3899312490 shutdown_connections 2024-07-24T16:36:31.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.324+0000 7f51c9f01640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f51b0077210 0x7f51b00796d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:31.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.324+0000 7f51c9f01640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f51c40cfb50 0x7f51c41550a0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:31.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.324+0000 7f51c9f01640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f51c40cf770 0x7f51c4152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:31.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.324+0000 7f51c9f01640 1 --2- 172.21.15.159:0/3899312490 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f51c406dba0 0x7f51c4146040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:31.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.324+0000 7f51c9f01640 1 -- 172.21.15.159:0/3899312490 >> 172.21.15.159:0/3899312490 conn(0x7f51c406c560 msgr2=0x7f51c415bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:31.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.325+0000 7f51c9f01640 1 -- 172.21.15.159:0/3899312490 shutdown_connections 2024-07-24T16:36:31.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:31.325+0000 7f51c9f01640 1 -- 172.21.15.159:0/3899312490 wait complete. 2024-07-24T16:36:31.338 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir3 2024-07-24T16:36:31.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:31.338 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir3/.snap) 2024-07-24T16:36:31.359 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:31.359 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:31.359 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:31.359 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:31.359 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:31.359 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:31.360 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:31.360 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:31.360 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:31.360 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:31.360 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:31.361 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:31.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:31.361 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_26_00_UTC) 2024-07-24T16:36:31.444 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:31.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:31.445 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_27_00_UTC) 2024-07-24T16:36:31.519 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:31.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:31.520 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_28_00_UTC) 2024-07-24T16:36:31.600 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:31.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:31.600 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_29_00_UTC) 2024-07-24T16:36:31.666 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:31.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:31.666 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_30_00_UTC) 2024-07-24T16:36:31.727 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:31.728 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:31.728 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_31_00_UTC) 2024-07-24T16:36:31.788 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:31.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:31.789 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_32_00_UTC) 2024-07-24T16:36:31.851 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:31.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:31.851 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_33_00_UTC) 2024-07-24T16:36:31.912 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:31.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:31.913 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_34_00_UTC) 2024-07-24T16:36:31.973 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:31.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:31.973 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_35_00_UTC) 2024-07-24T16:36:32.037 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:32.038 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:32.038 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3/.snap/scheduled-2024-07-24-16_36_00_UTC) 2024-07-24T16:36:32.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:32.102 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir3) 2024-07-24T16:36:32.160 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir4 1m 2024-07-24T16:36:32.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.304+0000 7f0936f59640 1 -- 172.21.15.159:0/1285378259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091c003a50 msgr2=0x7f091c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:32.307 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.304+0000 7f0936f59640 1 --2- 172.21.15.159:0/1285378259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091c003a50 0x7f091c003e70 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f0920005fd0 tx=0x7f091c005830 comp rx=0 tx=0).stop 2024-07-24T16:36:32.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.304+0000 7f0936f59640 1 -- 172.21.15.159:0/1285378259 shutdown_connections 2024-07-24T16:36:32.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.304+0000 7f0936f59640 1 --2- 172.21.15.159:0/1285378259 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091c003a50 0x7f091c003e70 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:32.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.304+0000 7f0936f59640 1 -- 172.21.15.159:0/1285378259 >> 172.21.15.159:0/1285378259 conn(0x7f093006c560 msgr2=0x7f093006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:32.308 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.305+0000 7f0936f59640 1 -- 172.21.15.159:0/1285378259 shutdown_connections 2024-07-24T16:36:32.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.305+0000 7f0936f59640 1 -- 172.21.15.159:0/1285378259 wait complete. 2024-07-24T16:36:32.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.306+0000 7f0936f59640 1 Processor -- start 2024-07-24T16:36:32.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.306+0000 7f0936f59640 1 -- start start 2024-07-24T16:36:32.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0936f59640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091c003a50 0x7f09301f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:32.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0936f59640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f09301399a0 0x7f093014df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:32.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0936f59640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f093014e4a0 0x7f093014eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:32.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0936f59640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f09300cb680 con 0x7f091c003a50 2024-07-24T16:36:32.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0936f59640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f09300cb500 con 0x7f093014e4a0 2024-07-24T16:36:32.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0936f59640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f09300cb800 con 0x7f09301399a0 2024-07-24T16:36:32.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0934cf5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091c003a50 0x7f09301f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:32.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0934cf5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091c003a50 0x7f09301f1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34366/0 (socket says 172.21.15.159:34366) 2024-07-24T16:36:32.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0934cf5640 1 -- 172.21.15.159:0/2612744852 learned_addr learned my addr 172.21.15.159:0/2612744852 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:32.313 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f09354f6640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f093014e4a0 0x7f093014eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:32.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f092ffff640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f09301399a0 0x7f093014df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:32.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0934cf5640 1 -- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f09301399a0 msgr2=0x7f093014df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:32.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0934cf5640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f09301399a0 0x7f093014df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:32.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0934cf5640 1 -- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f093014e4a0 msgr2=0x7f093014eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:32.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0934cf5640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f093014e4a0 0x7f093014eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:32.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0934cf5640 1 -- 172.21.15.159:0/2612744852 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f093013a3f0 con 0x7f091c003a50 2024-07-24T16:36:32.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0934cf5640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091c003a50 0x7f09301f1490 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0920009d70 tx=0x7f09200336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:32.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f092d7fa640 1 -- 172.21.15.159:0/2612744852 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920038040 con 0x7f091c003a50 2024-07-24T16:36:32.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f092d7fa640 1 -- 172.21.15.159:0/2612744852 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0920041070 con 0x7f091c003a50 2024-07-24T16:36:32.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0936f59640 1 -- 172.21.15.159:0/2612744852 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f093013a6d0 con 0x7f091c003a50 2024-07-24T16:36:32.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f092d7fa640 1 -- 172.21.15.159:0/2612744852 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0920033b40 con 0x7f091c003a50 2024-07-24T16:36:32.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.307+0000 7f0936f59640 1 -- 172.21.15.159:0/2612744852 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f093014da40 con 0x7f091c003a50 2024-07-24T16:36:32.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.308+0000 7f0936f59640 1 -- 172.21.15.159:0/2612744852 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09300cbd60 con 0x7f091c003a50 2024-07-24T16:36:32.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.309+0000 7f092d7fa640 1 -- 172.21.15.159:0/2612744852 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f0920033ce0 con 0x7f091c003a50 2024-07-24T16:36:32.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.310+0000 7f092d7fa640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0910077210 0x7f09100796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:32.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.310+0000 7f092d7fa640 1 -- 172.21.15.159:0/2612744852 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 7404+0+0 (secure 0 0 0) 0x7f09200b9810 con 0x7f091c003a50 2024-07-24T16:36:32.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.310+0000 7f092ffff640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0910077210 0x7f09100796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:32.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.310+0000 7f092ffff640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0910077210 0x7f09100796d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0918000c00 tx=0x7f09180067a0 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:32.316 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.314+0000 7f092d7fa640 1 -- 172.21.15.159:0/2612744852 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f0920082240 con 0x7f091c003a50 2024-07-24T16:36:32.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.523+0000 7f0936f59640 1 -- 172.21.15.159:0/2612744852 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir4", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f0930151e80 con 0x7f0910077210 2024-07-24T16:36:32.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.607+0000 7f092d7fa640 1 -- 172.21.15.159:0/2612744852 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f0930151e80 con 0x7f0910077210 2024-07-24T16:36:32.610 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule removed for path /snap_test_dir1/dir4 2024-07-24T16:36:32.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.609+0000 7f0936f59640 1 -- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0910077210 msgr2=0x7f09100796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:32.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.609+0000 7f0936f59640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0910077210 0x7f09100796d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f0918000c00 tx=0x7f09180067a0 comp rx=0 tx=0).stop 2024-07-24T16:36:32.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.609+0000 7f0936f59640 1 -- 172.21.15.159:0/2612744852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091c003a50 msgr2=0x7f09301f1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:32.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.609+0000 7f0936f59640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091c003a50 0x7f09301f1490 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f0920009d70 tx=0x7f09200336f0 comp rx=0 tx=0).stop 2024-07-24T16:36:32.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.609+0000 7f0936f59640 1 -- 172.21.15.159:0/2612744852 shutdown_connections 2024-07-24T16:36:32.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.609+0000 7f0936f59640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0910077210 0x7f09100796d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:32.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.609+0000 7f0936f59640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f093014e4a0 0x7f093014eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:32.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.609+0000 7f0936f59640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f09301399a0 0x7f093014df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:32.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.609+0000 7f0936f59640 1 --2- 172.21.15.159:0/2612744852 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f091c003a50 0x7f09301f1490 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:32.612 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.609+0000 7f0936f59640 1 -- 172.21.15.159:0/2612744852 >> 172.21.15.159:0/2612744852 conn(0x7f093006c560 msgr2=0x7f09301521f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:32.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.609+0000 7f0936f59640 1 -- 172.21.15.159:0/2612744852 shutdown_connections 2024-07-24T16:36:32.613 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:32.609+0000 7f0936f59640 1 -- 172.21.15.159:0/2612744852 wait complete. 2024-07-24T16:36:32.622 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir4 2024-07-24T16:36:32.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:32.622 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir4/.snap) 2024-07-24T16:36:32.639 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:32.639 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:32.639 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:32.639 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:32.639 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:32.639 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:32.639 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:32.639 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:32.639 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:32.639 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:32.640 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:32.640 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:32.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:32.640 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_26_00_UTC) 2024-07-24T16:36:32.701 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:32.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:32.702 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_27_00_UTC) 2024-07-24T16:36:32.763 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:32.763 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:32.763 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_28_00_UTC) 2024-07-24T16:36:32.825 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:32.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:32.825 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_29_00_UTC) 2024-07-24T16:36:32.887 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:32.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:32.887 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_30_00_UTC) 2024-07-24T16:36:32.949 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:32.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:32.950 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_31_00_UTC) 2024-07-24T16:36:33.011 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:33.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:33.011 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_32_00_UTC) 2024-07-24T16:36:33.072 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:33.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:33.073 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_33_00_UTC) 2024-07-24T16:36:33.134 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:33.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:33.134 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_34_00_UTC) 2024-07-24T16:36:33.200 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:33.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:33.201 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_35_00_UTC) 2024-07-24T16:36:33.265 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:33.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:33.265 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4/.snap/scheduled-2024-07-24-16_36_00_UTC) 2024-07-24T16:36:33.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:33.326 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir4) 2024-07-24T16:36:33.394 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir5 1m 2024-07-24T16:36:33.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.538+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1298030279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e415d950 msgr2=0x7f26e4161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:33.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.538+0000 7f26eb5cb640 1 --2- 172.21.15.159:0/1298030279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e415d950 0x7f26e4161f20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009830 tx=0x7f26e002a5a0 comp rx=0 tx=0).stop 2024-07-24T16:36:33.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.538+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1298030279 shutdown_connections 2024-07-24T16:36:33.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.538+0000 7f26eb5cb640 1 --2- 172.21.15.159:0/1298030279 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26e40b2ae0 0x7f26e40b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:33.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.538+0000 7f26eb5cb640 1 --2- 172.21.15.159:0/1298030279 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e415d950 0x7f26e4161f20 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:33.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.538+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1298030279 >> 172.21.15.159:0/1298030279 conn(0x7f26e409cd30 msgr2=0x7f26e40d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:33.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.538+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1298030279 shutdown_connections 2024-07-24T16:36:33.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.538+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1298030279 wait complete. 2024-07-24T16:36:33.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.539+0000 7f26eb5cb640 1 Processor -- start 2024-07-24T16:36:33.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.540+0000 7f26eb5cb640 1 -- start start 2024-07-24T16:36:33.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.540+0000 7f26eb5cb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e40b0b60 0x7f26e40b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:33.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.540+0000 7f26eb5cb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26e40b2ae0 0x7f26e41f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:33.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.540+0000 7f26eb5cb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26e415d950 0x7f26e41f7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:33.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.540+0000 7f26eb5cb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f26e40d02e0 con 0x7f26e40b0b60 2024-07-24T16:36:33.545 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.540+0000 7f26eb5cb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f26e40d0090 con 0x7f26e415d950 2024-07-24T16:36:33.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.540+0000 7f26eb5cb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f26e40d0460 con 0x7f26e40b2ae0 2024-07-24T16:36:33.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.540+0000 7f26e9367640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e40b0b60 0x7f26e40b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:33.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.540+0000 7f26e9367640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e40b0b60 0x7f26e40b5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34386/0 (socket says 172.21.15.159:34386) 2024-07-24T16:36:33.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.540+0000 7f26e9367640 1 -- 172.21.15.159:0/1393871377 learned_addr learned my addr 172.21.15.159:0/1393871377 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:33.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26e9367640 1 -- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26e40b2ae0 msgr2=0x7f26e41f4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:33.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26e8b66640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26e40b2ae0 0x7f26e41f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:33.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26e9b68640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26e415d950 0x7f26e41f7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:33.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26e9367640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26e40b2ae0 0x7f26e41f4e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:33.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26e9367640 1 -- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26e415d950 msgr2=0x7f26e41f7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:33.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26e9367640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26e415d950 0x7f26e41f7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:33.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26e9367640 1 -- 172.21.15.159:0/1393871377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26e40b5f50 con 0x7f26e40b0b60 2024-07-24T16:36:33.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26e9b68640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26e415d950 0x7f26e41f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:36:33.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26e9367640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e40b0b60 0x7f26e40b5a10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f26e002ab90 tx=0x7f26e0033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:33.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26d9ffb640 1 -- 172.21.15.159:0/1393871377 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e0005c90 con 0x7f26e40b0b60 2024-07-24T16:36:33.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26d9ffb640 1 -- 172.21.15.159:0/1393871377 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26e0031e50 con 0x7f26e40b0b60 2024-07-24T16:36:33.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26d9ffb640 1 -- 172.21.15.159:0/1393871377 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e0005260 con 0x7f26e40b0b60 2024-07-24T16:36:33.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1393871377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26e41f5380 con 0x7f26e40b0b60 2024-07-24T16:36:33.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.541+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1393871377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26e41f8730 con 0x7f26e40b0b60 2024-07-24T16:36:33.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.542+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1393871377 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26e40d08f0 con 0x7f26e40b0b60 2024-07-24T16:36:33.549 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.543+0000 7f26d9ffb640 1 -- 172.21.15.159:0/1393871377 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f26e0005400 con 0x7f26e40b0b60 2024-07-24T16:36:33.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.543+0000 7f26d9ffb640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f26c8077210 0x7f26c80796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:33.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.543+0000 7f26d9ffb640 1 -- 172.21.15.159:0/1393871377 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 7228+0+0 (secure 0 0 0) 0x7f26e00ba260 con 0x7f26e40b0b60 2024-07-24T16:36:33.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.544+0000 7f26e8b66640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f26c8077210 0x7f26c80796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:33.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.544+0000 7f26e8b66640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f26c8077210 0x7f26c80796d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26e415e860 tx=0x7f26d4005c60 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:33.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.547+0000 7f26d9ffb640 1 -- 172.21.15.159:0/1393871377 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f26e003f030 con 0x7f26e40b0b60 2024-07-24T16:36:33.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.768+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1393871377 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir5", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f26e41f8900 con 0x7f26c8077210 2024-07-24T16:36:33.842 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.840+0000 7f26d9ffb640 1 -- 172.21.15.159:0/1393871377 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f26e41f8900 con 0x7f26c8077210 2024-07-24T16:36:33.843 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule removed for path /snap_test_dir1/dir5 2024-07-24T16:36:33.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.842+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f26c8077210 msgr2=0x7f26c80796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:33.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.842+0000 7f26eb5cb640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f26c8077210 0x7f26c80796d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f26e415e860 tx=0x7f26d4005c60 comp rx=0 tx=0).stop 2024-07-24T16:36:33.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.842+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1393871377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e40b0b60 msgr2=0x7f26e40b5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:33.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.842+0000 7f26eb5cb640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e40b0b60 0x7f26e40b5a10 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f26e002ab90 tx=0x7f26e0033c20 comp rx=0 tx=0).stop 2024-07-24T16:36:33.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.842+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1393871377 shutdown_connections 2024-07-24T16:36:33.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.842+0000 7f26eb5cb640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f26c8077210 0x7f26c80796d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:33.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.842+0000 7f26eb5cb640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f26e415d950 0x7f26e41f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:33.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.842+0000 7f26eb5cb640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f26e40b2ae0 0x7f26e41f4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:33.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.842+0000 7f26eb5cb640 1 --2- 172.21.15.159:0/1393871377 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f26e40b0b60 0x7f26e40b5a10 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:33.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.842+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1393871377 >> 172.21.15.159:0/1393871377 conn(0x7f26e409cd30 msgr2=0x7f26e40b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:33.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.842+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1393871377 shutdown_connections 2024-07-24T16:36:33.846 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:33.842+0000 7f26eb5cb640 1 -- 172.21.15.159:0/1393871377 wait complete. 2024-07-24T16:36:33.855 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir5 2024-07-24T16:36:33.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:33.855 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir5/.snap) 2024-07-24T16:36:33.872 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:33.872 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:33.872 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:33.872 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:33.872 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:33.872 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:33.872 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:33.872 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:33.872 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:33.872 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:33.873 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:33.873 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:33.873 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:33.873 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_26_00_UTC) 2024-07-24T16:36:33.935 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:33.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:33.935 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_27_00_UTC) 2024-07-24T16:36:33.996 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:33.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:33.997 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_28_00_UTC) 2024-07-24T16:36:34.057 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:34.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:34.058 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_29_00_UTC) 2024-07-24T16:36:34.118 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:34.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:34.118 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_30_00_UTC) 2024-07-24T16:36:34.179 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:34.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:34.180 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_31_00_UTC) 2024-07-24T16:36:34.240 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:34.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:34.240 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_32_00_UTC) 2024-07-24T16:36:34.301 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:34.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:34.301 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_33_00_UTC) 2024-07-24T16:36:34.373 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:34.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:34.374 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_34_00_UTC) 2024-07-24T16:36:34.439 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:34.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:34.440 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_35_00_UTC) 2024-07-24T16:36:34.503 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:34.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:34.503 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5/.snap/scheduled-2024-07-24-16_36_00_UTC) 2024-07-24T16:36:34.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:34.565 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir5) 2024-07-24T16:36:34.625 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir6 1m 2024-07-24T16:36:34.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.769+0000 7efe03edb640 1 -- 172.21.15.159:0/658298834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdfc15f9a0 msgr2=0x7efdfc0ae730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:34.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.769+0000 7efe03edb640 1 --2- 172.21.15.159:0/658298834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdfc15f9a0 0x7efdfc0ae730 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009830 tx=0x7efdf402a5a0 comp rx=0 tx=0).stop 2024-07-24T16:36:34.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.769+0000 7efe03edb640 1 -- 172.21.15.159:0/658298834 shutdown_connections 2024-07-24T16:36:34.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.769+0000 7efe03edb640 1 --2- 172.21.15.159:0/658298834 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdfc15f9a0 0x7efdfc0ae730 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:34.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.769+0000 7efe03edb640 1 --2- 172.21.15.159:0/658298834 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efdfc15b4d0 0x7efdfc070750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:34.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.769+0000 7efe03edb640 1 -- 172.21.15.159:0/658298834 >> 172.21.15.159:0/658298834 conn(0x7efdfc09aa20 msgr2=0x7efdfc0d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:34.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.769+0000 7efe03edb640 1 -- 172.21.15.159:0/658298834 shutdown_connections 2024-07-24T16:36:34.773 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.769+0000 7efe03edb640 1 -- 172.21.15.159:0/658298834 wait complete. 2024-07-24T16:36:34.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.770+0000 7efe03edb640 1 Processor -- start 2024-07-24T16:36:34.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.770+0000 7efe03edb640 1 -- start start 2024-07-24T16:36:34.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.771+0000 7efe03edb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efdfc09af50 0x7efdfc150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:34.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.771+0000 7efe03edb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdfc15b4d0 0x7efdfc1f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:34.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.771+0000 7efe03edb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdfc15f9a0 0x7efdfc0b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:34.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.771+0000 7efe03edb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc0af000 con 0x7efdfc15f9a0 2024-07-24T16:36:34.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.771+0000 7efe03edb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efdfc0aee80 con 0x7efdfc15b4d0 2024-07-24T16:36:34.775 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.771+0000 7efe03edb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7efdfc0af180 con 0x7efdfc09af50 2024-07-24T16:36:34.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.771+0000 7efe02478640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdfc15f9a0 0x7efdfc0b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:34.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.771+0000 7efe02478640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdfc15f9a0 0x7efdfc0b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34404/0 (socket says 172.21.15.159:34404) 2024-07-24T16:36:34.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.771+0000 7efe02478640 1 -- 172.21.15.159:0/2167093344 learned_addr learned my addr 172.21.15.159:0/2167093344 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:34.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.771+0000 7efe01c77640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efdfc09af50 0x7efdfc150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:34.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.771+0000 7efe01476640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdfc15b4d0 0x7efdfc1f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:34.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.772+0000 7efe02478640 1 -- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efdfc09af50 msgr2=0x7efdfc150f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:34.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.772+0000 7efe02478640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efdfc09af50 0x7efdfc150f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:34.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.772+0000 7efe02478640 1 -- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdfc15b4d0 msgr2=0x7efdfc1f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:34.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.772+0000 7efe02478640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdfc15b4d0 0x7efdfc1f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:34.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.772+0000 7efe02478640 1 -- 172.21.15.159:0/2167093344 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdfc15a5c0 con 0x7efdfc15f9a0 2024-07-24T16:36:34.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.772+0000 7efe02478640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdfc15f9a0 0x7efdfc0b12e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009920 tx=0x7efdf4032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:34.776 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.772+0000 7efdfa7fc640 1 -- 172.21.15.159:0/2167093344 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4040070 con 0x7efdfc15f9a0 2024-07-24T16:36:34.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.772+0000 7efdfa7fc640 1 -- 172.21.15.159:0/2167093344 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdf4005310 con 0x7efdfc15f9a0 2024-07-24T16:36:34.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.772+0000 7efdfa7fc640 1 -- 172.21.15.159:0/2167093344 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdf4032e30 con 0x7efdfc15f9a0 2024-07-24T16:36:34.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.772+0000 7efe03edb640 1 -- 172.21.15.159:0/2167093344 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdfc0b3720 con 0x7efdfc15f9a0 2024-07-24T16:36:34.777 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.772+0000 7efe03edb640 1 -- 172.21.15.159:0/2167093344 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdfc0b4890 con 0x7efdfc15f9a0 2024-07-24T16:36:34.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.773+0000 7efe03edb640 1 -- 172.21.15.159:0/2167093344 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdfc0b46b0 con 0x7efdfc15f9a0 2024-07-24T16:36:34.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.774+0000 7efdfa7fc640 1 -- 172.21.15.159:0/2167093344 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7efdf4039040 con 0x7efdfc15f9a0 2024-07-24T16:36:34.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.774+0000 7efdfa7fc640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efde8077210 0x7efde80796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:34.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.774+0000 7efdfa7fc640 1 -- 172.21.15.159:0/2167093344 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 7436+0+0 (secure 0 0 0) 0x7efdf40ba390 con 0x7efdfc15f9a0 2024-07-24T16:36:34.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.774+0000 7efe01c77640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efde8077210 0x7efde80796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:34.778 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.775+0000 7efe01c77640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efde8077210 0x7efde80796d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efdec00a400 tx=0x7efdec00d040 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:34.781 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.778+0000 7efdfa7fc640 1 -- 172.21.15.159:0/2167093344 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7efdfc0b46b0 con 0x7efdfc15f9a0 2024-07-24T16:36:34.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:34.985+0000 7efe03edb640 1 -- 172.21.15.159:0/2167093344 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir6", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7efdfc070750 con 0x7efde8077210 2024-07-24T16:36:35.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:35.066+0000 7efdfa7fc640 1 -- 172.21.15.159:0/2167093344 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7efdfc070750 con 0x7efde8077210 2024-07-24T16:36:35.068 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule removed for path /snap_test_dir1/dir6 2024-07-24T16:36:35.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:35.068+0000 7efe03edb640 1 -- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efde8077210 msgr2=0x7efde80796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:35.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:35.068+0000 7efe03edb640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efde8077210 0x7efde80796d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7efdec00a400 tx=0x7efdec00d040 comp rx=0 tx=0).stop 2024-07-24T16:36:35.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:35.068+0000 7efe03edb640 1 -- 172.21.15.159:0/2167093344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdfc15f9a0 msgr2=0x7efdfc0b12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:35.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:35.068+0000 7efe03edb640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdfc15f9a0 0x7efdfc0b12e0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009920 tx=0x7efdf4032c10 comp rx=0 tx=0).stop 2024-07-24T16:36:35.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:35.068+0000 7efe03edb640 1 -- 172.21.15.159:0/2167093344 shutdown_connections 2024-07-24T16:36:35.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:35.068+0000 7efe03edb640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efde8077210 0x7efde80796d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:35.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:35.068+0000 7efe03edb640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efdfc15f9a0 0x7efdfc0b12e0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:35.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:35.068+0000 7efe03edb640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efdfc15b4d0 0x7efdfc1f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:35.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:35.068+0000 7efe03edb640 1 --2- 172.21.15.159:0/2167093344 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efdfc09af50 0x7efdfc150f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:35.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:35.068+0000 7efe03edb640 1 -- 172.21.15.159:0/2167093344 >> 172.21.15.159:0/2167093344 conn(0x7efdfc09aa20 msgr2=0x7efdfc0cdc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:35.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:35.068+0000 7efe03edb640 1 -- 172.21.15.159:0/2167093344 shutdown_connections 2024-07-24T16:36:35.071 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:35.068+0000 7efe03edb640 1 -- 172.21.15.159:0/2167093344 wait complete. 2024-07-24T16:36:35.081 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir6 2024-07-24T16:36:35.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:35.081 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir6/.snap) 2024-07-24T16:36:35.098 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:35.098 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:35.098 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:35.098 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:35.098 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:35.099 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:35.099 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:35.099 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:35.099 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:35.099 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:35.099 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:35.099 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:35.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:35.099 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_26_00_UTC) 2024-07-24T16:36:35.161 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:35.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:35.161 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_27_00_UTC) 2024-07-24T16:36:35.223 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:35.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:35.223 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_28_00_UTC) 2024-07-24T16:36:35.285 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:35.285 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:35.285 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_29_00_UTC) 2024-07-24T16:36:35.346 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:35.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:35.347 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_30_00_UTC) 2024-07-24T16:36:35.416 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:35.416 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:35.416 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_31_00_UTC) 2024-07-24T16:36:35.477 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:35.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:35.477 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_32_00_UTC) 2024-07-24T16:36:35.539 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:35.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:35.539 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_33_00_UTC) 2024-07-24T16:36:35.600 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:35.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:35.600 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_34_00_UTC) 2024-07-24T16:36:35.661 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:35.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:35.661 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_35_00_UTC) 2024-07-24T16:36:35.723 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:35.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:35.723 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6/.snap/scheduled-2024-07-24-16_36_00_UTC) 2024-07-24T16:36:35.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:35.787 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir6) 2024-07-24T16:36:35.845 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir7 1m 2024-07-24T16:36:36.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.001+0000 7faa01c41640 1 -- 172.21.15.159:0/909442062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9e80051c0 msgr2=0x7fa9e800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:36.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.001+0000 7faa01c41640 1 --2- 172.21.15.159:0/909442062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9e80051c0 0x7fa9e800b9c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc0cfb50 tx=0x7fa9e8005830 comp rx=0 tx=0).stop 2024-07-24T16:36:36.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.001+0000 7fa9fbfff640 1 -- 172.21.15.159:0/909442062 reap_dead start 2024-07-24T16:36:36.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.001+0000 7faa01c41640 1 -- 172.21.15.159:0/909442062 shutdown_connections 2024-07-24T16:36:36.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.001+0000 7faa01c41640 1 -- 172.21.15.159:0/909442062 >> 172.21.15.159:0/909442062 conn(0x7fa9fc09cd30 msgr2=0x7fa9fc0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:36.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.001+0000 7faa01c41640 1 -- 172.21.15.159:0/909442062 shutdown_connections 2024-07-24T16:36:36.004 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.001+0000 7faa01c41640 1 -- 172.21.15.159:0/909442062 wait complete. 2024-07-24T16:36:36.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.002+0000 7faa01c41640 1 Processor -- start 2024-07-24T16:36:36.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.002+0000 7faa01c41640 1 -- start start 2024-07-24T16:36:36.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7faa01c41640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa9e80051c0 0x7fa9fc15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:36.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7faa01c41640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9fc1f5550 0x7fa9fc0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:36.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7faa01c41640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9fc0cd0b0 0x7fa9fc0b5330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:36.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7faa01c41640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa9fc0cfd80 con 0x7fa9fc1f5550 2024-07-24T16:36:36.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7faa01c41640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa9fc0cfc00 con 0x7fa9fc0cd0b0 2024-07-24T16:36:36.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7faa01c41640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa9fc0cff00 con 0x7fa9e80051c0 2024-07-24T16:36:36.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7fa9faffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9fc1f5550 0x7fa9fc0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:36.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7fa9faffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9fc1f5550 0x7fa9fc0ccb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34424/0 (socket says 172.21.15.159:34424) 2024-07-24T16:36:36.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7fa9faffd640 1 -- 172.21.15.159:0/491335798 learned_addr learned my addr 172.21.15.159:0/491335798 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:36.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7fa9fb7fe640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa9e80051c0 0x7fa9fc15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:36.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7fa9fbfff640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9fc0cd0b0 0x7fa9fc0b5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:36.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7fa9faffd640 1 -- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa9e80051c0 msgr2=0x7fa9fc15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:36.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7fa9faffd640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa9e80051c0 0x7fa9fc15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:36.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7fa9faffd640 1 -- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9fc0cd0b0 msgr2=0x7fa9fc0b5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:36.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7fa9faffd640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9fc0cd0b0 0x7fa9fc0b5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:36.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7fa9faffd640 1 -- 172.21.15.159:0/491335798 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9fc1f4530 con 0x7fa9fc1f5550 2024-07-24T16:36:36.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.003+0000 7fa9faffd640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9fc1f5550 0x7fa9fc0ccb70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4001be0 tx=0x7fa9e4006810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:36.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.004+0000 7fa9f3fff640 1 -- 172.21.15.159:0/491335798 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4015070 con 0x7fa9fc1f5550 2024-07-24T16:36:36.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.004+0000 7fa9f3fff640 1 -- 172.21.15.159:0/491335798 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa9e400fd60 con 0x7fa9fc1f5550 2024-07-24T16:36:36.008 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.004+0000 7faa01c41640 1 -- 172.21.15.159:0/491335798 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9fc1f4810 con 0x7fa9fc1f5550 2024-07-24T16:36:36.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.004+0000 7fa9f3fff640 1 -- 172.21.15.159:0/491335798 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9e4011690 con 0x7fa9fc1f5550 2024-07-24T16:36:36.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.004+0000 7faa01c41640 1 -- 172.21.15.159:0/491335798 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9fc1f4dd0 con 0x7fa9fc1f5550 2024-07-24T16:36:36.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.005+0000 7faa01c41640 1 -- 172.21.15.159:0/491335798 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9fc161f20 con 0x7fa9fc1f5550 2024-07-24T16:36:36.009 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.005+0000 7fa9f3fff640 1 -- 172.21.15.159:0/491335798 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7fa9e4011830 con 0x7fa9fc1f5550 2024-07-24T16:36:36.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.006+0000 7fa9f3fff640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa9dc077240 0x7fa9dc079700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:36.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.006+0000 7fa9f3fff640 1 -- 172.21.15.159:0/491335798 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 7624+0+0 (secure 0 0 0) 0x7fa9e409a360 con 0x7fa9fc1f5550 2024-07-24T16:36:36.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.006+0000 7fa9fb7fe640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa9dc077240 0x7fa9dc079700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:36.010 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.007+0000 7fa9fb7fe640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa9dc077240 0x7fa9dc079700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009e50 tx=0x7fa9f4005f90 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:36.013 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.010+0000 7fa9f3fff640 1 -- 172.21.15.159:0/491335798 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa9e4062540 con 0x7fa9fc1f5550 2024-07-24T16:36:36.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.254+0000 7faa01c41640 1 -- 172.21.15.159:0/491335798 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir7", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7fa9fc0cd490 con 0x7fa9dc077240 2024-07-24T16:36:36.326 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.324+0000 7fa9f3fff640 1 -- 172.21.15.159:0/491335798 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7fa9fc0cd490 con 0x7fa9dc077240 2024-07-24T16:36:36.327 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule removed for path /snap_test_dir1/dir7 2024-07-24T16:36:36.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.326+0000 7faa01c41640 1 -- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa9dc077240 msgr2=0x7fa9dc079700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:36.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.326+0000 7faa01c41640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa9dc077240 0x7fa9dc079700 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa9f4009e50 tx=0x7fa9f4005f90 comp rx=0 tx=0).stop 2024-07-24T16:36:36.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.326+0000 7faa01c41640 1 -- 172.21.15.159:0/491335798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9fc1f5550 msgr2=0x7fa9fc0ccb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:36.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.326+0000 7faa01c41640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9fc1f5550 0x7fa9fc0ccb70 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fa9e4001be0 tx=0x7fa9e4006810 comp rx=0 tx=0).stop 2024-07-24T16:36:36.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.326+0000 7faa01c41640 1 -- 172.21.15.159:0/491335798 shutdown_connections 2024-07-24T16:36:36.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.326+0000 7faa01c41640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fa9dc077240 0x7fa9dc079700 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:36.329 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.326+0000 7faa01c41640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa9fc0cd0b0 0x7fa9fc0b5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:36.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.326+0000 7faa01c41640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa9fc1f5550 0x7fa9fc0ccb70 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:36.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.326+0000 7faa01c41640 1 --2- 172.21.15.159:0/491335798 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa9e80051c0 0x7fa9fc15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:36.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.327+0000 7faa01c41640 1 -- 172.21.15.159:0/491335798 >> 172.21.15.159:0/491335798 conn(0x7fa9fc09cd30 msgr2=0x7fa9fc0b78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:36.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.327+0000 7faa01c41640 1 -- 172.21.15.159:0/491335798 shutdown_connections 2024-07-24T16:36:36.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:36.327+0000 7faa01c41640 1 -- 172.21.15.159:0/491335798 wait complete. 2024-07-24T16:36:36.340 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir7 2024-07-24T16:36:36.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:36.340 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir7/.snap) 2024-07-24T16:36:36.356 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:36.356 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:36.356 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:36.357 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:36.357 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:36.357 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:36.357 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:36.357 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:36.357 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:36.357 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:36.357 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:36.357 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:36.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:36.358 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_26_00_UTC) 2024-07-24T16:36:36.417 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:36.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:36.418 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_27_00_UTC) 2024-07-24T16:36:36.480 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:36.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:36.481 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_28_00_UTC) 2024-07-24T16:36:36.542 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:36.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:36.542 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_29_00_UTC) 2024-07-24T16:36:36.603 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:36.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:36.603 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_30_00_UTC) 2024-07-24T16:36:36.664 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:36.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:36.664 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_31_00_UTC) 2024-07-24T16:36:36.730 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:36.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:36.731 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_32_00_UTC) 2024-07-24T16:36:36.792 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:36.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:36.792 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_33_00_UTC) 2024-07-24T16:36:36.856 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:36.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:36.856 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_34_00_UTC) 2024-07-24T16:36:36.935 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:36.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:36.936 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_35_00_UTC) 2024-07-24T16:36:36.997 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:36.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:36.998 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7/.snap/scheduled-2024-07-24-16_36_00_UTC) 2024-07-24T16:36:37.058 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:37.058 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir7) 2024-07-24T16:36:37.117 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir8 1m 2024-07-24T16:36:37.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.261+0000 7f58b80fd640 1 -- 172.21.15.159:0/1113908760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b006d670 msgr2=0x7f58b006dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:37.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.261+0000 7f58b80fd640 1 --2- 172.21.15.159:0/1113908760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b006d670 0x7f58b006dae0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f58b00d0430 tx=0x7f58a802a790 comp rx=0 tx=0).stop 2024-07-24T16:36:37.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.261+0000 7f58b80fd640 1 -- 172.21.15.159:0/1113908760 shutdown_connections 2024-07-24T16:36:37.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.261+0000 7f58b80fd640 1 --2- 172.21.15.159:0/1113908760 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b006d670 0x7f58b006dae0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:37.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.261+0000 7f58b80fd640 1 --2- 172.21.15.159:0/1113908760 >> v2:172.21.15.193:3300/0 conn(0x7f58b0150cc0 0x7f58b015ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:37.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.261+0000 7f58b80fd640 1 -- 172.21.15.159:0/1113908760 >> 172.21.15.159:0/1113908760 conn(0x7f58b006c560 msgr2=0x7f58b006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:37.264 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.261+0000 7f58b80fd640 1 -- 172.21.15.159:0/1113908760 shutdown_connections 2024-07-24T16:36:37.265 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.261+0000 7f58b80fd640 1 -- 172.21.15.159:0/1113908760 wait complete. 2024-07-24T16:36:37.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.262+0000 7f58b80fd640 1 Processor -- start 2024-07-24T16:36:37.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.262+0000 7f58b80fd640 1 -- start start 2024-07-24T16:36:37.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b80fd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b006d670 0x7f58b0155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:37.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b80fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58b00b41d0 0x7f58b00b1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:37.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b80fd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f58b0150cc0 0x7f58b00b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:37.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b80fd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f58b0071d90 con 0x7f58b006d670 2024-07-24T16:36:37.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b80fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f58b0071c10 con 0x7f58b00b41d0 2024-07-24T16:36:37.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b80fd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f58b0071f10 con 0x7f58b0150cc0 2024-07-24T16:36:37.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b5e99640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b006d670 0x7f58b0155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:37.267 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b5e99640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b006d670 0x7f58b0155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34438/0 (socket says 172.21.15.159:34438) 2024-07-24T16:36:37.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b5e99640 1 -- 172.21.15.159:0/4165295200 learned_addr learned my addr 172.21.15.159:0/4165295200 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:37.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b5698640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58b00b41d0 0x7f58b00b1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:37.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b669a640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f58b0150cc0 0x7f58b00b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:37.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b5e99640 1 -- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f58b0150cc0 msgr2=0x7f58b00b1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:37.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b5e99640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f58b0150cc0 0x7f58b00b1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:37.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b5e99640 1 -- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58b00b41d0 msgr2=0x7f58b00b1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:37.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b5e99640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58b00b41d0 0x7f58b00b1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:37.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b5e99640 1 -- 172.21.15.159:0/4165295200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b01f63a0 con 0x7f58b006d670 2024-07-24T16:36:37.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.263+0000 7f58b5698640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58b00b41d0 0x7f58b00b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:36:37.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.264+0000 7f58b5e99640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b006d670 0x7f58b0155da0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00b410 tx=0x7f58ac00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:37.268 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.264+0000 7f58a67fc640 1 -- 172.21.15.159:0/4165295200 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac015020 con 0x7f58b006d670 2024-07-24T16:36:37.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.264+0000 7f58a67fc640 1 -- 172.21.15.159:0/4165295200 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f58ac011940 con 0x7f58b006d670 2024-07-24T16:36:37.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.264+0000 7f58b80fd640 1 -- 172.21.15.159:0/4165295200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b01f55e0 con 0x7f58b006d670 2024-07-24T16:36:37.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.264+0000 7f58a67fc640 1 -- 172.21.15.159:0/4165295200 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58ac011d90 con 0x7f58b006d670 2024-07-24T16:36:37.269 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.264+0000 7f58b80fd640 1 -- 172.21.15.159:0/4165295200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b01f5ba0 con 0x7f58b006d670 2024-07-24T16:36:37.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.265+0000 7f58b80fd640 1 -- 172.21.15.159:0/4165295200 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58b0072440 con 0x7f58b006d670 2024-07-24T16:36:37.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.265+0000 7f58a67fc640 1 -- 172.21.15.159:0/4165295200 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f58ac018020 con 0x7f58b006d670 2024-07-24T16:36:37.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.266+0000 7f58a67fc640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5894077210 0x7f58940796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:37.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.266+0000 7f58a67fc640 1 -- 172.21.15.159:0/4165295200 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 7068+0+0 (secure 0 0 0) 0x7f58ac099130 con 0x7f58b006d670 2024-07-24T16:36:37.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.266+0000 7f58b5698640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5894077210 0x7f58940796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:37.270 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.267+0000 7f58b5698640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5894077210 0x7f58940796d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f58b014f090 tx=0x7f58a0009040 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:37.272 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.270+0000 7f58a67fc640 1 -- 172.21.15.159:0/4165295200 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f58ac01f020 con 0x7f58b006d670 2024-07-24T16:36:37.498 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.495+0000 7f58b80fd640 1 -- 172.21.15.159:0/4165295200 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir8", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f58b015bcc0 con 0x7f5894077210 2024-07-24T16:36:37.569 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.567+0000 7f58a67fc640 1 -- 172.21.15.159:0/4165295200 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f58b015bcc0 con 0x7f5894077210 2024-07-24T16:36:37.570 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule removed for path /snap_test_dir1/dir8 2024-07-24T16:36:37.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.569+0000 7f58b80fd640 1 -- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5894077210 msgr2=0x7f58940796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:37.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.569+0000 7f58b80fd640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5894077210 0x7f58940796d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f58b014f090 tx=0x7f58a0009040 comp rx=0 tx=0).stop 2024-07-24T16:36:37.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.569+0000 7f58b80fd640 1 -- 172.21.15.159:0/4165295200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b006d670 msgr2=0x7f58b0155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:37.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.569+0000 7f58b80fd640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b006d670 0x7f58b0155da0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f58ac00b410 tx=0x7f58ac00b8d0 comp rx=0 tx=0).stop 2024-07-24T16:36:37.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.569+0000 7f58b80fd640 1 -- 172.21.15.159:0/4165295200 shutdown_connections 2024-07-24T16:36:37.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.569+0000 7f58b80fd640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f5894077210 0x7f58940796d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:37.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.569+0000 7f58b80fd640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f58b0150cc0 0x7f58b00b1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:37.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.569+0000 7f58b80fd640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f58b00b41d0 0x7f58b00b1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:37.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.569+0000 7f58b80fd640 1 --2- 172.21.15.159:0/4165295200 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f58b006d670 0x7f58b0155da0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:37.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.569+0000 7f58b80fd640 1 -- 172.21.15.159:0/4165295200 >> 172.21.15.159:0/4165295200 conn(0x7f58b006c560 msgr2=0x7f58b015a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:37.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.569+0000 7f58b80fd640 1 -- 172.21.15.159:0/4165295200 shutdown_connections 2024-07-24T16:36:37.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:37.569+0000 7f58b80fd640 1 -- 172.21.15.159:0/4165295200 wait complete. 2024-07-24T16:36:37.582 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir8 2024-07-24T16:36:37.582 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:37.583 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir8/.snap) 2024-07-24T16:36:37.599 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:37.599 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:37.599 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:37.599 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:37.599 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:37.599 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:37.599 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:37.599 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:37.599 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:37.599 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:37.599 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:37.600 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:37.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:37.600 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_26_00_UTC) 2024-07-24T16:36:37.661 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:37.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:37.662 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_27_00_UTC) 2024-07-24T16:36:37.724 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:37.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:37.724 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_28_00_UTC) 2024-07-24T16:36:37.785 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:37.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:37.786 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_29_00_UTC) 2024-07-24T16:36:37.846 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:37.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:37.846 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_30_00_UTC) 2024-07-24T16:36:37.933 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:37.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:37.933 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_31_00_UTC) 2024-07-24T16:36:37.966 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:37.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:37.966 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_32_00_UTC) 2024-07-24T16:36:38.028 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:38.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:38.028 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_33_00_UTC) 2024-07-24T16:36:38.089 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:38.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:38.089 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_34_00_UTC) 2024-07-24T16:36:38.151 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:38.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:38.151 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_35_00_UTC) 2024-07-24T16:36:38.213 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:38.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:38.213 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8/.snap/scheduled-2024-07-24-16_36_00_UTC) 2024-07-24T16:36:38.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:38.275 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir8) 2024-07-24T16:36:38.334 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs snap-schedule remove /snap_test_dir1/dir9 1m 2024-07-24T16:36:38.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.478+0000 7f8008ea9640 1 -- 172.21.15.159:0/2060521703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004150cc0 msgr2=0x7f800415ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:38.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.478+0000 7f8008ea9640 1 --2- 172.21.15.159:0/2060521703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004150cc0 0x7f800415ad80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f8004073aa0 tx=0x7f7ff402a8f0 comp rx=0 tx=0).stop 2024-07-24T16:36:38.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.478+0000 7f8008ea9640 1 -- 172.21.15.159:0/2060521703 shutdown_connections 2024-07-24T16:36:38.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.478+0000 7f8008ea9640 1 --2- 172.21.15.159:0/2060521703 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f800406d670 0x7f800406dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:38.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.478+0000 7f8008ea9640 1 --2- 172.21.15.159:0/2060521703 >> v2:172.21.15.193:3300/0 conn(0x7f80040b41d0 0x7f80040b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:38.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.478+0000 7f8008ea9640 1 --2- 172.21.15.159:0/2060521703 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004150cc0 0x7f800415ad80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:38.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.478+0000 7f8008ea9640 1 -- 172.21.15.159:0/2060521703 >> 172.21.15.159:0/2060521703 conn(0x7f800406c560 msgr2=0x7f800406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:38.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.478+0000 7f8008ea9640 1 -- 172.21.15.159:0/2060521703 shutdown_connections 2024-07-24T16:36:38.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.478+0000 7f8008ea9640 1 -- 172.21.15.159:0/2060521703 wait complete. 2024-07-24T16:36:38.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.479+0000 7f8008ea9640 1 Processor -- start 2024-07-24T16:36:38.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.479+0000 7f8008ea9640 1 -- start start 2024-07-24T16:36:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.480+0000 7f8008ea9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f800406d670 0x7f80041f2a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.480+0000 7f8008ea9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80040b41d0 0x7f80041f5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.480+0000 7f8008ea9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004150cc0 0x7f80041f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.480+0000 7f8008ea9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f80040cf630 con 0x7f8004150cc0 2024-07-24T16:36:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.480+0000 7f8008ea9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f80040cf4b0 con 0x7f80040b41d0 2024-07-24T16:36:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.480+0000 7f8008ea9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f80040cf7b0 con 0x7f800406d670 2024-07-24T16:36:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.480+0000 7f8002d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004150cc0 0x7f80041f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.480+0000 7f8002d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004150cc0 0x7f80041f5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34450/0 (socket says 172.21.15.159:34450) 2024-07-24T16:36:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.480+0000 7f8002d9d640 1 -- 172.21.15.159:0/2090607590 learned_addr learned my addr 172.21.15.159:0/2090607590 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.480+0000 7f800259c640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f800406d670 0x7f80041f2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:38.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.480+0000 7f8001d9b640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80040b41d0 0x7f80041f5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.481+0000 7f8002d9d640 1 -- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f800406d670 msgr2=0x7f80041f2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.481+0000 7f8002d9d640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f800406d670 0x7f80041f2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.481+0000 7f8002d9d640 1 -- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80040b41d0 msgr2=0x7f80041f5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.481+0000 7f8002d9d640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80040b41d0 0x7f80041f5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.481+0000 7f8002d9d640 1 -- 172.21.15.159:0/2090607590 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8004148f20 con 0x7f8004150cc0 2024-07-24T16:36:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.481+0000 7f8002d9d640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004150cc0 0x7f80041f5ca0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00e970 tx=0x7f7ffc00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.481+0000 7f7ffaffd640 1 -- 172.21.15.159:0/2090607590 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc00ccc0 con 0x7f8004150cc0 2024-07-24T16:36:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.481+0000 7f7ffaffd640 1 -- 172.21.15.159:0/2090607590 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ffc00ce60 con 0x7f8004150cc0 2024-07-24T16:36:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.481+0000 7f8008ea9640 1 -- 172.21.15.159:0/2090607590 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8004149200 con 0x7f8004150cc0 2024-07-24T16:36:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.481+0000 7f7ffaffd640 1 -- 172.21.15.159:0/2090607590 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ffc005280 con 0x7f8004150cc0 2024-07-24T16:36:38.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.481+0000 7f8008ea9640 1 -- 172.21.15.159:0/2090607590 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80041545c0 con 0x7f8004150cc0 2024-07-24T16:36:38.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.482+0000 7f8008ea9640 1 -- 172.21.15.159:0/2090607590 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8004073830 con 0x7f8004150cc0 2024-07-24T16:36:38.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.483+0000 7f7ffaffd640 1 -- 172.21.15.159:0/2090607590 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f7ffc005420 con 0x7f8004150cc0 2024-07-24T16:36:38.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.483+0000 7f7ffaffd640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f7fe4077210 0x7f7fe40796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:38.486 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.483+0000 7f7ffaffd640 1 -- 172.21.15.159:0/2090607590 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 7084+0+0 (secure 0 0 0) 0x7f7ffc099a40 con 0x7f8004150cc0 2024-07-24T16:36:38.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.483+0000 7f800259c640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f7fe4077210 0x7f7fe40796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:38.487 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.484+0000 7f800259c640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f7fe4077210 0x7f7fe40796d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4035000 tx=0x7f7ff4004ab0 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:38.489 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.487+0000 7f7ffaffd640 1 -- 172.21.15.159:0/2090607590 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f8004073830 con 0x7f8004150cc0 2024-07-24T16:36:38.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.693+0000 7f8008ea9640 1 -- 172.21.15.159:0/2090607590 --> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] -- mgr_command(tid 0: {"prefix": "fs snap-schedule remove", "path": "/snap_test_dir1/dir9", "repeat": "1m", "target": ["mon-mgr", ""]}) -- 0x7f800406edf0 con 0x7f7fe4077210 2024-07-24T16:36:38.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.765+0000 7f7ffaffd640 1 -- 172.21.15.159:0/2090607590 <== mgr.4820 v2:172.21.15.193:6832/2609611338 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+47 (secure 0 0 0) 0x7f800406edf0 con 0x7f7fe4077210 2024-07-24T16:36:38.768 INFO:teuthology.orchestra.run.smithi159.stdout:Schedule removed for path /snap_test_dir1/dir9 2024-07-24T16:36:38.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.767+0000 7f8008ea9640 1 -- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f7fe4077210 msgr2=0x7f7fe40796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:38.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.767+0000 7f8008ea9640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f7fe4077210 0x7f7fe40796d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4035000 tx=0x7f7ff4004ab0 comp rx=0 tx=0).stop 2024-07-24T16:36:38.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.767+0000 7f8008ea9640 1 -- 172.21.15.159:0/2090607590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004150cc0 msgr2=0x7f80041f5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:38.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.767+0000 7f8008ea9640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004150cc0 0x7f80041f5ca0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00e970 tx=0x7f7ffc00ee30 comp rx=0 tx=0).stop 2024-07-24T16:36:38.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.767+0000 7f8008ea9640 1 -- 172.21.15.159:0/2090607590 shutdown_connections 2024-07-24T16:36:38.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.767+0000 7f8008ea9640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f7fe4077210 0x7f7fe40796d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:38.770 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.767+0000 7f8008ea9640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8004150cc0 0x7f80041f5ca0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:38.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.767+0000 7f8008ea9640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f80040b41d0 0x7f80041f5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:38.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.767+0000 7f8008ea9640 1 --2- 172.21.15.159:0/2090607590 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f800406d670 0x7f80041f2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:38.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.767+0000 7f8008ea9640 1 -- 172.21.15.159:0/2090607590 >> 172.21.15.159:0/2090607590 conn(0x7f800406c560 msgr2=0x7f800406c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:38.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.767+0000 7f8008ea9640 1 -- 172.21.15.159:0/2090607590 shutdown_connections 2024-07-24T16:36:38.771 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:38.767+0000 7f8008ea9640 1 -- 172.21.15.159:0/2090607590 wait complete. 2024-07-24T16:36:38.781 DEBUG:tasks.cephfs.test_snap_schedules:res=Schedule removed for path /snap_test_dir1/dir9 2024-07-24T16:36:38.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:38.781 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls snap_test_dir1/dir9/.snap) 2024-07-24T16:36:38.797 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:38.797 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:38.797 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:38.797 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:38.797 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:38.798 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:38.798 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:38.798 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:38.798 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:38.798 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:38.798 INFO:teuthology.orchestra.run.smithi159.stdout:scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:38.798 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_26_00_UTC 2024-07-24T16:36:38.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:38.798 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_26_00_UTC) 2024-07-24T16:36:38.863 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_27_00_UTC 2024-07-24T16:36:38.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:38.863 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_27_00_UTC) 2024-07-24T16:36:38.931 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_28_00_UTC 2024-07-24T16:36:38.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:38.931 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_28_00_UTC) 2024-07-24T16:36:38.993 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_29_00_UTC 2024-07-24T16:36:38.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:38.993 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_29_00_UTC) 2024-07-24T16:36:39.074 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_30_00_UTC 2024-07-24T16:36:39.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:39.074 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_30_00_UTC) 2024-07-24T16:36:39.135 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_31_00_UTC 2024-07-24T16:36:39.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:39.135 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_31_00_UTC) 2024-07-24T16:36:39.196 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_32_00_UTC 2024-07-24T16:36:39.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:39.196 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_32_00_UTC) 2024-07-24T16:36:39.257 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_33_00_UTC 2024-07-24T16:36:39.257 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:39.257 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_33_00_UTC) 2024-07-24T16:36:39.319 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_34_00_UTC 2024-07-24T16:36:39.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:39.319 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_34_00_UTC) 2024-07-24T16:36:39.383 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_35_00_UTC 2024-07-24T16:36:39.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:39.383 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_35_00_UTC) 2024-07-24T16:36:39.444 DEBUG:tasks.cephfs.test_snap_schedules:removing snapshot: snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_36_00_UTC 2024-07-24T16:36:39.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:39.444 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9/.snap/scheduled-2024-07-24-16_36_00_UTC) 2024-07-24T16:36:39.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:39.505 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec rmdir snap_test_dir1/dir9) 2024-07-24T16:36:39.564 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr module disable snap_schedule 2024-07-24T16:36:39.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.706+0000 7f098f7cb640 1 -- 172.21.15.159:0/3748864629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f098806f890 msgr2=0x7f09880cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:39.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.706+0000 7f098f7cb640 1 --2- 172.21.15.159:0/3748864629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f098806f890 0x7f09880cf320 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f097c009900 tx=0x7f097c02a610 comp rx=0 tx=0).stop 2024-07-24T16:36:39.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.706+0000 7f098f7cb640 1 -- 172.21.15.159:0/3748864629 shutdown_connections 2024-07-24T16:36:39.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.706+0000 7f098f7cb640 1 --2- 172.21.15.159:0/3748864629 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f098806f890 0x7f09880cf320 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:39.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.706+0000 7f098f7cb640 1 -- 172.21.15.159:0/3748864629 >> 172.21.15.159:0/3748864629 conn(0x7f098806c560 msgr2=0x7f098806c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:39.709 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.706+0000 7f098f7cb640 1 -- 172.21.15.159:0/3748864629 shutdown_connections 2024-07-24T16:36:39.710 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.706+0000 7f098f7cb640 1 -- 172.21.15.159:0/3748864629 wait complete. 2024-07-24T16:36:39.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.707+0000 7f098f7cb640 1 Processor -- start 2024-07-24T16:36:39.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.707+0000 7f098f7cb640 1 -- start start 2024-07-24T16:36:39.712 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.708+0000 7f098f7cb640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f098806f890 0x7f09881f2800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:39.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.708+0000 7f098f7cb640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09880cf860 0x7f09880b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:39.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.708+0000 7f098f7cb640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0988158fe0 0x7f098815dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:39.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.708+0000 7f098f7cb640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0988159540 con 0x7f09880cf860 2024-07-24T16:36:39.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.708+0000 7f098f7cb640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f09881593c0 con 0x7f0988158fe0 2024-07-24T16:36:39.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.708+0000 7f098f7cb640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f098815c6a0 con 0x7f098806f890 2024-07-24T16:36:39.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.708+0000 7f098cd66640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09880cf860 0x7f09880b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:39.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.708+0000 7f098cd66640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09880cf860 0x7f09880b02c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:34472/0 (socket says 172.21.15.159:34472) 2024-07-24T16:36:39.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.708+0000 7f098cd66640 1 -- 172.21.15.159:0/2351829654 learned_addr learned my addr 172.21.15.159:0/2351829654 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:39.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.708+0000 7f098dd68640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0988158fe0 0x7f098815dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:39.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.708+0000 7f098d567640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f098806f890 0x7f09881f2800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:39.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.708+0000 7f098cd66640 1 -- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f098806f890 msgr2=0x7f09881f2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:39.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.709+0000 7f098cd66640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f098806f890 0x7f09881f2800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:39.713 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.709+0000 7f098cd66640 1 -- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0988158fe0 msgr2=0x7f098815dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:39.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.709+0000 7f098cd66640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0988158fe0 0x7f098815dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:39.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.709+0000 7f098cd66640 1 -- 172.21.15.159:0/2351829654 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09880b0800 con 0x7f09880cf860 2024-07-24T16:36:39.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.709+0000 7f098dd68640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0988158fe0 0x7f098815dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:36:39.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.709+0000 7f098d567640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f098806f890 0x7f09881f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:36:39.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.709+0000 7f098cd66640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09880cf860 0x7f09880b02c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f097c000c00 tx=0x7f097c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:39.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.709+0000 7f0985ffb640 1 -- 172.21.15.159:0/2351829654 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c03f070 con 0x7f09880cf860 2024-07-24T16:36:39.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.709+0000 7f0985ffb640 1 -- 172.21.15.159:0/2351829654 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f097c0047a0 con 0x7f09880cf860 2024-07-24T16:36:39.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.709+0000 7f098f7cb640 1 -- 172.21.15.159:0/2351829654 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09880af620 con 0x7f09880cf860 2024-07-24T16:36:39.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.709+0000 7f0985ffb640 1 -- 172.21.15.159:0/2351829654 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c035030 con 0x7f09880cf860 2024-07-24T16:36:39.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.709+0000 7f098f7cb640 1 -- 172.21.15.159:0/2351829654 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09880afbe0 con 0x7f09880cf860 2024-07-24T16:36:39.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.710+0000 7f098f7cb640 1 -- 172.21.15.159:0/2351829654 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09880cf320 con 0x7f09880cf860 2024-07-24T16:36:39.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.711+0000 7f0985ffb640 1 -- 172.21.15.159:0/2351829654 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 13) ==== 99327+0+0 (secure 0 0 0) 0x7f097c042070 con 0x7f09880cf860 2024-07-24T16:36:39.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.711+0000 7f0985ffb640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0974077210 0x7f09740796d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:39.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.711+0000 7f0985ffb640 1 -- 172.21.15.159:0/2351829654 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 7100+0+0 (secure 0 0 0) 0x7f097c0b9e30 con 0x7f09880cf860 2024-07-24T16:36:39.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.711+0000 7f098d567640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0974077210 0x7f09740796d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:39.716 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.712+0000 7f098d567640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0974077210 0x7f09740796d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0978001d10 tx=0x7f0978009040 comp rx=0 tx=0).ready entity=mgr.4820 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:39.717 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.715+0000 7f0985ffb640 1 -- 172.21.15.159:0/2351829654 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f097c082850 con 0x7f09880cf860 2024-07-24T16:36:39.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:39.959+0000 7f098f7cb640 1 -- 172.21.15.159:0/2351829654 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "mgr module disable", "module": "snap_schedule"} v 0) -- 0x7f098806ed90 con 0x7f09880cf860 2024-07-24T16:36:40.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:40.906+0000 7f0985ffb640 1 -- 172.21.15.159:0/2351829654 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module disable", "module": "snap_schedule"}]=0 v14) ==== 93+0+0 (secure 0 0 0) 0x7f097c082150 con 0x7f09880cf860 2024-07-24T16:36:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:40.910+0000 7f098f7cb640 1 -- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0974077210 msgr2=0x7f09740796d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:40.910+0000 7f098f7cb640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0974077210 0x7f09740796d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f0978001d10 tx=0x7f0978009040 comp rx=0 tx=0).stop 2024-07-24T16:36:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:40.910+0000 7f098f7cb640 1 -- 172.21.15.159:0/2351829654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09880cf860 msgr2=0x7f09880b02c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:40.910+0000 7f098f7cb640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09880cf860 0x7f09880b02c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f097c000c00 tx=0x7f097c0038a0 comp rx=0 tx=0).stop 2024-07-24T16:36:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:40.910+0000 7f098f7cb640 1 -- 172.21.15.159:0/2351829654 shutdown_connections 2024-07-24T16:36:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:40.910+0000 7f098f7cb640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f0974077210 0x7f09740796d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:40.910+0000 7f098f7cb640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0988158fe0 0x7f098815dd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:40.913 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:40.910+0000 7f098f7cb640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f09880cf860 0x7f09880b02c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:40.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:40.910+0000 7f098f7cb640 1 --2- 172.21.15.159:0/2351829654 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f098806f890 0x7f09881f2800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:40.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:40.910+0000 7f098f7cb640 1 -- 172.21.15.159:0/2351829654 >> 172.21.15.159:0/2351829654 conn(0x7f098806c560 msgr2=0x7f098806c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:40.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:40.911+0000 7f098f7cb640 1 -- 172.21.15.159:0/2351829654 shutdown_connections 2024-07-24T16:36:40.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:40.911+0000 7f098f7cb640 1 -- 172.21.15.159:0/2351829654 wait complete. 2024-07-24T16:36:40.930 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-07-24T16:36:40.930 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-24T16:36:40.983 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-24T16:36:41.025 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-07-24T16:36:41.025 INFO:tasks.cephfs.mount:Terminating background process 2024-07-24T16:36:41.025 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:36:41.025 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:36:41.051 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:36:41.051 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:36:41.107 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-24T16:36:41.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.250+0000 7efe7508b640 1 -- 172.21.15.159:0/1844096897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe7015d950 msgr2=0x7efe70161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:41.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.250+0000 7efe7508b640 1 --2- 172.21.15.159:0/1844096897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe7015d950 0x7efe70161f20 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efe60009830 tx=0x7efe6002a590 comp rx=0 tx=0).stop 2024-07-24T16:36:41.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.250+0000 7efe7508b640 1 -- 172.21.15.159:0/1844096897 shutdown_connections 2024-07-24T16:36:41.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.250+0000 7efe7508b640 1 --2- 172.21.15.159:0/1844096897 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efe700cf770 0x7efe700cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.250+0000 7efe7508b640 1 --2- 172.21.15.159:0/1844096897 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe7015d950 0x7efe70161f20 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.250+0000 7efe7508b640 1 -- 172.21.15.159:0/1844096897 >> 172.21.15.159:0/1844096897 conn(0x7efe7009cd30 msgr2=0x7efe700d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:41.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.250+0000 7efe7508b640 1 -- 172.21.15.159:0/1844096897 shutdown_connections 2024-07-24T16:36:41.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.250+0000 7efe7508b640 1 -- 172.21.15.159:0/1844096897 wait complete. 2024-07-24T16:36:41.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.252+0000 7efe7508b640 1 Processor -- start 2024-07-24T16:36:41.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.252+0000 7efe7508b640 1 -- start start 2024-07-24T16:36:41.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.252+0000 7efe7508b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe700b2ae0 0x7efe701f4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:41.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.252+0000 7efe7508b640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe700cf770 0x7efe700ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:41.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.252+0000 7efe7508b640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efe7015d950 0x7efe70160ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:41.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.252+0000 7efe7508b640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7efe700d0460 con 0x7efe700b2ae0 2024-07-24T16:36:41.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.252+0000 7efe7508b640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efe700d02e0 con 0x7efe700cf770 2024-07-24T16:36:41.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.252+0000 7efe7508b640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7efe700d05e0 con 0x7efe7015d950 2024-07-24T16:36:41.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.252+0000 7efe6ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe700b2ae0 0x7efe701f4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:41.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe6ed9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe700b2ae0 0x7efe701f4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53708/0 (socket says 172.21.15.159:53708) 2024-07-24T16:36:41.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe6f59e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efe7015d950 0x7efe70160ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:41.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe6ed9d640 1 -- 172.21.15.159:0/3709367304 learned_addr learned my addr 172.21.15.159:0/3709367304 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:41.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe67fff640 1 --2- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe700cf770 0x7efe700ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:41.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe6f59e640 1 -- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe700cf770 msgr2=0x7efe700ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:41.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe6f59e640 1 --2- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe700cf770 0x7efe700ccde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.257 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe6f59e640 1 -- 172.21.15.159:0/3709367304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe700b2ae0 msgr2=0x7efe701f4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:41.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe6f59e640 1 --2- 172.21.15.159:0/3709367304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe700b2ae0 0x7efe701f4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe6f59e640 1 -- 172.21.15.159:0/3709367304 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe701f4b50 con 0x7efe7015d950 2024-07-24T16:36:41.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe6f59e640 1 --2- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efe7015d950 0x7efe70160ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efe6800ec50 tx=0x7efe6800c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:41.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe677fe640 1 -- 172.21.15.159:0/3709367304 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68003b70 con 0x7efe7015d950 2024-07-24T16:36:41.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe677fe640 1 -- 172.21.15.159:0/3709367304 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efe68003d10 con 0x7efe7015d950 2024-07-24T16:36:41.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe7508b640 1 -- 172.21.15.159:0/3709367304 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe700b4540 con 0x7efe7015d950 2024-07-24T16:36:41.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe677fe640 1 -- 172.21.15.159:0/3709367304 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe68004280 con 0x7efe7015d950 2024-07-24T16:36:41.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.253+0000 7efe7508b640 1 -- 172.21.15.159:0/3709367304 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efe701f3e10 con 0x7efe7015d950 2024-07-24T16:36:41.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.254+0000 7efe7508b640 1 -- 172.21.15.159:0/3709367304 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe700d0a90 con 0x7efe7015d950 2024-07-24T16:36:41.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.255+0000 7efe677fe640 1 -- 172.21.15.159:0/3709367304 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 14) ==== 99310+0+0 (secure 0 0 0) 0x7efe68004420 con 0x7efe7015d950 2024-07-24T16:36:41.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.255+0000 7efe677fe640 1 --2- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efe500771c0 0x7efe50079680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:41.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.255+0000 7efe6ed9d640 1 -- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efe500771c0 msgr2=0x7efe50079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:41.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.255+0000 7efe677fe640 1 -- 172.21.15.159:0/3709367304 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(50..50 src has 1..50) ==== 7464+0+0 (secure 0 0 0) 0x7efe68099e10 con 0x7efe7015d950 2024-07-24T16:36:41.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.255+0000 7efe6ed9d640 1 --2- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efe500771c0 0x7efe50079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-07-24T16:36:41.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.260+0000 7efe677fe640 1 -- 172.21.15.159:0/3709367304 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7efe701f4b50 con 0x7efe7015d950 2024-07-24T16:36:41.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.456+0000 7efe6ed9d640 1 -- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efe500771c0 msgr2=0x7efe50079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:41.458 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.456+0000 7efe6ed9d640 1 --2- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efe500771c0 0x7efe50079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-07-24T16:36:41.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.460+0000 7efe7508b640 1 -- 172.21.15.159:0/3709367304 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efe7006a400 con 0x7efe7015d950 2024-07-24T16:36:41.462 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.460+0000 7efe677fe640 1 -- 172.21.15.159:0/3709367304 <== mon.2 v2:172.21.15.193:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v50) ==== 80+0+358 (secure 0 0 0) 0x7efe68061fe0 con 0x7efe7015d950 2024-07-24T16:36:41.463 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.193:6832/222319347 2024-07-25T16:25:13.031566+0000 2024-07-24T16:36:41.463 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.193:0/3580844224 2024-07-25T16:25:13.031566+0000 2024-07-24T16:36:41.463 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.193:0/3685404778 2024-07-25T16:25:13.031566+0000 2024-07-24T16:36:41.463 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.193:6833/222319347 2024-07-25T16:25:13.031566+0000 2024-07-24T16:36:41.463 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.193:0/1332350307 2024-07-25T16:25:13.031566+0000 2024-07-24T16:36:41.463 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.15.193:0/1903087136 2024-07-25T16:25:13.031566+0000 2024-07-24T16:36:41.464 INFO:teuthology.orchestra.run.smithi159.stderr:listed 6 entries 2024-07-24T16:36:41.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.462+0000 7efe7508b640 1 -- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efe500771c0 msgr2=0x7efe50079680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:36:41.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.462+0000 7efe7508b640 1 --2- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efe500771c0 0x7efe50079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.462+0000 7efe7508b640 1 -- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efe7015d950 msgr2=0x7efe70160ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:41.465 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.462+0000 7efe7508b640 1 --2- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efe7015d950 0x7efe70160ad0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7efe6800ec50 tx=0x7efe6800c6a0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.462+0000 7efe7508b640 1 -- 172.21.15.159:0/3709367304 shutdown_connections 2024-07-24T16:36:41.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.462+0000 7efe7508b640 1 --2- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7efe500771c0 0x7efe50079680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.462+0000 7efe7508b640 1 --2- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efe7015d950 0x7efe70160ad0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.462+0000 7efe7508b640 1 --2- 172.21.15.159:0/3709367304 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efe700cf770 0x7efe700ccde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.462+0000 7efe7508b640 1 --2- 172.21.15.159:0/3709367304 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efe700b2ae0 0x7efe701f4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.462+0000 7efe7508b640 1 -- 172.21.15.159:0/3709367304 >> 172.21.15.159:0/3709367304 conn(0x7efe7009cd30 msgr2=0x7efe700b0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:41.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.462+0000 7efe7508b640 1 -- 172.21.15.159:0/3709367304 shutdown_connections 2024-07-24T16:36:41.466 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.462+0000 7efe7508b640 1 -- 172.21.15.159:0/3709367304 wait complete. 2024-07-24T16:36:41.476 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-07-24T16:36:41.476 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:41.476 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-07-24T16:36:41.505 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:36:41.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:36:41.505 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-07-24T16:36:41.561 INFO:tasks.cephfs.mount:Terminating background process 2024-07-24T16:36:41.562 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:36:41.562 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:36:41.577 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056073,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497484k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=448 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248740k,nr_inodes=812185,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497484k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-24T16:36:41.577 INFO:tasks.cephfs.mount:Terminating background process 2024-07-24T16:36:41.578 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:36:41.578 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:36:41.617 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056071,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20922 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248736k,nr_inodes=812184,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-24T16:36:41.617 INFO:tasks.cephfs.mount:Terminating background process 2024-07-24T16:36:41.617 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:36:41.617 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:36:41.634 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056073,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497484k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=448 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248740k,nr_inodes=812185,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497484k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-24T16:36:41.634 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:36:41.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.760+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1884441573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ef0154920 msgr2=0x7f6ef015aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:41.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.760+0000 7f6ef6efd640 1 --2- 172.21.15.159:0/1884441573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ef0154920 0x7f6ef015aa10 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f6ef0072440 tx=0x7f6ee802a560 comp rx=0 tx=0).stop 2024-07-24T16:36:41.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.760+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1884441573 shutdown_connections 2024-07-24T16:36:41.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.760+0000 7f6ef6efd640 1 --2- 172.21.15.159:0/1884441573 >> v2:172.21.15.193:3300/0 conn(0x7f6ef00b6350 0x7f6ef015e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.763 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.760+0000 7f6ef6efd640 1 --2- 172.21.15.159:0/1884441573 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ef006fb60 0x7f6ef00b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.760+0000 7f6ef6efd640 1 --2- 172.21.15.159:0/1884441573 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ef0154920 0x7f6ef015aa10 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.760+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1884441573 >> 172.21.15.159:0/1884441573 conn(0x7f6ef0072a80 msgr2=0x7f6ef0072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:41.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.760+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1884441573 shutdown_connections 2024-07-24T16:36:41.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.760+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1884441573 wait complete. 2024-07-24T16:36:41.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.762+0000 7f6ef6efd640 1 Processor -- start 2024-07-24T16:36:41.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.762+0000 7f6ef6efd640 1 -- start start 2024-07-24T16:36:41.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.762+0000 7f6ef6efd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ef006fb60 0x7f6ef01e4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:41.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.762+0000 7f6ef6efd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ef00b6350 0x7f6ef01e6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:41.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.762+0000 7f6ef6efd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ef0154920 0x7f6ef01e8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:41.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef6efd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef015e540 con 0x7f6ef0154920 2024-07-24T16:36:41.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef6efd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0154f10 con 0x7f6ef00b6350 2024-07-24T16:36:41.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef6efd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6ef015e6c0 con 0x7f6ef006fb60 2024-07-24T16:36:41.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef549a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ef0154920 0x7f6ef01e8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef549a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ef0154920 0x7f6ef01e8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53726/0 (socket says 172.21.15.159:53726) 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef549a640 1 -- 172.21.15.159:0/1267660459 learned_addr learned my addr 172.21.15.159:0/1267660459 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef4c99640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ef006fb60 0x7f6ef01e4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6eeffff640 1 --2- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ef00b6350 0x7f6ef01e6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef549a640 1 -- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ef006fb60 msgr2=0x7f6ef01e4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef549a640 1 --2- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ef006fb60 0x7f6ef01e4f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef549a640 1 -- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ef00b6350 msgr2=0x7f6ef01e6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef549a640 1 --2- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ef00b6350 0x7f6ef01e6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef549a640 1 -- 172.21.15.159:0/1267660459 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef01e7220 con 0x7f6ef0154920 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef549a640 1 --2- 172.21.15.159:0/1267660459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ef0154920 0x7f6ef01e8540 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800e9a0 tx=0x7f6ed800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6eed7fa640 1 -- 172.21.15.159:0/1267660459 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed800cc60 con 0x7f6ef0154920 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6eed7fa640 1 -- 172.21.15.159:0/1267660459 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ed800ce00 con 0x7f6ef0154920 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1267660459 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef01e74a0 con 0x7f6ef0154920 2024-07-24T16:36:41.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6eed7fa640 1 -- 172.21.15.159:0/1267660459 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ed8005280 con 0x7f6ef0154920 2024-07-24T16:36:41.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.763+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1267660459 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef01e7a60 con 0x7f6ef0154920 2024-07-24T16:36:41.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.765+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1267660459 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef015eb70 con 0x7f6ef0154920 2024-07-24T16:36:41.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.765+0000 7f6eed7fa640 1 -- 172.21.15.159:0/1267660459 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 14) ==== 99310+0+0 (secure 0 0 0) 0x7f6ed8005420 con 0x7f6ef0154920 2024-07-24T16:36:41.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.765+0000 7f6eed7fa640 1 --2- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6ed00771c0 0x7f6ed0079680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:41.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.765+0000 7f6ef4c99640 1 -- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6ed00771c0 msgr2=0x7f6ed0079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:41.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.766+0000 7f6eed7fa640 1 -- 172.21.15.159:0/1267660459 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 7464+0+0 (secure 0 0 0) 0x7f6ed8099c20 con 0x7f6ef0154920 2024-07-24T16:36:41.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.766+0000 7f6ef4c99640 1 --2- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6ed00771c0 0x7f6ed0079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-07-24T16:36:41.772 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.770+0000 7f6eed7fa640 1 -- 172.21.15.159:0/1267660459 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f6ef01e7220 con 0x7f6ef0154920 2024-07-24T16:36:41.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.967+0000 7f6ef4c99640 1 -- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6ed00771c0 msgr2=0x7f6ed0079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:41.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:41.967+0000 7f6ef4c99640 1 --2- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6ed00771c0 0x7f6ed0079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-07-24T16:36:42.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.067+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1267660459 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6ef015cb10 con 0x7f6ef0154920 2024-07-24T16:36:42.070 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.067+0000 7f6eed7fa640 1 -- 172.21.15.159:0/1267660459 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f6ed80623c0 con 0x7f6ef0154920 2024-07-24T16:36:42.070 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:42.070 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":16,"btime":"2024-07-24T16:25:00:240907+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2383254131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2383254131},{"type":"v1","addr":"172.21.15.159:6835","nonce":2383254131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1682765472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1682765472},{"type":"v1","addr":"172.21.15.193:6836","nonce":1682765472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4840,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/306853489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":306853489},{"type":"v1","addr":"172.21.15.193:6837","nonce":306853489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:57.601499+0000","modified":"2024-07-24T16:24:59.597468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/279171348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":279171348},{"type":"v1","addr":"172.21.15.159:6834","nonce":279171348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":2}]} 2024-07-24T16:36:42.071 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 16 2024-07-24T16:36:42.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.070+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6ed00771c0 msgr2=0x7f6ed0079680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:36:42.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.070+0000 7f6ef6efd640 1 --2- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6ed00771c0 0x7f6ed0079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.070+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1267660459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ef0154920 msgr2=0x7f6ef01e8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:42.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.070+0000 7f6ef6efd640 1 --2- 172.21.15.159:0/1267660459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ef0154920 0x7f6ef01e8540 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6ed800e9a0 tx=0x7f6ed800eda0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.070+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1267660459 shutdown_connections 2024-07-24T16:36:42.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.070+0000 7f6ef6efd640 1 --2- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f6ed00771c0 0x7f6ed0079680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.070+0000 7f6ef6efd640 1 --2- 172.21.15.159:0/1267660459 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ef0154920 0x7f6ef01e8540 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.070+0000 7f6ef6efd640 1 --2- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ef00b6350 0x7f6ef01e6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.070+0000 7f6ef6efd640 1 --2- 172.21.15.159:0/1267660459 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ef006fb60 0x7f6ef01e4f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.073 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.070+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1267660459 >> 172.21.15.159:0/1267660459 conn(0x7f6ef0072a80 msgr2=0x7f6ef0153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:42.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.070+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1267660459 shutdown_connections 2024-07-24T16:36:42.074 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.070+0000 7f6ef6efd640 1 -- 172.21.15.159:0/1267660459 wait complete. 2024-07-24T16:36:42.084 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:36:42.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.186+0000 7fb465206640 1 -- 172.21.15.159:0/4183934082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4600cf770 msgr2=0x7fb4600cfbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:42.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.186+0000 7fb465206640 1 --2- 172.21.15.159:0/4183934082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4600cf770 0x7fb4600cfbc0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fb46008c710 tx=0x7fb45802a940 comp rx=0 tx=0).stop 2024-07-24T16:36:42.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.186+0000 7fb465206640 1 -- 172.21.15.159:0/4183934082 shutdown_connections 2024-07-24T16:36:42.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.187+0000 7fb465206640 1 --2- 172.21.15.159:0/4183934082 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb4600cf770 0x7fb4600cfbc0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.187+0000 7fb465206640 1 --2- 172.21.15.159:0/4183934082 >> v2:172.21.15.193:3300/0 conn(0x7fb46015d950 0x7fb460161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.187+0000 7fb465206640 1 -- 172.21.15.159:0/4183934082 >> 172.21.15.159:0/4183934082 conn(0x7fb46009cd30 msgr2=0x7fb4600d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:42.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.187+0000 7fb465206640 1 -- 172.21.15.159:0/4183934082 shutdown_connections 2024-07-24T16:36:42.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.187+0000 7fb465206640 1 -- 172.21.15.159:0/4183934082 wait complete. 2024-07-24T16:36:42.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.188+0000 7fb465206640 1 Processor -- start 2024-07-24T16:36:42.190 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.188+0000 7fb465206640 1 -- start start 2024-07-24T16:36:42.192 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb465206640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4600b2ae0 0x7fb46014d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:42.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb465206640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4600cf770 0x7fb4600ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:42.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb465206640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb46015d950 0x7fb46015dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:42.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb465206640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb4600ce470 con 0x7fb46015d950 2024-07-24T16:36:42.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb465206640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb4600ce2f0 con 0x7fb4600cf770 2024-07-24T16:36:42.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb465206640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb4600d02e0 con 0x7fb4600b2ae0 2024-07-24T16:36:42.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb45f59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb46015d950 0x7fb46015dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:42.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb45f59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb46015d950 0x7fb46015dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53742/0 (socket says 172.21.15.159:53742) 2024-07-24T16:36:42.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb45f59e640 1 -- 172.21.15.159:0/2158493170 learned_addr learned my addr 172.21.15.159:0/2158493170 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:42.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb457fff640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4600cf770 0x7fb4600ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:42.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb45ed9d640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4600b2ae0 0x7fb46014d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:42.193 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb45f59e640 1 -- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4600b2ae0 msgr2=0x7fb46014d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:42.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb45f59e640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4600b2ae0 0x7fb46014d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb45f59e640 1 -- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4600cf770 msgr2=0x7fb4600ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:42.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb45f59e640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4600cf770 0x7fb4600ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb45f59e640 1 -- 172.21.15.159:0/2158493170 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb460160ed0 con 0x7fb46015d950 2024-07-24T16:36:42.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb45f59e640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb46015d950 0x7fb46015dff0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb45802af30 tx=0x7fb458031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:42.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb4577fe640 1 -- 172.21.15.159:0/2158493170 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458030430 con 0x7fb46015d950 2024-07-24T16:36:42.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.189+0000 7fb4577fe640 1 -- 172.21.15.159:0/2158493170 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb458004240 con 0x7fb46015d950 2024-07-24T16:36:42.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.190+0000 7fb465206640 1 -- 172.21.15.159:0/2158493170 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4601611b0 con 0x7fb46015d950 2024-07-24T16:36:42.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.190+0000 7fb4577fe640 1 -- 172.21.15.159:0/2158493170 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb458004670 con 0x7fb46015d950 2024-07-24T16:36:42.194 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.190+0000 7fb465206640 1 -- 172.21.15.159:0/2158493170 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb46014d010 con 0x7fb46015d950 2024-07-24T16:36:42.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.191+0000 7fb465206640 1 -- 172.21.15.159:0/2158493170 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4600cfbc0 con 0x7fb46015d950 2024-07-24T16:36:42.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.191+0000 7fb4577fe640 1 -- 172.21.15.159:0/2158493170 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 14) ==== 99310+0+0 (secure 0 0 0) 0x7fb458039440 con 0x7fb46015d950 2024-07-24T16:36:42.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.192+0000 7fb4577fe640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb4400771c0 0x7fb440079680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:42.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.192+0000 7fb45ed9d640 1 -- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb4400771c0 msgr2=0x7fb440079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:42.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.192+0000 7fb4577fe640 1 -- 172.21.15.159:0/2158493170 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 7464+0+0 (secure 0 0 0) 0x7fb4580bab80 con 0x7fb46015d950 2024-07-24T16:36:42.195 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.192+0000 7fb45ed9d640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb4400771c0 0x7fb440079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-07-24T16:36:42.198 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.196+0000 7fb4577fe640 1 -- 172.21.15.159:0/2158493170 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fb458082ef0 con 0x7fb46015d950 2024-07-24T16:36:42.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.393+0000 7fb45ed9d640 1 -- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb4400771c0 msgr2=0x7fb440079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:42.396 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.394+0000 7fb45ed9d640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb4400771c0 0x7fb440079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-07-24T16:36:42.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.427+0000 7fb465206640 1 -- 172.21.15.159:0/2158493170 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb46014d4b0 con 0x7fb46015d950 2024-07-24T16:36:42.430 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.427+0000 7fb4577fe640 1 -- 172.21.15.159:0/2158493170 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7fb458087440 con 0x7fb46015d950 2024-07-24T16:36:42.430 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:42.430 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":16,"btime":"2024-07-24T16:25:00:240907+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2383254131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2383254131},{"type":"v1","addr":"172.21.15.159:6835","nonce":2383254131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1682765472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1682765472},{"type":"v1","addr":"172.21.15.193:6836","nonce":1682765472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4840,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/306853489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":306853489},{"type":"v1","addr":"172.21.15.193:6837","nonce":306853489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:57.601499+0000","modified":"2024-07-24T16:24:59.597468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/279171348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":279171348},{"type":"v1","addr":"172.21.15.159:6834","nonce":279171348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":2}]} 2024-07-24T16:36:42.430 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 16 2024-07-24T16:36:42.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.429+0000 7fb465206640 1 -- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb4400771c0 msgr2=0x7fb440079680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:36:42.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.429+0000 7fb465206640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb4400771c0 0x7fb440079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.429+0000 7fb465206640 1 -- 172.21.15.159:0/2158493170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb46015d950 msgr2=0x7fb46015dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:42.432 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.429+0000 7fb465206640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb46015d950 0x7fb46015dff0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb45802af30 tx=0x7fb458031ea0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.429+0000 7fb465206640 1 -- 172.21.15.159:0/2158493170 shutdown_connections 2024-07-24T16:36:42.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.429+0000 7fb465206640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fb4400771c0 0x7fb440079680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.430+0000 7fb465206640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb46015d950 0x7fb46015dff0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.430+0000 7fb465206640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb4600cf770 0x7fb4600ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.430+0000 7fb465206640 1 --2- 172.21.15.159:0/2158493170 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb4600b2ae0 0x7fb46014d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.430+0000 7fb465206640 1 -- 172.21.15.159:0/2158493170 >> 172.21.15.159:0/2158493170 conn(0x7fb46009cd30 msgr2=0x7fb46015c590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:42.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.430+0000 7fb465206640 1 -- 172.21.15.159:0/2158493170 shutdown_connections 2024-07-24T16:36:42.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.430+0000 7fb465206640 1 -- 172.21.15.159:0/2158493170 wait complete. 2024-07-24T16:36:42.443 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:36:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.545+0000 7f95bf6a9640 1 -- 172.21.15.159:0/2449646175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b80cf770 msgr2=0x7f95b80cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.545+0000 7f95bf6a9640 1 --2- 172.21.15.159:0/2449646175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b80cf770 0x7f95b80cfc20 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f95b0005fd0 tx=0x7f95b002a940 comp rx=0 tx=0).stop 2024-07-24T16:36:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.545+0000 7f95bf6a9640 1 -- 172.21.15.159:0/2449646175 shutdown_connections 2024-07-24T16:36:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.545+0000 7f95bf6a9640 1 --2- 172.21.15.159:0/2449646175 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95b80b2ae0 0x7f95b8161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.545+0000 7f95bf6a9640 1 --2- 172.21.15.159:0/2449646175 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b80cf770 0x7f95b80cfc20 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.545+0000 7f95bf6a9640 1 -- 172.21.15.159:0/2449646175 >> 172.21.15.159:0/2449646175 conn(0x7f95b809cd30 msgr2=0x7f95b80d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.545+0000 7f95bf6a9640 1 -- 172.21.15.159:0/2449646175 shutdown_connections 2024-07-24T16:36:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.545+0000 7f95bf6a9640 1 -- 172.21.15.159:0/2449646175 wait complete. 2024-07-24T16:36:42.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.546+0000 7f95bf6a9640 1 Processor -- start 2024-07-24T16:36:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.546+0000 7f95bf6a9640 1 -- start start 2024-07-24T16:36:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bf6a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b80b2ae0 0x7f95b815b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bf6a9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95b80cf770 0x7f95b80ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bf6a9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95b815d950 0x7f95b81600f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bf6a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f95b80d0460 con 0x7f95b80b2ae0 2024-07-24T16:36:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bf6a9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f95b80d02e0 con 0x7f95b80cf770 2024-07-24T16:36:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bf6a9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f95b80d05e0 con 0x7f95b815d950 2024-07-24T16:36:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bd445640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b80b2ae0 0x7f95b815b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bd445640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b80b2ae0 0x7f95b815b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53772/0 (socket says 172.21.15.159:53772) 2024-07-24T16:36:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bd445640 1 -- 172.21.15.159:0/1602519395 learned_addr learned my addr 172.21.15.159:0/1602519395 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bdc46640 1 --2- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95b815d950 0x7f95b81600f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bcc44640 1 --2- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95b80cf770 0x7f95b80ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bd445640 1 -- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95b815d950 msgr2=0x7f95b81600f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bd445640 1 --2- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95b815d950 0x7f95b81600f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bd445640 1 -- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95b80cf770 msgr2=0x7f95b80ca0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bd445640 1 --2- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95b80cf770 0x7f95b80ca0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.547+0000 7f95bd445640 1 -- 172.21.15.159:0/1602519395 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b81f74e0 con 0x7f95b80b2ae0 2024-07-24T16:36:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.548+0000 7f95bd445640 1 --2- 172.21.15.159:0/1602519395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b80b2ae0 0x7f95b815b130 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f95b400c3c0 tx=0x7f95b400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.548+0000 7f95adffb640 1 -- 172.21.15.159:0/1602519395 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4017070 con 0x7f95b80b2ae0 2024-07-24T16:36:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.548+0000 7f95adffb640 1 -- 172.21.15.159:0/1602519395 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95b40035f0 con 0x7f95b80b2ae0 2024-07-24T16:36:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.548+0000 7f95bf6a9640 1 -- 172.21.15.159:0/1602519395 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b81f77c0 con 0x7f95b80b2ae0 2024-07-24T16:36:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.548+0000 7f95adffb640 1 -- 172.21.15.159:0/1602519395 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b4003a80 con 0x7f95b80b2ae0 2024-07-24T16:36:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.548+0000 7f95bf6a9640 1 -- 172.21.15.159:0/1602519395 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b81f7d80 con 0x7f95b80b2ae0 2024-07-24T16:36:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.549+0000 7f95bf6a9640 1 -- 172.21.15.159:0/1602519395 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95b80d0a90 con 0x7f95b80b2ae0 2024-07-24T16:36:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.549+0000 7f95adffb640 1 -- 172.21.15.159:0/1602519395 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 14) ==== 99310+0+0 (secure 0 0 0) 0x7f95b401a070 con 0x7f95b80b2ae0 2024-07-24T16:36:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.550+0000 7f95adffb640 1 --2- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f959c0771f0 0x7f959c0796b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.550+0000 7f95bcc44640 1 -- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f959c0771f0 msgr2=0x7f959c0796b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.550+0000 7f95adffb640 1 -- 172.21.15.159:0/1602519395 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 7464+0+0 (secure 0 0 0) 0x7f95b4098480 con 0x7f95b80b2ae0 2024-07-24T16:36:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.550+0000 7f95bcc44640 1 --2- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f959c0771f0 0x7f959c0796b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-07-24T16:36:42.556 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.554+0000 7f95adffb640 1 -- 172.21.15.159:0/1602519395 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f95b4060810 con 0x7f95b80b2ae0 2024-07-24T16:36:42.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.746+0000 7f95bf6a9640 1 -- 172.21.15.159:0/1602519395 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f95b80b0ab0 con 0x7f95b80b2ae0 2024-07-24T16:36:42.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.747+0000 7f95adffb640 1 -- 172.21.15.159:0/1602519395 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+19058 (secure 0 0 0) 0x7f95b4064d60 con 0x7f95b80b2ae0 2024-07-24T16:36:42.750 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:42.750 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":50,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:36:40.883037+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:55.230299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:56.555270+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.38","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.193:6832/222319347":"2024-07-25T16:25:13.031566+0000","172.21.15.193:0/3580844224":"2024-07-25T16:25:13.031566+0000","172.21.15.193:0/3685404778":"2024-07-25T16:25:13.031566+0000","172.21.15.193:6833/222319347":"2024-07-25T16:25:13.031566+0000","172.21.15.193:0/1332350307":"2024-07-25T16:25:13.031566+0000","172.21.15.193:0/1903087136":"2024-07-25T16:25:13.031566+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":4,"length":1},{"begin":14,"length":1},{"begin":24,"length":1},{"begin":35,"length":1},{"begin":41,"length":2},{"begin":46,"length":1},{"begin":52,"length":1},{"begin":56,"length":1},{"begin":63,"length":1},{"begin":67,"length":1},{"begin":74,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":88,"length":1},{"begin":95,"length":1},{"begin":99,"length":1},{"begin":106,"length":1},{"begin":203,"length":18}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":4,"length":1},{"begin":14,"length":1},{"begin":24,"length":1},{"begin":35,"length":1},{"begin":46,"length":1},{"begin":56,"length":1},{"begin":67,"length":1},{"begin":78,"length":1},{"begin":88,"length":1},{"begin":99,"length":1},{"begin":211,"length":10}]}],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":5,"length":2},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":15,"length":2},{"begin":18,"length":1},{"begin":20,"length":1},{"begin":22,"length":1},{"begin":25,"length":2},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":33,"length":1},{"begin":36,"length":2},{"begin":39,"length":1},{"begin":44,"length":1},{"begin":47,"length":2},{"begin":50,"length":1},{"begin":54,"length":1},{"begin":57,"length":2},{"begin":60,"length":1},{"begin":65,"length":1},{"begin":68,"length":2},{"begin":71,"length":2},{"begin":76,"length":1},{"begin":79,"length":2},{"begin":82,"length":1},{"begin":86,"length":1},{"begin":89,"length":2},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":107,"length":2},{"begin":111,"length":1},{"begin":155,"length":48}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:36:42.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.749+0000 7f95bf6a9640 1 -- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f959c0771f0 msgr2=0x7f959c0796b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:36:42.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.749+0000 7f95bf6a9640 1 --2- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f959c0771f0 0x7f959c0796b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.749+0000 7f95bf6a9640 1 -- 172.21.15.159:0/1602519395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b80b2ae0 msgr2=0x7f95b815b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:42.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.749+0000 7f95bf6a9640 1 --2- 172.21.15.159:0/1602519395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b80b2ae0 0x7f95b815b130 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f95b400c3c0 tx=0x7f95b400c880 comp rx=0 tx=0).stop 2024-07-24T16:36:42.752 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.749+0000 7f95bf6a9640 1 -- 172.21.15.159:0/1602519395 shutdown_connections 2024-07-24T16:36:42.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.749+0000 7f95bf6a9640 1 --2- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f959c0771f0 0x7f959c0796b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.749+0000 7f95bf6a9640 1 --2- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f95b815d950 0x7f95b81600f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.749+0000 7f95bf6a9640 1 --2- 172.21.15.159:0/1602519395 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f95b80cf770 0x7f95b80ca0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.749+0000 7f95bf6a9640 1 --2- 172.21.15.159:0/1602519395 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f95b80b2ae0 0x7f95b815b130 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.749+0000 7f95bf6a9640 1 -- 172.21.15.159:0/1602519395 >> 172.21.15.159:0/1602519395 conn(0x7f95b809cd30 msgr2=0x7f95b80b6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:42.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.749+0000 7f95bf6a9640 1 -- 172.21.15.159:0/1602519395 shutdown_connections 2024-07-24T16:36:42.753 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.749+0000 7f95bf6a9640 1 -- 172.21.15.159:0/1602519395 wait complete. 2024-07-24T16:36:42.763 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-07-24T16:36:42.763 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:36:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.867+0000 7f4961483640 1 -- 172.21.15.159:0/815837488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f495c06d670 msgr2=0x7f495c06dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.867+0000 7f4961483640 1 --2- 172.21.15.159:0/815837488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f495c06d670 0x7f495c06dae0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f495c073aa0 tx=0x7f495402a9a0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.867+0000 7f4961483640 1 -- 172.21.15.159:0/815837488 shutdown_connections 2024-07-24T16:36:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.867+0000 7f4961483640 1 --2- 172.21.15.159:0/815837488 >> v2:172.21.15.193:3300/0 conn(0x7f495c15ad80 0x7f495c0b41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.867+0000 7f4961483640 1 --2- 172.21.15.159:0/815837488 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f495c06d670 0x7f495c06dae0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.867+0000 7f4961483640 1 -- 172.21.15.159:0/815837488 >> 172.21.15.159:0/815837488 conn(0x7f495c06c560 msgr2=0x7f495c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.867+0000 7f4961483640 1 -- 172.21.15.159:0/815837488 shutdown_connections 2024-07-24T16:36:42.870 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.867+0000 7f4961483640 1 -- 172.21.15.159:0/815837488 wait complete. 2024-07-24T16:36:42.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.868+0000 7f4961483640 1 Processor -- start 2024-07-24T16:36:42.871 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.868+0000 7f4961483640 1 -- start start 2024-07-24T16:36:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.869+0000 7f4961483640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f495c06d670 0x7f495c14f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.869+0000 7f4961483640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f495c150cc0 0x7f495c1f58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.869+0000 7f4961483640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f495c15ad80 0x7f495c1f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.869+0000 7f4961483640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f495c0cf840 con 0x7f495c06d670 2024-07-24T16:36:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.869+0000 7f4961483640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f495c0cf6c0 con 0x7f495c150cc0 2024-07-24T16:36:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.869+0000 7f4961483640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f495c0cf9c0 con 0x7f495c15ad80 2024-07-24T16:36:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.869+0000 7f495affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f495c06d670 0x7f495c14f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.869+0000 7f495affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f495c06d670 0x7f495c14f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53776/0 (socket says 172.21.15.159:53776) 2024-07-24T16:36:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.869+0000 7f495affd640 1 -- 172.21.15.159:0/906799023 learned_addr learned my addr 172.21.15.159:0/906799023 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.869+0000 7f495a7fc640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f495c150cc0 0x7f495c1f58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.869+0000 7f495b7fe640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f495c15ad80 0x7f495c1f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.869+0000 7f495affd640 1 -- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f495c15ad80 msgr2=0x7f495c1f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:42.873 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.869+0000 7f495affd640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f495c15ad80 0x7f495c1f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.870+0000 7f495affd640 1 -- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f495c150cc0 msgr2=0x7f495c1f58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.870+0000 7f495affd640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f495c150cc0 0x7f495c1f58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.870+0000 7f495affd640 1 -- 172.21.15.159:0/906799023 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c14b9b0 con 0x7f495c06d670 2024-07-24T16:36:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.870+0000 7f495affd640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f495c06d670 0x7f495c14f020 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f494c00c450 tx=0x7f494c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.870+0000 7f49437fe640 1 -- 172.21.15.159:0/906799023 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c0052d0 con 0x7f495c06d670 2024-07-24T16:36:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.870+0000 7f49437fe640 1 -- 172.21.15.159:0/906799023 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f494c005470 con 0x7f495c06d670 2024-07-24T16:36:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.870+0000 7f4961483640 1 -- 172.21.15.159:0/906799023 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495c14c4e0 con 0x7f495c06d670 2024-07-24T16:36:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.870+0000 7f49437fe640 1 -- 172.21.15.159:0/906799023 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c012870 con 0x7f495c06d670 2024-07-24T16:36:42.874 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.870+0000 7f4961483640 1 -- 172.21.15.159:0/906799023 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495c139bc0 con 0x7f495c06d670 2024-07-24T16:36:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.871+0000 7f4961483640 1 -- 172.21.15.159:0/906799023 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f495c06dae0 con 0x7f495c06d670 2024-07-24T16:36:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.872+0000 7f49437fe640 1 -- 172.21.15.159:0/906799023 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 14) ==== 99310+0+0 (secure 0 0 0) 0x7f494c0035f0 con 0x7f495c06d670 2024-07-24T16:36:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.872+0000 7f49437fe640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f49480771c0 0x7f4948079680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.873+0000 7f495a7fc640 1 -- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f49480771c0 msgr2=0x7f4948079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.873+0000 7f49437fe640 1 -- 172.21.15.159:0/906799023 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 7464+0+0 (secure 0 0 0) 0x7f494c098d00 con 0x7f495c06d670 2024-07-24T16:36:42.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.873+0000 7f495a7fc640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f49480771c0 0x7f4948079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-07-24T16:36:42.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:42.877+0000 7f49437fe640 1 -- 172.21.15.159:0/906799023 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f494c060ff0 con 0x7f495c06d670 2024-07-24T16:36:43.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.074+0000 7f495a7fc640 1 -- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f49480771c0 msgr2=0x7f4948079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:43.077 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.074+0000 7f495a7fc640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f49480771c0 0x7f4948079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-07-24T16:36:43.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.105+0000 7f4961483640 1 -- 172.21.15.159:0/906799023 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f495c15b940 con 0x7f495c06d670 2024-07-24T16:36:43.108 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.106+0000 7f49437fe640 1 -- 172.21.15.159:0/906799023 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f494c065540 con 0x7f495c06d670 2024-07-24T16:36:43.108 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:43.108 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":16,"btime":"2024-07-24T16:25:00:240907+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2383254131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2383254131},{"type":"v1","addr":"172.21.15.159:6835","nonce":2383254131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1682765472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1682765472},{"type":"v1","addr":"172.21.15.193:6836","nonce":1682765472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4840,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/306853489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":306853489},{"type":"v1","addr":"172.21.15.193:6837","nonce":306853489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:57.601499+0000","modified":"2024-07-24T16:24:59.597468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/279171348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":279171348},{"type":"v1","addr":"172.21.15.159:6834","nonce":279171348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":2}]} 2024-07-24T16:36:43.109 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 16 2024-07-24T16:36:43.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.108+0000 7f4961483640 1 -- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f49480771c0 msgr2=0x7f4948079680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:36:43.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.108+0000 7f4961483640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f49480771c0 0x7f4948079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.108+0000 7f4961483640 1 -- 172.21.15.159:0/906799023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f495c06d670 msgr2=0x7f495c14f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:43.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.108+0000 7f4961483640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f495c06d670 0x7f495c14f020 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f494c00c450 tx=0x7f494c00c910 comp rx=0 tx=0).stop 2024-07-24T16:36:43.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.108+0000 7f4961483640 1 -- 172.21.15.159:0/906799023 shutdown_connections 2024-07-24T16:36:43.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.108+0000 7f4961483640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f49480771c0 0x7f4948079680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.108+0000 7f4961483640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f495c15ad80 0x7f495c1f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.108+0000 7f4961483640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f495c150cc0 0x7f495c1f58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.108+0000 7f4961483640 1 --2- 172.21.15.159:0/906799023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f495c06d670 0x7f495c14f020 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.111 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.108+0000 7f4961483640 1 -- 172.21.15.159:0/906799023 >> 172.21.15.159:0/906799023 conn(0x7f495c06c560 msgr2=0x7f495c15c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:43.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.108+0000 7f4961483640 1 -- 172.21.15.159:0/906799023 shutdown_connections 2024-07-24T16:36:43.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.108+0000 7f4961483640 1 -- 172.21.15.159:0/906799023 wait complete. 2024-07-24T16:36:43.122 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:36:43.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.225+0000 7f738409a640 1 -- 172.21.15.159:0/3978667206 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f737c0cf770 msgr2=0x7f737c0cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:43.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.225+0000 7f738409a640 1 --2- 172.21.15.159:0/3978667206 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f737c0cf770 0x7f737c0cfc20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7374005fd0 tx=0x7f737402ab20 comp rx=0 tx=0).stop 2024-07-24T16:36:43.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.225+0000 7f738409a640 1 -- 172.21.15.159:0/3978667206 shutdown_connections 2024-07-24T16:36:43.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.225+0000 7f738409a640 1 --2- 172.21.15.159:0/3978667206 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f737c0cf770 0x7f737c0cfc20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.225+0000 7f738409a640 1 --2- 172.21.15.159:0/3978667206 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f737c15d950 0x7f737c161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.225+0000 7f738409a640 1 -- 172.21.15.159:0/3978667206 >> 172.21.15.159:0/3978667206 conn(0x7f737c09cd30 msgr2=0x7f737c0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:43.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.225+0000 7f738409a640 1 -- 172.21.15.159:0/3978667206 shutdown_connections 2024-07-24T16:36:43.228 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.225+0000 7f738409a640 1 -- 172.21.15.159:0/3978667206 wait complete. 2024-07-24T16:36:43.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.226+0000 7f738409a640 1 Processor -- start 2024-07-24T16:36:43.229 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.227+0000 7f738409a640 1 -- start start 2024-07-24T16:36:43.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.227+0000 7f738409a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f737c0b2ae0 0x7f737c1f4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:43.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.227+0000 7f738409a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f737c0cf770 0x7f737c15fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:43.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.227+0000 7f738409a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f737c15d950 0x7f737c0b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:43.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.227+0000 7f738409a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f737c0d0460 con 0x7f737c15d950 2024-07-24T16:36:43.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.227+0000 7f738409a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f737c0d02e0 con 0x7f737c0b2ae0 2024-07-24T16:36:43.231 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.227+0000 7f738409a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f737c0d05e0 con 0x7f737c0cf770 2024-07-24T16:36:43.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.227+0000 7f7382637640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f737c15d950 0x7f737c0b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:43.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.227+0000 7f7382637640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f737c15d950 0x7f737c0b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53788/0 (socket says 172.21.15.159:53788) 2024-07-24T16:36:43.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.227+0000 7f7382637640 1 -- 172.21.15.159:0/2000392663 learned_addr learned my addr 172.21.15.159:0/2000392663 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:43.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.227+0000 7f7381635640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f737c0cf770 0x7f737c15fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:43.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.227+0000 7f7381e36640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f737c0b2ae0 0x7f737c1f4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:43.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.228+0000 7f7382637640 1 -- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f737c0cf770 msgr2=0x7f737c15fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:43.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.228+0000 7f7382637640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f737c0cf770 0x7f737c15fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.228+0000 7f7382637640 1 -- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f737c0b2ae0 msgr2=0x7f737c1f4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:43.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.228+0000 7f7382637640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f737c0b2ae0 0x7f737c1f4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.228+0000 7f7382637640 1 -- 172.21.15.159:0/2000392663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f737c160260 con 0x7f737c15d950 2024-07-24T16:36:43.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.228+0000 7f7381e36640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f737c0b2ae0 0x7f737c1f4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:36:43.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.228+0000 7f7381635640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f737c0cf770 0x7f737c15fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:36:43.232 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.228+0000 7f7382637640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f737c15d950 0x7f737c0b5150 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7374006010 tx=0x7f7374003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:43.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.228+0000 7f736e7fc640 1 -- 172.21.15.159:0/2000392663 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7374044070 con 0x7f737c15d950 2024-07-24T16:36:43.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.228+0000 7f736e7fc640 1 -- 172.21.15.159:0/2000392663 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7374004040 con 0x7f737c15d950 2024-07-24T16:36:43.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.228+0000 7f738409a640 1 -- 172.21.15.159:0/2000392663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f737c0b59a0 con 0x7f737c15d950 2024-07-24T16:36:43.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.228+0000 7f736e7fc640 1 -- 172.21.15.159:0/2000392663 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7374004430 con 0x7f737c15d950 2024-07-24T16:36:43.233 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.228+0000 7f738409a640 1 -- 172.21.15.159:0/2000392663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f737c0b5f60 con 0x7f737c15d950 2024-07-24T16:36:43.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.229+0000 7f738409a640 1 -- 172.21.15.159:0/2000392663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f737c0d0a00 con 0x7f737c15d950 2024-07-24T16:36:43.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.230+0000 7f736e7fc640 1 -- 172.21.15.159:0/2000392663 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 14) ==== 99310+0+0 (secure 0 0 0) 0x7f73740045d0 con 0x7f737c15d950 2024-07-24T16:36:43.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.230+0000 7f736e7fc640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f73600771c0 0x7f7360079680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:43.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.230+0000 7f7381e36640 1 -- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f73600771c0 msgr2=0x7f7360079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:43.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.230+0000 7f736e7fc640 1 -- 172.21.15.159:0/2000392663 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 7464+0+0 (secure 0 0 0) 0x7f73740b9900 con 0x7f737c15d950 2024-07-24T16:36:43.234 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.230+0000 7f7381e36640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f73600771c0 0x7f7360079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-07-24T16:36:43.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.235+0000 7f736e7fc640 1 -- 172.21.15.159:0/2000392663 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f7374032030 con 0x7f737c15d950 2024-07-24T16:36:43.372 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:36:43.375 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:36:43.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.431+0000 7f7381e36640 1 -- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f73600771c0 msgr2=0x7f7360079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:43.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.431+0000 7f7381e36640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f73600771c0 0x7f7360079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-07-24T16:36:43.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.477+0000 7f738409a640 1 -- 172.21.15.159:0/2000392663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f737c161e00 con 0x7f737c15d950 2024-07-24T16:36:43.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.477+0000 7f736e7fc640 1 -- 172.21.15.159:0/2000392663 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) ==== 94+0+5229 (secure 0 0 0) 0x7f7374081c10 con 0x7f737c15d950 2024-07-24T16:36:43.480 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:43.480 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":16,"btime":"2024-07-24T16:25:00:240907+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2383254131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2383254131},{"type":"v1","addr":"172.21.15.159:6835","nonce":2383254131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1682765472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1682765472},{"type":"v1","addr":"172.21.15.193:6836","nonce":1682765472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4840,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/306853489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":306853489},{"type":"v1","addr":"172.21.15.193:6837","nonce":306853489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:24:57.601499+0000","modified":"2024-07-24T16:24:59.597468+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4998},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4998":{"gid":4998,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.159:6834/279171348","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":279171348},{"type":"v1","addr":"172.21.15.159:6834","nonce":279171348}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4998,"qdb_cluster":[4998]},"id":2}]} 2024-07-24T16:36:43.481 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 16 2024-07-24T16:36:43.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.480+0000 7f738409a640 1 -- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f73600771c0 msgr2=0x7f7360079680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:36:43.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.480+0000 7f738409a640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f73600771c0 0x7f7360079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.480+0000 7f738409a640 1 -- 172.21.15.159:0/2000392663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f737c15d950 msgr2=0x7f737c0b5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:43.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.480+0000 7f738409a640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f737c15d950 0x7f737c0b5150 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f7374006010 tx=0x7f7374003ce0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.480+0000 7f738409a640 1 -- 172.21.15.159:0/2000392663 shutdown_connections 2024-07-24T16:36:43.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.480+0000 7f738409a640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f73600771c0 0x7f7360079680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.480+0000 7f738409a640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f737c15d950 0x7f737c0b5150 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.480+0000 7f738409a640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f737c0cf770 0x7f737c15fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.480+0000 7f738409a640 1 --2- 172.21.15.159:0/2000392663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f737c0b2ae0 0x7f737c1f4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.480+0000 7f738409a640 1 -- 172.21.15.159:0/2000392663 >> 172.21.15.159:0/2000392663 conn(0x7f737c09cd30 msgr2=0x7f737c0d1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:43.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.480+0000 7f738409a640 1 -- 172.21.15.159:0/2000392663 shutdown_connections 2024-07-24T16:36:43.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.480+0000 7f738409a640 1 -- 172.21.15.159:0/2000392663 wait complete. 2024-07-24T16:36:43.494 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:36:43.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.637+0000 7f044e1a6640 1 -- 172.21.15.159:0/2855208354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04480cf770 msgr2=0x7f04480cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:43.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.637+0000 7f044e1a6640 1 --2- 172.21.15.159:0/2855208354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04480cf770 0x7f04480cfc20 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f0440005fd0 tx=0x7f044002ab20 comp rx=0 tx=0).stop 2024-07-24T16:36:43.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.637+0000 7f044e1a6640 1 -- 172.21.15.159:0/2855208354 shutdown_connections 2024-07-24T16:36:43.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.637+0000 7f044e1a6640 1 --2- 172.21.15.159:0/2855208354 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04480b2ae0 0x7f0448161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.637+0000 7f044e1a6640 1 --2- 172.21.15.159:0/2855208354 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f04480cf770 0x7f04480cfc20 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.637+0000 7f044e1a6640 1 -- 172.21.15.159:0/2855208354 >> 172.21.15.159:0/2855208354 conn(0x7f044809cd30 msgr2=0x7f04480d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:43.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.637+0000 7f044e1a6640 1 -- 172.21.15.159:0/2855208354 shutdown_connections 2024-07-24T16:36:43.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.637+0000 7f044e1a6640 1 -- 172.21.15.159:0/2855208354 wait complete. 2024-07-24T16:36:43.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.638+0000 7f044e1a6640 1 Processor -- start 2024-07-24T16:36:43.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.638+0000 7f044e1a6640 1 -- start start 2024-07-24T16:36:43.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f044e1a6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04480b2ae0 0x7f04480cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:43.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f044e1a6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04480cf770 0x7f044815be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:43.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f044e1a6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044815d950 0x7f04480b0f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:43.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f044e1a6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f04480d0460 con 0x7f044815d950 2024-07-24T16:36:43.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f044e1a6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f04480d02e0 con 0x7f04480cf770 2024-07-24T16:36:43.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f044e1a6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f04480d05e0 con 0x7f04480b2ae0 2024-07-24T16:36:43.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f0447fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044815d950 0x7f04480b0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:43.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f0447fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044815d950 0x7f04480b0f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53804/0 (socket says 172.21.15.159:53804) 2024-07-24T16:36:43.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f0447fff640 1 -- 172.21.15.159:0/2032511560 learned_addr learned my addr 172.21.15.159:0/2032511560 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:43.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f04477fe640 1 --2- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04480b2ae0 0x7f04480cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:43.643 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f043ffff640 1 --2- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04480cf770 0x7f044815be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:43.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f0447fff640 1 -- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04480b2ae0 msgr2=0x7f04480cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:43.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f0447fff640 1 --2- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04480b2ae0 0x7f04480cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f0447fff640 1 -- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04480cf770 msgr2=0x7f044815be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:43.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f0447fff640 1 --2- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04480cf770 0x7f044815be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f0447fff640 1 -- 172.21.15.159:0/2032511560 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f044815c920 con 0x7f044815d950 2024-07-24T16:36:43.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.639+0000 7f0447fff640 1 --2- 172.21.15.159:0/2032511560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044815d950 0x7f04480b0f50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0440006010 tx=0x7f0440003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:43.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.640+0000 7f0444ff9640 1 -- 172.21.15.159:0/2032511560 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440044070 con 0x7f044815d950 2024-07-24T16:36:43.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.640+0000 7f0444ff9640 1 -- 172.21.15.159:0/2032511560 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0440004040 con 0x7f044815d950 2024-07-24T16:36:43.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.640+0000 7f044e1a6640 1 -- 172.21.15.159:0/2032511560 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04480cd750 con 0x7f044815d950 2024-07-24T16:36:43.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.640+0000 7f0444ff9640 1 -- 172.21.15.159:0/2032511560 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0440004430 con 0x7f044815d950 2024-07-24T16:36:43.644 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.640+0000 7f044e1a6640 1 -- 172.21.15.159:0/2032511560 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04480cb220 con 0x7f044815d950 2024-07-24T16:36:43.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.641+0000 7f044e1a6640 1 -- 172.21.15.159:0/2032511560 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04480d0a00 con 0x7f044815d950 2024-07-24T16:36:43.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.641+0000 7f0444ff9640 1 -- 172.21.15.159:0/2032511560 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 14) ==== 99310+0+0 (secure 0 0 0) 0x7f04400045d0 con 0x7f044815d950 2024-07-24T16:36:43.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.642+0000 7f0444ff9640 1 --2- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f04280771c0 0x7f0428079680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:43.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.642+0000 7f04477fe640 1 -- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f04280771c0 msgr2=0x7f0428079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:43.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.642+0000 7f0444ff9640 1 -- 172.21.15.159:0/2032511560 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 7464+0+0 (secure 0 0 0) 0x7f04400b9920 con 0x7f044815d950 2024-07-24T16:36:43.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.642+0000 7f04477fe640 1 --2- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f04280771c0 0x7f0428079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-07-24T16:36:43.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.646+0000 7f0444ff9640 1 -- 172.21.15.159:0/2032511560 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f0440032030 con 0x7f044815d950 2024-07-24T16:36:43.840 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.838+0000 7f044e1a6640 1 -- 172.21.15.159:0/2032511560 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f044815c3c0 con 0x7f044815d950 2024-07-24T16:36:43.841 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.839+0000 7f0444ff9640 1 -- 172.21.15.159:0/2032511560 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+19058 (secure 0 0 0) 0x7f0440081c30 con 0x7f044815d950 2024-07-24T16:36:43.842 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:43.842 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":50,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:36:40.883037+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:24:55.230299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-07-24T16:24:56.555270+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":220,"snap_epoch":50,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.38","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.193:6832/222319347":"2024-07-25T16:25:13.031566+0000","172.21.15.193:0/3580844224":"2024-07-25T16:25:13.031566+0000","172.21.15.193:0/3685404778":"2024-07-25T16:25:13.031566+0000","172.21.15.193:6833/222319347":"2024-07-25T16:25:13.031566+0000","172.21.15.193:0/1332350307":"2024-07-25T16:25:13.031566+0000","172.21.15.193:0/1903087136":"2024-07-25T16:25:13.031566+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":4,"length":1},{"begin":14,"length":1},{"begin":24,"length":1},{"begin":35,"length":1},{"begin":41,"length":2},{"begin":46,"length":1},{"begin":52,"length":1},{"begin":56,"length":1},{"begin":63,"length":1},{"begin":67,"length":1},{"begin":74,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":88,"length":1},{"begin":95,"length":1},{"begin":99,"length":1},{"begin":106,"length":1},{"begin":203,"length":18}]}],"new_removed_snaps":[{"pool":6,"snaps":[{"begin":4,"length":1},{"begin":14,"length":1},{"begin":24,"length":1},{"begin":35,"length":1},{"begin":46,"length":1},{"begin":56,"length":1},{"begin":67,"length":1},{"begin":78,"length":1},{"begin":88,"length":1},{"begin":99,"length":1},{"begin":211,"length":10}]}],"new_purged_snaps":[{"pool":6,"snaps":[{"begin":2,"length":1},{"begin":5,"length":2},{"begin":8,"length":1},{"begin":10,"length":1},{"begin":12,"length":1},{"begin":15,"length":2},{"begin":18,"length":1},{"begin":20,"length":1},{"begin":22,"length":1},{"begin":25,"length":2},{"begin":28,"length":1},{"begin":30,"length":1},{"begin":33,"length":1},{"begin":36,"length":2},{"begin":39,"length":1},{"begin":44,"length":1},{"begin":47,"length":2},{"begin":50,"length":1},{"begin":54,"length":1},{"begin":57,"length":2},{"begin":60,"length":1},{"begin":65,"length":1},{"begin":68,"length":2},{"begin":71,"length":2},{"begin":76,"length":1},{"begin":79,"length":2},{"begin":82,"length":1},{"begin":86,"length":1},{"begin":89,"length":2},{"begin":93,"length":1},{"begin":97,"length":1},{"begin":100,"length":3},{"begin":104,"length":1},{"begin":107,"length":2},{"begin":111,"length":1},{"begin":155,"length":48}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:36:43.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.841+0000 7f044e1a6640 1 -- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f04280771c0 msgr2=0x7f0428079680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:36:43.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.841+0000 7f044e1a6640 1 --2- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f04280771c0 0x7f0428079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.841+0000 7f044e1a6640 1 -- 172.21.15.159:0/2032511560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044815d950 msgr2=0x7f04480b0f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:43.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.841+0000 7f044e1a6640 1 --2- 172.21.15.159:0/2032511560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044815d950 0x7f04480b0f50 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f0440006010 tx=0x7f0440003ce0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.841+0000 7f044e1a6640 1 -- 172.21.15.159:0/2032511560 shutdown_connections 2024-07-24T16:36:43.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.841+0000 7f044e1a6640 1 --2- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f04280771c0 0x7f0428079680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.841+0000 7f044e1a6640 1 --2- 172.21.15.159:0/2032511560 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f044815d950 0x7f04480b0f50 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.841+0000 7f044e1a6640 1 --2- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f04480cf770 0x7f044815be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.841+0000 7f044e1a6640 1 --2- 172.21.15.159:0/2032511560 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f04480b2ae0 0x7f04480cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.841+0000 7f044e1a6640 1 -- 172.21.15.159:0/2032511560 >> 172.21.15.159:0/2032511560 conn(0x7f044809cd30 msgr2=0x7f0448161bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:43.844 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.841+0000 7f044e1a6640 1 -- 172.21.15.159:0/2032511560 shutdown_connections 2024-07-24T16:36:43.845 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.841+0000 7f044e1a6640 1 -- 172.21.15.159:0/2032511560 wait complete. 2024-07-24T16:36:43.855 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-07-24T16:36:43.961 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.958+0000 7f3255159640 1 -- 172.21.15.159:0/3599616343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32500d0fc0 msgr2=0x7f3250071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:43.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.958+0000 7f3255159640 1 --2- 172.21.15.159:0/3599616343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32500d0fc0 0x7f3250071ca0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f32500d2670 tx=0x7f324402a4d0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.959+0000 7f3255159640 1 -- 172.21.15.159:0/3599616343 shutdown_connections 2024-07-24T16:36:43.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.959+0000 7f3255159640 1 --2- 172.21.15.159:0/3599616343 >> v2:172.21.15.159:3300/0 conn(0x7f32500721e0 0x7f3250073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.959+0000 7f3255159640 1 --2- 172.21.15.159:0/3599616343 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32500d0fc0 0x7f3250071ca0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.959+0000 7f3255159640 1 --2- 172.21.15.159:0/3599616343 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32500b66e0 0x7f325015bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.959+0000 7f3255159640 1 -- 172.21.15.159:0/3599616343 >> 172.21.15.159:0/3599616343 conn(0x7f32500b33c0 msgr2=0x7f32500b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:43.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.959+0000 7f3255159640 1 -- 172.21.15.159:0/3599616343 shutdown_connections 2024-07-24T16:36:43.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.959+0000 7f3255159640 1 -- 172.21.15.159:0/3599616343 wait complete. 2024-07-24T16:36:43.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.960+0000 7f3255159640 1 Processor -- start 2024-07-24T16:36:43.963 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.960+0000 7f3255159640 1 -- start start 2024-07-24T16:36:43.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f3255159640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32500721e0 0x7f32501511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:43.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f3255159640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500b66e0 0x7f3250156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:43.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f3255159640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32500d0fc0 0x7f3250156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:43.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f3255159640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3250074260 con 0x7f32500b66e0 2024-07-24T16:36:43.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f3255159640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f32500740e0 con 0x7f32500721e0 2024-07-24T16:36:43.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f3255159640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f32500743e0 con 0x7f32500d0fc0 2024-07-24T16:36:43.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f324e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500b66e0 0x7f3250156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:43.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f324ed9d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32500721e0 0x7f32501511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:43.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f324e59c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500b66e0 0x7f3250156110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53826/0 (socket says 172.21.15.159:53826) 2024-07-24T16:36:43.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f324e59c640 1 -- 172.21.15.159:0/2260329046 learned_addr learned my addr 172.21.15.159:0/2260329046 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:43.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f324f59e640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32500d0fc0 0x7f3250156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:43.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f324e59c640 1 -- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32500d0fc0 msgr2=0x7f3250156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:43.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f324e59c640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32500d0fc0 0x7f3250156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f324e59c640 1 -- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32500721e0 msgr2=0x7f32501511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:43.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f324e59c640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32500721e0 0x7f32501511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:43.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f324e59c640 1 -- 172.21.15.159:0/2260329046 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3250151700 con 0x7f32500b66e0 2024-07-24T16:36:43.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.961+0000 7f324ed9d640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32500721e0 0x7f32501511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:36:43.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.962+0000 7f324e59c640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500b66e0 0x7f3250156110 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3244000c00 tx=0x7f32440038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:43.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.962+0000 7f32377fe640 1 -- 172.21.15.159:0/2260329046 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324403e030 con 0x7f32500b66e0 2024-07-24T16:36:43.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.962+0000 7f3255159640 1 -- 172.21.15.159:0/2260329046 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3250154940 con 0x7f32500b66e0 2024-07-24T16:36:43.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.962+0000 7f32377fe640 1 -- 172.21.15.159:0/2260329046 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3244003ca0 con 0x7f32500b66e0 2024-07-24T16:36:43.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.962+0000 7f32377fe640 1 -- 172.21.15.159:0/2260329046 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244035040 con 0x7f32500b66e0 2024-07-24T16:36:43.966 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.962+0000 7f3255159640 1 -- 172.21.15.159:0/2260329046 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3250154f00 con 0x7f32500b66e0 2024-07-24T16:36:43.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.963+0000 7f3255159640 1 -- 172.21.15.159:0/2260329046 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f325015bae0 con 0x7f32500b66e0 2024-07-24T16:36:43.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.964+0000 7f32377fe640 1 -- 172.21.15.159:0/2260329046 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 14) ==== 99310+0+0 (secure 0 0 0) 0x7f3244041030 con 0x7f32500b66e0 2024-07-24T16:36:43.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.964+0000 7f32377fe640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f323c0771c0 0x7f323c079680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:43.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.964+0000 7f32377fe640 1 -- 172.21.15.159:0/2260329046 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 7464+0+0 (secure 0 0 0) 0x7f32440b9af0 con 0x7f32500b66e0 2024-07-24T16:36:43.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.964+0000 7f324ed9d640 1 -- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f323c0771c0 msgr2=0x7f323c079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:43.967 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.964+0000 7f324ed9d640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f323c0771c0 0x7f323c079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-07-24T16:36:43.970 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:43.968+0000 7f32377fe640 1 -- 172.21.15.159:0/2260329046 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f3244081c40 con 0x7f32500b66e0 2024-07-24T16:36:44.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.166+0000 7f324ed9d640 1 -- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f323c0771c0 msgr2=0x7f323c079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:44.168 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.166+0000 7f324ed9d640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f323c0771c0 0x7f323c079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-07-24T16:36:44.199 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.197+0000 7f3255159640 1 -- 172.21.15.159:0/2260329046 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f32500b5920 con 0x7f32500b66e0 2024-07-24T16:36:44.200 INFO:tasks.ceph.mon.a.smithi159.stderr:2024-07-24T16:36:44.197+0000 7f7a58ad5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-07-24T16:36:44.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.201+0000 7f32377fe640 1 -- 172.21.15.159:0/2260329046 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v17) ==== 161+0+0 (secure 0 0 0) 0x7f3244086190 con 0x7f32500b66e0 2024-07-24T16:36:44.203 INFO:teuthology.orchestra.run.smithi159.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-07-24T16:36:44.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.204+0000 7f3255159640 1 -- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f323c0771c0 msgr2=0x7f323c079680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:36:44.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.204+0000 7f3255159640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f323c0771c0 0x7f323c079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:44.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.204+0000 7f3255159640 1 -- 172.21.15.159:0/2260329046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500b66e0 msgr2=0x7f3250156110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:44.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.204+0000 7f3255159640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500b66e0 0x7f3250156110 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f3244000c00 tx=0x7f32440038a0 comp rx=0 tx=0).stop 2024-07-24T16:36:44.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.204+0000 7f3255159640 1 -- 172.21.15.159:0/2260329046 shutdown_connections 2024-07-24T16:36:44.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.204+0000 7f3255159640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7f323c0771c0 0x7f323c079680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:44.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.204+0000 7f3255159640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f32500d0fc0 0x7f3250156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:44.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.204+0000 7f3255159640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f32500b66e0 0x7f3250156110 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:44.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.204+0000 7f3255159640 1 --2- 172.21.15.159:0/2260329046 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f32500721e0 0x7f32501511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:44.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.204+0000 7f3255159640 1 -- 172.21.15.159:0/2260329046 >> 172.21.15.159:0/2260329046 conn(0x7f32500b33c0 msgr2=0x7f32500cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:44.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.204+0000 7f3255159640 1 -- 172.21.15.159:0/2260329046 shutdown_connections 2024-07-24T16:36:44.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.204+0000 7f3255159640 1 -- 172.21.15.159:0/2260329046 wait complete. 2024-07-24T16:36:44.219 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-07-24T16:36:44.242 INFO:tasks.ceph.mds.a.smithi159.stdout:starting mds.a at 2024-07-24T16:36:44.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.324+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/38572558 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf8815b490 msgr2=0x7fcf8815f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:44.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.324+0000 7fcf8d7e8640 1 --2- 172.21.15.159:0/38572558 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf8815b490 0x7fcf8815f0f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fcf881601f0 tx=0x7fcf7802a480 comp rx=0 tx=0).stop 2024-07-24T16:36:44.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.324+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/38572558 shutdown_connections 2024-07-24T16:36:44.327 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.324+0000 7fcf8d7e8640 1 --2- 172.21.15.159:0/38572558 >> v2:172.21.15.193:3300/0 conn(0x7fcf880b62b0 0x7fcf880afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:44.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.324+0000 7fcf8d7e8640 1 --2- 172.21.15.159:0/38572558 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf8815b490 0x7fcf8815f0f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:44.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.324+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/38572558 >> 172.21.15.159:0/38572558 conn(0x7fcf88072a80 msgr2=0x7fcf88072e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:44.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.324+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/38572558 shutdown_connections 2024-07-24T16:36:44.328 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.324+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/38572558 wait complete. 2024-07-24T16:36:44.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.325+0000 7fcf8d7e8640 1 Processor -- start 2024-07-24T16:36:44.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.326+0000 7fcf8d7e8640 1 -- start start 2024-07-24T16:36:44.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.326+0000 7fcf8d7e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf88070fc0 0x7fcf8814a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:44.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.326+0000 7fcf8d7e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf880b62b0 0x7fcf8815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:44.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.326+0000 7fcf8d7e8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf8815b490 0x7fcf88149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:44.330 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.326+0000 7fcf8d7e8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8806c980 con 0x7fcf880b62b0 2024-07-24T16:36:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.326+0000 7fcf8d7e8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8806c800 con 0x7fcf88070fc0 2024-07-24T16:36:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.326+0000 7fcf8d7e8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcf8806cb00 con 0x7fcf8815b490 2024-07-24T16:36:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.326+0000 7fcf7ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf880b62b0 0x7fcf8815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.326+0000 7fcf7ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf880b62b0 0x7fcf8815dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53858/0 (socket says 172.21.15.159:53858) 2024-07-24T16:36:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.326+0000 7fcf7ffff640 1 -- 172.21.15.159:0/1153203220 learned_addr learned my addr 172.21.15.159:0/1153203220 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.326+0000 7fcf877fe640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf8815b490 0x7fcf88149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.326+0000 7fcf86ffd640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf88070fc0 0x7fcf8814a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.327+0000 7fcf7ffff640 1 -- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf8815b490 msgr2=0x7fcf88149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.327+0000 7fcf7ffff640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf8815b490 0x7fcf88149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.327+0000 7fcf7ffff640 1 -- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf88070fc0 msgr2=0x7fcf8814a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.327+0000 7fcf7ffff640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf88070fc0 0x7fcf8814a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:44.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.327+0000 7fcf7ffff640 1 -- 172.21.15.159:0/1153203220 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf8815e510 con 0x7fcf880b62b0 2024-07-24T16:36:44.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.327+0000 7fcf7ffff640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf880b62b0 0x7fcf8815dfd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcf7000c460 tx=0x7fcf7000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:44.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.327+0000 7fcf7f7fe640 1 -- 172.21.15.159:0/1153203220 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70011790 con 0x7fcf880b62b0 2024-07-24T16:36:44.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.327+0000 7fcf7f7fe640 1 -- 172.21.15.159:0/1153203220 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcf70017070 con 0x7fcf880b62b0 2024-07-24T16:36:44.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.327+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/1153203220 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8815cf30 con 0x7fcf880b62b0 2024-07-24T16:36:44.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.327+0000 7fcf7f7fe640 1 -- 172.21.15.159:0/1153203220 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf70011ca0 con 0x7fcf880b62b0 2024-07-24T16:36:44.332 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.327+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/1153203220 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf8815d4f0 con 0x7fcf880b62b0 2024-07-24T16:36:44.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.328+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/1153203220 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf880afc70 con 0x7fcf880b62b0 2024-07-24T16:36:44.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.329+0000 7fcf7f7fe640 1 -- 172.21.15.159:0/1153203220 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 14) ==== 99310+0+0 (secure 0 0 0) 0x7fcf7001c460 con 0x7fcf880b62b0 2024-07-24T16:36:44.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.329+0000 7fcf7f7fe640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcf680771c0 0x7fcf68079680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:44.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.329+0000 7fcf86ffd640 1 -- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcf680771c0 msgr2=0x7fcf68079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:44.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.329+0000 7fcf7f7fe640 1 -- 172.21.15.159:0/1153203220 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 6774+0+0 (secure 0 0 0) 0x7fcf70098d80 con 0x7fcf880b62b0 2024-07-24T16:36:44.333 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.329+0000 7fcf86ffd640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcf680771c0 0x7fcf68079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-07-24T16:36:44.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.337+0000 7fcf7f7fe640 1 -- 172.21.15.159:0/1153203220 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fcf70061350 con 0x7fcf880b62b0 2024-07-24T16:36:44.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.531+0000 7fcf86ffd640 1 -- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcf680771c0 msgr2=0x7fcf68079680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.193:6832/2609611338 2024-07-24T16:36:44.533 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.531+0000 7fcf86ffd640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcf680771c0 0x7fcf68079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-07-24T16:36:44.534 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.532+0000 7fcf7f7fe640 1 -- 172.21.15.159:0/1153203220 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 15) ==== 98850+0+0 (secure 0 0 0) 0x7fcf7005d5e0 con 0x7fcf880b62b0 2024-07-24T16:36:44.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.533+0000 7fcf7f7fe640 1 -- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcf680771c0 msgr2=0x7fcf68079680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-07-24T16:36:44.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.533+0000 7fcf7f7fe640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcf680771c0 0x7fcf68079680 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:44.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:44.571+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/1153203220 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fcf8815cbc0 con 0x7fcf880b62b0 2024-07-24T16:36:44.583 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:36:44.580+0000 7fa51d076640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:36:44.583 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:36:44.580+0000 7fa51d076640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:36:44.583 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:36:44.580+0000 7fa51d076640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:36:44.583 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:36:44.580+0000 7fa51d076640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:36:44.583 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:36:44.580+0000 7fa51d076640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:36:44.583 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:36:44.580+0000 7fa51a070640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:36:44.583 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:36:44.580+0000 7fa51a070640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:36:44.583 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:36:44.580+0000 7fa51a070640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:36:44.583 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:36:44.580+0000 7fa51a070640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:36:44.583 INFO:tasks.ceph.mgr.x.smithi193.stderr:2024-07-24T16:36:44.580+0000 7fa51a070640 -1 client.0 error registering admin socket command: (17) File exists 2024-07-24T16:36:45.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.204+0000 7fcf7f7fe640 1 -- 172.21.15.159:0/1153203220 <== mon.0 v2:172.21.15.159:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v18) ==== 104+0+0 (secure 0 0 0) 0x7fcf70088c80 con 0x7fcf880b62b0 2024-07-24T16:36:45.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.207+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/1153203220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf880b62b0 msgr2=0x7fcf8815dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:45.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.207+0000 7fcf8d7e8640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf880b62b0 0x7fcf8815dfd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcf7000c460 tx=0x7fcf7000c920 comp rx=0 tx=0).stop 2024-07-24T16:36:45.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.207+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/1153203220 shutdown_connections 2024-07-24T16:36:45.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.207+0000 7fcf8d7e8640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:6832/2609611338,v1:172.21.15.193:6833/2609611338] conn(0x7fcf680771c0 0x7fcf68079680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:45.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.207+0000 7fcf8d7e8640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcf8815b490 0x7fcf88149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:45.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.207+0000 7fcf8d7e8640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcf880b62b0 0x7fcf8815dfd0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:45.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.207+0000 7fcf8d7e8640 1 --2- 172.21.15.159:0/1153203220 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcf88070fc0 0x7fcf8814a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:45.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.207+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/1153203220 >> 172.21.15.159:0/1153203220 conn(0x7fcf88072a80 msgr2=0x7fcf88152cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:45.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.207+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/1153203220 shutdown_connections 2024-07-24T16:36:45.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.207+0000 7fcf8d7e8640 1 -- 172.21.15.159:0/1153203220 wait complete. 2024-07-24T16:36:45.224 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-07-24T16:36:45.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.378+0000 7fb2702a3640 1 -- 172.21.15.159:0/1399148840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26806d8a0 msgr2=0x7fb26808b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:45.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.378+0000 7fb2702a3640 1 --2- 172.21.15.159:0/1399148840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26806d8a0 0x7fb26808b3c0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fb2680cf3b0 tx=0x7fb25802b4b0 comp rx=0 tx=0).stop 2024-07-24T16:36:45.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.379+0000 7fb2702a3640 1 -- 172.21.15.159:0/1399148840 shutdown_connections 2024-07-24T16:36:45.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.379+0000 7fb2702a3640 1 --2- 172.21.15.159:0/1399148840 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb2680cc320 0x7fb2680cc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:45.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.379+0000 7fb2702a3640 1 --2- 172.21.15.159:0/1399148840 >> v2:172.21.15.193:3300/0 conn(0x7fb2680aed50 0x7fb26806dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:45.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.379+0000 7fb2702a3640 1 --2- 172.21.15.159:0/1399148840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb26806d8a0 0x7fb26808b3c0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:45.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.379+0000 7fb2702a3640 1 -- 172.21.15.159:0/1399148840 >> 172.21.15.159:0/1399148840 conn(0x7fb26806c9b0 msgr2=0x7fb26806cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:45.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.379+0000 7fb2702a3640 1 -- 172.21.15.159:0/1399148840 shutdown_connections 2024-07-24T16:36:45.382 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.379+0000 7fb2702a3640 1 -- 172.21.15.159:0/1399148840 wait complete. 2024-07-24T16:36:45.384 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.380+0000 7fb2702a3640 1 Processor -- start 2024-07-24T16:36:45.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.380+0000 7fb2702a3640 1 -- start start 2024-07-24T16:36:45.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.380+0000 7fb2702a3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb26806d8a0 0x7fb2680ce980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:45.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.380+0000 7fb2702a3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2680aed50 0x7fb2680ceec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:45.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.380+0000 7fb2702a3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2680cc320 0x7fb26816cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:45.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.380+0000 7fb2702a3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb26808bc40 con 0x7fb2680aed50 2024-07-24T16:36:45.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.380+0000 7fb2702a3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb26806e960 con 0x7fb2680cc320 2024-07-24T16:36:45.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.380+0000 7fb2702a3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb268072f30 con 0x7fb26806d8a0 2024-07-24T16:36:45.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb26d83e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2680aed50 0x7fb2680ceec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:45.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb26d83e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2680aed50 0x7fb2680ceec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53880/0 (socket says 172.21.15.159:53880) 2024-07-24T16:36:45.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb26d83e640 1 -- 172.21.15.159:0/1006165848 learned_addr learned my addr 172.21.15.159:0/1006165848 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:45.385 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb26e03f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb26806d8a0 0x7fb2680ce980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:45.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb26e840640 1 --2- 172.21.15.159:0/1006165848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2680cc320 0x7fb26816cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:45.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb26d83e640 1 -- 172.21.15.159:0/1006165848 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb26806d8a0 msgr2=0x7fb2680ce980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:45.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb26d83e640 1 --2- 172.21.15.159:0/1006165848 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb26806d8a0 0x7fb2680ce980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:45.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb26d83e640 1 -- 172.21.15.159:0/1006165848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2680cc320 msgr2=0x7fb26816cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:45.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb26d83e640 1 --2- 172.21.15.159:0/1006165848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2680cc320 0x7fb26816cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:45.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb26d83e640 1 -- 172.21.15.159:0/1006165848 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26815b7e0 con 0x7fb2680aed50 2024-07-24T16:36:45.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb26d83e640 1 --2- 172.21.15.159:0/1006165848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2680aed50 0x7fb2680ceec0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00c920 tx=0x7fb25c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:45.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb266ffd640 1 -- 172.21.15.159:0/1006165848 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c007c70 con 0x7fb2680aed50 2024-07-24T16:36:45.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb266ffd640 1 -- 172.21.15.159:0/1006165848 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb25c00f450 con 0x7fb2680aed50 2024-07-24T16:36:45.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb266ffd640 1 -- 172.21.15.159:0/1006165848 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb25c00f8a0 con 0x7fb2680aed50 2024-07-24T16:36:45.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb2702a3640 1 -- 172.21.15.159:0/1006165848 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb268205050 con 0x7fb2680aed50 2024-07-24T16:36:45.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.381+0000 7fb2702a3640 1 -- 172.21.15.159:0/1006165848 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb268204d10 con 0x7fb2680aed50 2024-07-24T16:36:45.386 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.382+0000 7fb2702a3640 1 -- 172.21.15.159:0/1006165848 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb26806dc80 con 0x7fb2680aed50 2024-07-24T16:36:45.387 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.383+0000 7fb266ffd640 1 -- 172.21.15.159:0/1006165848 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 15) ==== 98850+0+0 (secure 0 0 0) 0x7fb25c00fa40 con 0x7fb2680aed50 2024-07-24T16:36:45.388 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.384+0000 7fb266ffd640 1 -- 172.21.15.159:0/1006165848 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(52..52 src has 1..52) ==== 7161+0+0 (secure 0 0 0) 0x7fb25c098f70 con 0x7fb2680aed50 2024-07-24T16:36:45.390 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.388+0000 7fb266ffd640 1 -- 172.21.15.159:0/1006165848 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fb25c014030 con 0x7fb2680aed50 2024-07-24T16:36:45.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.535+0000 7fb266ffd640 1 -- 172.21.15.159:0/1006165848 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 16) ==== 98977+0+0 (secure 0 0 0) 0x7fb25c05d3c0 con 0x7fb2680aed50 2024-07-24T16:36:45.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.535+0000 7fb266ffd640 1 --2- 172.21.15.159:0/1006165848 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb25407d240 0x7fb25407f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:45.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.535+0000 7fb26e03f640 1 --2- 172.21.15.159:0/1006165848 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb25407d240 0x7fb25407f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:45.546 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.543+0000 7fb26e03f640 1 --2- 172.21.15.159:0/1006165848 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb25407d240 0x7fb25407f630 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb258034000 tx=0x7fb258004ab0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:45.579 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:45.577+0000 7fb2702a3640 1 -- 172.21.15.159:0/1006165848 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb268169a40 con 0x7fb2680aed50 2024-07-24T16:36:46.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.536+0000 7fb266ffd640 1 -- 172.21.15.159:0/1006165848 <== mon.0 v2:172.21.15.159:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) ==== 181+0+0 (secure 0 0 0) 0x7fb25c018400 con 0x7fb2680aed50 2024-07-24T16:36:46.539 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_metadata' removed 2024-07-24T16:36:46.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.540+0000 7fb2702a3640 1 -- 172.21.15.159:0/1006165848 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb25407d240 msgr2=0x7fb25407f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:46.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.540+0000 7fb2702a3640 1 --2- 172.21.15.159:0/1006165848 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb25407d240 0x7fb25407f630 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb258034000 tx=0x7fb258004ab0 comp rx=0 tx=0).stop 2024-07-24T16:36:46.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.540+0000 7fb2702a3640 1 -- 172.21.15.159:0/1006165848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2680aed50 msgr2=0x7fb2680ceec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:46.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.540+0000 7fb2702a3640 1 --2- 172.21.15.159:0/1006165848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2680aed50 0x7fb2680ceec0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb25c00c920 tx=0x7fb25c00cde0 comp rx=0 tx=0).stop 2024-07-24T16:36:46.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.540+0000 7fb2702a3640 1 -- 172.21.15.159:0/1006165848 shutdown_connections 2024-07-24T16:36:46.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.540+0000 7fb2702a3640 1 --2- 172.21.15.159:0/1006165848 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb2680cc320 0x7fb26816cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:46.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.540+0000 7fb2702a3640 1 --2- 172.21.15.159:0/1006165848 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb25407d240 0x7fb25407f630 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:46.543 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.540+0000 7fb2702a3640 1 --2- 172.21.15.159:0/1006165848 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb2680aed50 0x7fb2680ceec0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:46.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.540+0000 7fb2702a3640 1 --2- 172.21.15.159:0/1006165848 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb26806d8a0 0x7fb2680ce980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:46.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.540+0000 7fb2702a3640 1 -- 172.21.15.159:0/1006165848 >> 172.21.15.159:0/1006165848 conn(0x7fb26806c9b0 msgr2=0x7fb2680cd5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:46.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.540+0000 7fb2702a3640 1 -- 172.21.15.159:0/1006165848 shutdown_connections 2024-07-24T16:36:46.544 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.540+0000 7fb2702a3640 1 -- 172.21.15.159:0/1006165848 wait complete. 2024-07-24T16:36:46.557 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-07-24T16:36:46.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.668+0000 7fa6630e9640 1 -- 172.21.15.159:0/144544627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c073a50 msgr2=0x7fa65c06f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:46.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.668+0000 7fa6630e9640 1 --2- 172.21.15.159:0/144544627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c073a50 0x7fa65c06f240 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0af2c0 tx=0x7fa64c02a980 comp rx=0 tx=0).stop 2024-07-24T16:36:46.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.668+0000 7fa6630e9640 1 -- 172.21.15.159:0/144544627 shutdown_connections 2024-07-24T16:36:46.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.668+0000 7fa6630e9640 1 --2- 172.21.15.159:0/144544627 >> v2:172.21.15.193:3300/0 conn(0x7fa65c06f780 0x7fa65c15df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:46.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.668+0000 7fa6630e9640 1 --2- 172.21.15.159:0/144544627 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c073a50 0x7fa65c06f240 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:46.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.668+0000 7fa6630e9640 1 --2- 172.21.15.159:0/144544627 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa65c1549d0 0x7fa65c15b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:46.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.668+0000 7fa6630e9640 1 -- 172.21.15.159:0/144544627 >> 172.21.15.159:0/144544627 conn(0x7fa65c06c560 msgr2=0x7fa65c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:46.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.668+0000 7fa6630e9640 1 -- 172.21.15.159:0/144544627 shutdown_connections 2024-07-24T16:36:46.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.668+0000 7fa6630e9640 1 -- 172.21.15.159:0/144544627 wait complete. 2024-07-24T16:36:46.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.669+0000 7fa6630e9640 1 Processor -- start 2024-07-24T16:36:46.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.670+0000 7fa6630e9640 1 -- start start 2024-07-24T16:36:46.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.670+0000 7fa6630e9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c06f780 0x7fa65c150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:46.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.670+0000 7fa6630e9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa65c073a50 0x7fa65c1f54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:46.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.670+0000 7fa6630e9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa65c1549d0 0x7fa65c1f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:46.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.670+0000 7fa6630e9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c15e840 con 0x7fa65c06f780 2024-07-24T16:36:46.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.670+0000 7fa6630e9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa65c15e6c0 con 0x7fa65c073a50 2024-07-24T16:36:46.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.670+0000 7fa6630e9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa65c15e9c0 con 0x7fa65c1549d0 2024-07-24T16:36:46.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa660e85640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c06f780 0x7fa65c150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:46.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa660e85640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c06f780 0x7fa65c150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53892/0 (socket says 172.21.15.159:53892) 2024-07-24T16:36:46.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa660e85640 1 -- 172.21.15.159:0/1455713214 learned_addr learned my addr 172.21.15.159:0/1455713214 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:46.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa661686640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa65c1549d0 0x7fa65c1f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:46.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa65bfff640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa65c073a50 0x7fa65c1f54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:46.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa660e85640 1 -- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa65c1549d0 msgr2=0x7fa65c1f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:46.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa660e85640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa65c1549d0 0x7fa65c1f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:46.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa660e85640 1 -- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa65c073a50 msgr2=0x7fa65c1f54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:46.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa660e85640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa65c073a50 0x7fa65c1f54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:46.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa660e85640 1 -- 172.21.15.159:0/1455713214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa65c14fe90 con 0x7fa65c06f780 2024-07-24T16:36:46.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa660e85640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c06f780 0x7fa65c150f30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c970 tx=0x7fa65400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:46.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa6597fa640 1 -- 172.21.15.159:0/1455713214 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654007bb0 con 0x7fa65c06f780 2024-07-24T16:36:46.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa6597fa640 1 -- 172.21.15.159:0/1455713214 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa654005020 con 0x7fa65c06f780 2024-07-24T16:36:46.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa6630e9640 1 -- 172.21.15.159:0/1455713214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa65c150170 con 0x7fa65c06f780 2024-07-24T16:36:46.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa6597fa640 1 -- 172.21.15.159:0/1455713214 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa654007e60 con 0x7fa65c06f780 2024-07-24T16:36:46.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.671+0000 7fa6630e9640 1 -- 172.21.15.159:0/1455713214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa65c150a10 con 0x7fa65c06f780 2024-07-24T16:36:46.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.672+0000 7fa6630e9640 1 -- 172.21.15.159:0/1455713214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa65c06f240 con 0x7fa65c06f780 2024-07-24T16:36:46.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.673+0000 7fa6597fa640 1 -- 172.21.15.159:0/1455713214 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 16) ==== 98977+0+0 (secure 0 0 0) 0x7fa654005470 con 0x7fa65c06f780 2024-07-24T16:36:46.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.673+0000 7fa6597fa640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa63c076e60 0x7fa63c079320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:46.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.673+0000 7fa6597fa640 1 -- 172.21.15.159:0/1455713214 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6723+0+0 (secure 0 0 0) 0x7fa654098ce0 con 0x7fa65c06f780 2024-07-24T16:36:46.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.673+0000 7fa65bfff640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa63c076e60 0x7fa63c079320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:46.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.674+0000 7fa65bfff640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa63c076e60 0x7fa63c079320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa64c035000 tx=0x7fa64c03c040 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:46.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.677+0000 7fa6597fa640 1 -- 172.21.15.159:0/1455713214 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa65409d070 con 0x7fa65c06f780 2024-07-24T16:36:46.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.860+0000 7fa6630e9640 1 -- 172.21.15.159:0/1455713214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa65c150340 con 0x7fa65c06f780 2024-07-24T16:36:46.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:46.921+0000 7fa6597fa640 1 -- 172.21.15.159:0/1455713214 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mgrmap(e 17) ==== 99083+0+0 (secure 0 0 0) 0x7fa65405da70 con 0x7fa65c06f780 2024-07-24T16:36:47.547 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.544+0000 7fa6597fa640 1 -- 172.21.15.159:0/1455713214 <== mon.0 v2:172.21.15.159:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) ==== 169+0+0 (secure 0 0 0) 0x7fa654014030 con 0x7fa65c06f780 2024-07-24T16:36:47.547 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_data' removed 2024-07-24T16:36:47.550 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.547+0000 7fa6630e9640 1 -- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa63c076e60 msgr2=0x7fa63c079320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.547+0000 7fa6630e9640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa63c076e60 0x7fa63c079320 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa64c035000 tx=0x7fa64c03c040 comp rx=0 tx=0).stop 2024-07-24T16:36:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.547+0000 7fa6630e9640 1 -- 172.21.15.159:0/1455713214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c06f780 msgr2=0x7fa65c150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.547+0000 7fa6630e9640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c06f780 0x7fa65c150f30 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa65400c970 tx=0x7fa65400ce30 comp rx=0 tx=0).stop 2024-07-24T16:36:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.548+0000 7fa6630e9640 1 -- 172.21.15.159:0/1455713214 shutdown_connections 2024-07-24T16:36:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.548+0000 7fa6630e9640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa65c1549d0 0x7fa65c1f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.548+0000 7fa6630e9640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa65c073a50 0x7fa65c1f54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.548+0000 7fa6630e9640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa63c076e60 0x7fa63c079320 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.548+0000 7fa6630e9640 1 --2- 172.21.15.159:0/1455713214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa65c06f780 0x7fa65c150f30 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.548+0000 7fa6630e9640 1 -- 172.21.15.159:0/1455713214 >> 172.21.15.159:0/1455713214 conn(0x7fa65c06c560 msgr2=0x7fa65c0b38c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.548+0000 7fa6630e9640 1 -- 172.21.15.159:0/1455713214 shutdown_connections 2024-07-24T16:36:47.551 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.548+0000 7fa6630e9640 1 -- 172.21.15.159:0/1455713214 wait complete. 2024-07-24T16:36:47.563 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-07-24T16:36:47.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.671+0000 7f3b1591e640 1 -- 172.21.15.159:0/3985321237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1015ad80 msgr2=0x7f3b100b41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:47.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.671+0000 7f3b1591e640 1 --2- 172.21.15.159:0/3985321237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1015ad80 0x7f3b100b41d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f3af8009830 tx=0x7f3af802a3f0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.671+0000 7f3b1591e640 1 -- 172.21.15.159:0/3985321237 shutdown_connections 2024-07-24T16:36:47.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.671+0000 7f3b1591e640 1 --2- 172.21.15.159:0/3985321237 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b1006d670 0x7f3b1006dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.671+0000 7f3b1591e640 1 --2- 172.21.15.159:0/3985321237 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1015ad80 0x7f3b100b41d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.671+0000 7f3b1591e640 1 -- 172.21.15.159:0/3985321237 >> 172.21.15.159:0/3985321237 conn(0x7f3b1006c560 msgr2=0x7f3b1006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:47.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.671+0000 7f3b1591e640 1 -- 172.21.15.159:0/3985321237 shutdown_connections 2024-07-24T16:36:47.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.671+0000 7f3b1591e640 1 -- 172.21.15.159:0/3985321237 wait complete. 2024-07-24T16:36:47.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.672+0000 7f3b1591e640 1 Processor -- start 2024-07-24T16:36:47.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.673+0000 7f3b1591e640 1 -- start start 2024-07-24T16:36:47.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.673+0000 7f3b1591e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1006d670 0x7f3b100add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:47.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.673+0000 7f3b1591e640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b10150cc0 0x7f3b101f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:47.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.673+0000 7f3b1591e640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b1015ad80 0x7f3b101f5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:47.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.673+0000 7f3b1591e640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3b100cf840 con 0x7f3b1006d670 2024-07-24T16:36:47.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.673+0000 7f3b1591e640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3b100cf6c0 con 0x7f3b1015ad80 2024-07-24T16:36:47.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.673+0000 7f3b1591e640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3b100cf9c0 con 0x7f3b10150cc0 2024-07-24T16:36:47.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.673+0000 7f3b0effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1006d670 0x7f3b100add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.673+0000 7f3b0effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1006d670 0x7f3b100add20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53906/0 (socket says 172.21.15.159:53906) 2024-07-24T16:36:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.673+0000 7f3b0effd640 1 -- 172.21.15.159:0/2195662089 learned_addr learned my addr 172.21.15.159:0/2195662089 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.673+0000 7f3b0e7fc640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b10150cc0 0x7f3b101f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.674+0000 7f3b0f7fe640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b1015ad80 0x7f3b101f5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.674+0000 7f3b0effd640 1 -- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b10150cc0 msgr2=0x7f3b101f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.674+0000 7f3b0effd640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b10150cc0 0x7f3b101f55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.674+0000 7f3b0effd640 1 -- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b1015ad80 msgr2=0x7f3b101f5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.674+0000 7f3b0effd640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b1015ad80 0x7f3b101f5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.674+0000 7f3b0effd640 1 -- 172.21.15.159:0/2195662089 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b100aa0e0 con 0x7f3b1006d670 2024-07-24T16:36:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.674+0000 7f3b0effd640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1006d670 0x7f3b100add20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800c500 tx=0x7f3b0800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.674+0000 7f3b07fff640 1 -- 172.21.15.159:0/2195662089 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08017070 con 0x7f3b1006d670 2024-07-24T16:36:47.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.674+0000 7f3b07fff640 1 -- 172.21.15.159:0/2195662089 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b080035f0 con 0x7f3b1006d670 2024-07-24T16:36:47.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.674+0000 7f3b1591e640 1 -- 172.21.15.159:0/2195662089 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b100aa3c0 con 0x7f3b1006d670 2024-07-24T16:36:47.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.674+0000 7f3b07fff640 1 -- 172.21.15.159:0/2195662089 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08003a40 con 0x7f3b1006d670 2024-07-24T16:36:47.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.674+0000 7f3b1591e640 1 -- 172.21.15.159:0/2195662089 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b100aa980 con 0x7f3b1006d670 2024-07-24T16:36:47.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.675+0000 7f3b1591e640 1 -- 172.21.15.159:0/2195662089 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b1006dae0 con 0x7f3b1006d670 2024-07-24T16:36:47.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.676+0000 7f3b07fff640 1 -- 172.21.15.159:0/2195662089 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 99083+0+0 (secure 0 0 0) 0x7f3b0801a070 con 0x7f3b1006d670 2024-07-24T16:36:47.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.676+0000 7f3b07fff640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3af0076f80 0x7f3af0079440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:47.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.676+0000 7f3b07fff640 1 -- 172.21.15.159:0/2195662089 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6280+0+0 (secure 0 0 0) 0x7f3b08097ed0 con 0x7f3b1006d670 2024-07-24T16:36:47.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.676+0000 7f3b0e7fc640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3af0076f80 0x7f3af0079440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:47.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.677+0000 7f3b0e7fc640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3af0076f80 0x7f3af0079440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3af8034000 tx=0x7f3af8004730 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:47.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.681+0000 7f3b07fff640 1 -- 172.21.15.159:0/2195662089 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f3b08061090 con 0x7f3b1006d670 2024-07-24T16:36:47.869 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.866+0000 7f3b1591e640 1 -- 172.21.15.159:0/2195662089 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f3b10071b30 con 0x7f3b1006d670 2024-07-24T16:36:47.872 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.870+0000 7f3b07fff640 1 -- 172.21.15.159:0/2195662089 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v31) ==== 71+0+0 (secure 0 0 0) 0x7f3b080692d0 con 0x7f3b1006d670 2024-07-24T16:36:47.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.872+0000 7f3b1591e640 1 -- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3af0076f80 msgr2=0x7f3af0079440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:47.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.872+0000 7f3b1591e640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3af0076f80 0x7f3af0079440 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3af8034000 tx=0x7f3af8004730 comp rx=0 tx=0).stop 2024-07-24T16:36:47.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.872+0000 7f3b1591e640 1 -- 172.21.15.159:0/2195662089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1006d670 msgr2=0x7f3b100add20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:47.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.872+0000 7f3b1591e640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1006d670 0x7f3b100add20 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f3b0800c500 tx=0x7f3b0800c9c0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.872+0000 7f3b1591e640 1 -- 172.21.15.159:0/2195662089 shutdown_connections 2024-07-24T16:36:47.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.872+0000 7f3b1591e640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3b1015ad80 0x7f3b101f5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.872+0000 7f3b1591e640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3b10150cc0 0x7f3b101f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.872+0000 7f3b1591e640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3af0076f80 0x7f3af0079440 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.872+0000 7f3b1591e640 1 --2- 172.21.15.159:0/2195662089 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3b1006d670 0x7f3b100add20 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.872+0000 7f3b1591e640 1 -- 172.21.15.159:0/2195662089 >> 172.21.15.159:0/2195662089 conn(0x7f3b1006c560 msgr2=0x7f3b1015c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:47.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.872+0000 7f3b1591e640 1 -- 172.21.15.159:0/2195662089 shutdown_connections 2024-07-24T16:36:47.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.872+0000 7f3b1591e640 1 -- 172.21.15.159:0/2195662089 wait complete. 2024-07-24T16:36:47.886 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates' 2024-07-24T16:36:47.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.986+0000 7fe0faf83640 1 -- 172.21.15.159:0/4032388935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f406f890 msgr2=0x7fe0f40cf320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:47.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.986+0000 7fe0faf83640 1 --2- 172.21.15.159:0/4032388935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f406f890 0x7fe0f40cf320 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009830 tx=0x7fe0dc02a410 comp rx=0 tx=0).stop 2024-07-24T16:36:47.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.986+0000 7fe0faf83640 1 -- 172.21.15.159:0/4032388935 shutdown_connections 2024-07-24T16:36:47.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.986+0000 7fe0faf83640 1 --2- 172.21.15.159:0/4032388935 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0f40cf860 0x7fe0f415bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.986+0000 7fe0faf83640 1 --2- 172.21.15.159:0/4032388935 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f406f890 0x7fe0f40cf320 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.986+0000 7fe0faf83640 1 -- 172.21.15.159:0/4032388935 >> 172.21.15.159:0/4032388935 conn(0x7fe0f406c560 msgr2=0x7fe0f406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:47.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.986+0000 7fe0faf83640 1 -- 172.21.15.159:0/4032388935 shutdown_connections 2024-07-24T16:36:47.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.986+0000 7fe0faf83640 1 -- 172.21.15.159:0/4032388935 wait complete. 2024-07-24T16:36:47.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.987+0000 7fe0faf83640 1 Processor -- start 2024-07-24T16:36:47.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.987+0000 7fe0faf83640 1 -- start start 2024-07-24T16:36:47.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0faf83640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0f406f890 0x7fe0f4146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:47.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0faf83640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f40cf860 0x7fe0f40b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:47.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0faf83640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0f4158fe0 0x7fe0f415e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:47.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0faf83640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f4159540 con 0x7fe0f40cf860 2024-07-24T16:36:47.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0faf83640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe0f41593c0 con 0x7fe0f406f890 2024-07-24T16:36:47.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0faf83640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe0f415c4d0 con 0x7fe0f4158fe0 2024-07-24T16:36:47.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f40cf860 0x7fe0f40b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:47.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0f3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f40cf860 0x7fe0f40b1090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53918/0 (socket says 172.21.15.159:53918) 2024-07-24T16:36:47.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0f3fff640 1 -- 172.21.15.159:0/765957486 learned_addr learned my addr 172.21.15.159:0/765957486 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:47.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0f9520640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0f4158fe0 0x7fe0f415e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:47.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0f8d1f640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0f406f890 0x7fe0f4146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:47.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0f3fff640 1 -- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0f4158fe0 msgr2=0x7fe0f415e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:47.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0f3fff640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0f4158fe0 0x7fe0f415e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0f3fff640 1 -- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0f406f890 msgr2=0x7fe0f4146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:47.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0f3fff640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0f406f890 0x7fe0f4146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:47.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.988+0000 7fe0f3fff640 1 -- 172.21.15.159:0/765957486 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0f41f53b0 con 0x7fe0f40cf860 2024-07-24T16:36:47.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.989+0000 7fe0f3fff640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f40cf860 0x7fe0f40b1090 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009780 tx=0x7fe0dc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:47.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.989+0000 7fe0f17fa640 1 -- 172.21.15.159:0/765957486 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc03f020 con 0x7fe0f40cf860 2024-07-24T16:36:47.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.989+0000 7fe0f17fa640 1 -- 172.21.15.159:0/765957486 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe0dc033e10 con 0x7fe0f40cf860 2024-07-24T16:36:47.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.989+0000 7fe0faf83640 1 -- 172.21.15.159:0/765957486 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0f40b1b10 con 0x7fe0f40cf860 2024-07-24T16:36:47.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.989+0000 7fe0f17fa640 1 -- 172.21.15.159:0/765957486 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc037040 con 0x7fe0f40cf860 2024-07-24T16:36:47.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.989+0000 7fe0faf83640 1 -- 172.21.15.159:0/765957486 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0f41f4bb0 con 0x7fe0f40cf860 2024-07-24T16:36:47.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.990+0000 7fe0faf83640 1 -- 172.21.15.159:0/765957486 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0f40cbf00 con 0x7fe0f40cf860 2024-07-24T16:36:47.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.990+0000 7fe0f17fa640 1 -- 172.21.15.159:0/765957486 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 17) ==== 99083+0+0 (secure 0 0 0) 0x7fe0dc042020 con 0x7fe0f40cf860 2024-07-24T16:36:47.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.991+0000 7fe0f17fa640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe0d4076f80 0x7fe0d4079440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:47.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.991+0000 7fe0f17fa640 1 -- 172.21.15.159:0/765957486 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6280+0+0 (secure 0 0 0) 0x7fe0dc0b8980 con 0x7fe0f40cf860 2024-07-24T16:36:47.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.991+0000 7fe0f8d1f640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe0d4076f80 0x7fe0d4079440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:47.994 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.992+0000 7fe0f8d1f640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe0d4076f80 0x7fe0d4079440 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4001fb0 tx=0x7fe0e4009040 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:47.998 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:47.995+0000 7fe0f17fa640 1 -- 172.21.15.159:0/765957486 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fe0dc049030 con 0x7fe0f40cf860 2024-07-24T16:36:48.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.248+0000 7fe0faf83640 1 -- 172.21.15.159:0/765957486 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]} v 0) -- 0x7fe0f406da80 con 0x7fe0f40cf860 2024-07-24T16:36:48.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.926+0000 7fe0f17fa640 1 -- 172.21.15.159:0/765957486 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_concurrent_snap_creates"]}]=0 v445) ==== 158+0+0 (secure 0 0 0) 0x7fe0dc081460 con 0x7fe0f40cf860 2024-07-24T16:36:48.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.928+0000 7fe0faf83640 1 -- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe0d4076f80 msgr2=0x7fe0d4079440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:48.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.928+0000 7fe0faf83640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe0d4076f80 0x7fe0d4079440 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4001fb0 tx=0x7fe0e4009040 comp rx=0 tx=0).stop 2024-07-24T16:36:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.929+0000 7fe0faf83640 1 -- 172.21.15.159:0/765957486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f40cf860 msgr2=0x7fe0f40b1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.929+0000 7fe0faf83640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f40cf860 0x7fe0f40b1090 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc009780 tx=0x7fe0dc033c20 comp rx=0 tx=0).stop 2024-07-24T16:36:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.929+0000 7fe0faf83640 1 -- 172.21.15.159:0/765957486 shutdown_connections 2024-07-24T16:36:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.929+0000 7fe0faf83640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe0f4158fe0 0x7fe0f415e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.929+0000 7fe0faf83640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe0d4076f80 0x7fe0d4079440 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.929+0000 7fe0faf83640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe0f40cf860 0x7fe0f40b1090 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.929+0000 7fe0faf83640 1 --2- 172.21.15.159:0/765957486 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe0f406f890 0x7fe0f4146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.929+0000 7fe0faf83640 1 -- 172.21.15.159:0/765957486 >> 172.21.15.159:0/765957486 conn(0x7fe0f406c560 msgr2=0x7fe0f415abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.929+0000 7fe0faf83640 1 -- 172.21.15.159:0/765957486 shutdown_connections 2024-07-24T16:36:48.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:48.929+0000 7fe0faf83640 1 -- 172.21.15.159:0/765957486 wait complete. 2024-07-24T16:36:48.944 INFO:tasks.cephfs_test_runner:Test concurrent snap creates in same file-system without db issues ... ok 2024-07-24T16:36:48.944 INFO:tasks.cephfs_test_runner:Starting test: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) Test exisitence of multiple scheduled snapshots 2024-07-24T16:36:48.945 INFO:tasks.cephfs_test_runner:test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-07-24T16:36:48.945 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:36:49.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.048+0000 7f3ece0a9640 1 -- 172.21.15.159:0/2196649343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3eb0003a50 msgr2=0x7f3eb0003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:49.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.048+0000 7f3ece0a9640 1 --2- 172.21.15.159:0/2196649343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3eb0003a50 0x7f3eb0003e90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8001dc0 tx=0x7f3eb0005830 comp rx=0 tx=0).stop 2024-07-24T16:36:49.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.048+0000 7f3ece0a9640 1 -- 172.21.15.159:0/2196649343 shutdown_connections 2024-07-24T16:36:49.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.048+0000 7f3ece0a9640 1 --2- 172.21.15.159:0/2196649343 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3eb0003a50 0x7f3eb0003e90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.048+0000 7f3ece0a9640 1 -- 172.21.15.159:0/2196649343 >> 172.21.15.159:0/2196649343 conn(0x7f3ec806c560 msgr2=0x7f3ec806c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:49.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.048+0000 7f3ece0a9640 1 -- 172.21.15.159:0/2196649343 shutdown_connections 2024-07-24T16:36:49.052 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.049+0000 7f3ece0a9640 1 -- 172.21.15.159:0/2196649343 wait complete. 2024-07-24T16:36:49.053 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.050+0000 7f3ece0a9640 1 Processor -- start 2024-07-24T16:36:49.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.050+0000 7f3ece0a9640 1 -- start start 2024-07-24T16:36:49.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ece0a9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3eb0003a50 0x7f3ec80a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:49.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ece0a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ec8149c90 0x7f3ec8145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:49.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ece0a9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ec8132620 0x7f3ec814edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:49.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ece0a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec80b46c0 con 0x7f3ec8149c90 2024-07-24T16:36:49.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ece0a9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3ec80b4540 con 0x7f3ec8132620 2024-07-24T16:36:49.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ece0a9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3ec80b3850 con 0x7f3eb0003a50 2024-07-24T16:36:49.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ec6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ec8149c90 0x7f3ec8145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:49.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ec6ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ec8149c90 0x7f3ec8145f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53932/0 (socket says 172.21.15.159:53932) 2024-07-24T16:36:49.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ec6ffd640 1 -- 172.21.15.159:0/652826187 learned_addr learned my addr 172.21.15.159:0/652826187 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:49.055 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ec77fe640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3eb0003a50 0x7f3ec80a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:49.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ec7fff640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ec8132620 0x7f3ec814edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:49.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ec6ffd640 1 -- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3eb0003a50 msgr2=0x7f3ec80a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:49.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ec6ffd640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3eb0003a50 0x7f3ec80a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ec6ffd640 1 -- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ec8132620 msgr2=0x7f3ec814edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:49.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ec6ffd640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ec8132620 0x7f3ec814edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ec6ffd640 1 -- 172.21.15.159:0/652826187 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ec80a99c0 con 0x7f3ec8149c90 2024-07-24T16:36:49.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ec6ffd640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ec8149c90 0x7f3ec8145f70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0063d0 tx=0x7f3ebc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:49.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3eaffff640 1 -- 172.21.15.159:0/652826187 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc015070 con 0x7f3ec8149c90 2024-07-24T16:36:49.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3eaffff640 1 -- 172.21.15.159:0/652826187 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ebc011840 con 0x7f3ec8149c90 2024-07-24T16:36:49.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ece0a9640 1 -- 172.21.15.159:0/652826187 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ec814dd50 con 0x7f3ec8149c90 2024-07-24T16:36:49.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3eaffff640 1 -- 172.21.15.159:0/652826187 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ebc011c90 con 0x7f3ec8149c90 2024-07-24T16:36:49.056 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.051+0000 7f3ece0a9640 1 -- 172.21.15.159:0/652826187 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ec814e310 con 0x7f3ec8149c90 2024-07-24T16:36:49.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.052+0000 7f3ece0a9640 1 -- 172.21.15.159:0/652826187 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec806d670 con 0x7f3ec8149c90 2024-07-24T16:36:49.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.053+0000 7f3eaffff640 1 -- 172.21.15.159:0/652826187 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f3ebc018070 con 0x7f3ec8149c90 2024-07-24T16:36:49.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.053+0000 7f3eaffff640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3eb4077040 0x7f3eb4079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:49.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.054+0000 7f3eaffff640 1 -- 172.21.15.159:0/652826187 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6280+0+0 (secure 0 0 0) 0x7f3ebc099650 con 0x7f3ec8149c90 2024-07-24T16:36:49.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.054+0000 7f3ec77fe640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3eb4077040 0x7f3eb4079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:49.058 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.054+0000 7f3ec77fe640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3eb4077040 0x7f3eb4079500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8032000 tx=0x7f3eb8001510 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:49.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.058+0000 7f3eaffff640 1 -- 172.21.15.159:0/652826187 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f3ebc0626b0 con 0x7f3ec8149c90 2024-07-24T16:36:49.246 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.243+0000 7f3ece0a9640 1 -- 172.21.15.159:0/652826187 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ec8159d60 con 0x7f3ec8149c90 2024-07-24T16:36:49.247 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.244+0000 7f3eaffff640 1 -- 172.21.15.159:0/652826187 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v54) ==== 74+0+14737 (secure 0 0 0) 0x7f3ebc061fb0 con 0x7f3ec8149c90 2024-07-24T16:36:49.247 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:49.247 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":54,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:36:47.538175+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.193:6833/2609611338":"2024-07-25T16:36:44.526018+0000","172.21.15.193:0/1903087136":"2024-07-25T16:25:13.031566+0000","172.21.15.193:0/1332350307":"2024-07-25T16:25:13.031566+0000","172.21.15.193:6832/2609611338":"2024-07-25T16:36:44.526018+0000","172.21.15.193:6833/222319347":"2024-07-25T16:25:13.031566+0000","172.21.15.193:0/1296621384":"2024-07-25T16:36:44.526018+0000","172.21.15.193:0/3685404778":"2024-07-25T16:25:13.031566+0000","172.21.15.159:6834/279171348":"2024-07-25T16:36:44.198559+0000","172.21.15.193:0/3580844224":"2024-07-25T16:25:13.031566+0000","172.21.15.193:0/2783014880":"2024-07-25T16:36:44.526018+0000","172.21.15.193:0/866767113":"2024-07-25T16:36:44.526018+0000","172.21.15.193:6832/222319347":"2024-07-25T16:25:13.031566+0000","172.21.15.159:6832/279171348":"2024-07-25T16:36:44.198559+0000","172.21.15.193:0/2630177852":"2024-07-25T16:36:44.526018+0000","172.21.15.193:0/1425618250":"2024-07-25T16:36:44.526018+0000","172.21.15.193:0/4052911631":"2024-07-25T16:36:44.526018+0000","172.21.15.193:0/3617064513":"2024-07-25T16:36:44.526018+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":4,"length":1},{"begin":14,"length":1},{"begin":24,"length":1},{"begin":35,"length":1},{"begin":41,"length":2},{"begin":46,"length":1},{"begin":52,"length":1},{"begin":56,"length":1},{"begin":63,"length":1},{"begin":67,"length":1},{"begin":74,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":88,"length":1},{"begin":95,"length":1},{"begin":99,"length":1},{"begin":106,"length":1},{"begin":203,"length":18}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:36:49.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.246+0000 7f3ece0a9640 1 -- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3eb4077040 msgr2=0x7f3eb4079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:49.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.246+0000 7f3ece0a9640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3eb4077040 0x7f3eb4079500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3eb8032000 tx=0x7f3eb8001510 comp rx=0 tx=0).stop 2024-07-24T16:36:49.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.246+0000 7f3ece0a9640 1 -- 172.21.15.159:0/652826187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ec8149c90 msgr2=0x7f3ec8145f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:49.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.246+0000 7f3ece0a9640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ec8149c90 0x7f3ec8145f70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc0063d0 tx=0x7f3ebc0039c0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.246+0000 7f3ece0a9640 1 -- 172.21.15.159:0/652826187 shutdown_connections 2024-07-24T16:36:49.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.246+0000 7f3ece0a9640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ec8132620 0x7f3ec814edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.246+0000 7f3ece0a9640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3eb4077040 0x7f3eb4079500 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.246+0000 7f3ece0a9640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ec8149c90 0x7f3ec8145f70 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.246+0000 7f3ece0a9640 1 --2- 172.21.15.159:0/652826187 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3eb0003a50 0x7f3ec80a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.246+0000 7f3ece0a9640 1 -- 172.21.15.159:0/652826187 >> 172.21.15.159:0/652826187 conn(0x7f3ec806c560 msgr2=0x7f3ec815cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:49.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.246+0000 7f3ece0a9640 1 -- 172.21.15.159:0/652826187 shutdown_connections 2024-07-24T16:36:49.250 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.246+0000 7f3ece0a9640 1 -- 172.21.15.159:0/652826187 wait complete. 2024-07-24T16:36:49.260 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-07-24T16:23:58.377345+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-07-24T16:36:49.260 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-07-24T16:36:49.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.363+0000 7f3593055640 1 -- 172.21.15.159:0/1376908228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358c070500 msgr2=0x7f358c0cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:49.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.363+0000 7f3593055640 1 --2- 172.21.15.159:0/1376908228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358c070500 0x7f358c0cf410 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f3578005fd0 tx=0x7f357802a5d0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.363+0000 7f3593055640 1 -- 172.21.15.159:0/1376908228 shutdown_connections 2024-07-24T16:36:49.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.363+0000 7f3593055640 1 --2- 172.21.15.159:0/1376908228 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f358c06f1c0 0x7f358c15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.366 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.363+0000 7f3593055640 1 --2- 172.21.15.159:0/1376908228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358c070500 0x7f358c0cf410 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.363+0000 7f3593055640 1 -- 172.21.15.159:0/1376908228 >> 172.21.15.159:0/1376908228 conn(0x7f358c06d450 msgr2=0x7f358c06d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:49.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.363+0000 7f3593055640 1 -- 172.21.15.159:0/1376908228 shutdown_connections 2024-07-24T16:36:49.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.363+0000 7f3593055640 1 -- 172.21.15.159:0/1376908228 wait complete. 2024-07-24T16:36:49.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.365+0000 7f3593055640 1 Processor -- start 2024-07-24T16:36:49.367 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.365+0000 7f3593055640 1 -- start start 2024-07-24T16:36:49.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.365+0000 7f3593055640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f358c06f1c0 0x7f358c147190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:49.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.365+0000 7f3593055640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358c070500 0x7f358c143d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:49.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.365+0000 7f3593055640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f358c157d50 0x7f358c1f4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:49.369 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.365+0000 7f3593055640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f358c0cdea0 con 0x7f358c070500 2024-07-24T16:36:49.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.365+0000 7f3593055640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f358c0cdd20 con 0x7f358c157d50 2024-07-24T16:36:49.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.365+0000 7f3593055640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f358c0ce020 con 0x7f358c06f1c0 2024-07-24T16:36:49.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f358bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358c070500 0x7f358c143d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:49.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f358bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358c070500 0x7f358c143d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53952/0 (socket says 172.21.15.159:53952) 2024-07-24T16:36:49.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f358bfff640 1 -- 172.21.15.159:0/1588540102 learned_addr learned my addr 172.21.15.159:0/1588540102 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:49.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f3590df1640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f358c06f1c0 0x7f358c147190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:49.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f35915f2640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f358c157d50 0x7f358c1f4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:49.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f358bfff640 1 -- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f358c06f1c0 msgr2=0x7f358c147190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:49.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f358bfff640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f358c06f1c0 0x7f358c147190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f358bfff640 1 -- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f358c157d50 msgr2=0x7f358c1f4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:49.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f358bfff640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f358c157d50 0x7f358c1f4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f358bfff640 1 -- 172.21.15.159:0/1588540102 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358c1476d0 con 0x7f358c070500 2024-07-24T16:36:49.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f358bfff640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358c070500 0x7f358c143d50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3578009850 tx=0x7f35780038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:49.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f35897fa640 1 -- 172.21.15.159:0/1588540102 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357803f070 con 0x7f358c070500 2024-07-24T16:36:49.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f35897fa640 1 -- 172.21.15.159:0/1588540102 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3578005600 con 0x7f358c070500 2024-07-24T16:36:49.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f3593055640 1 -- 172.21.15.159:0/1588540102 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f358c1e0900 con 0x7f358c070500 2024-07-24T16:36:49.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f35897fa640 1 -- 172.21.15.159:0/1588540102 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3578035030 con 0x7f358c070500 2024-07-24T16:36:49.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.366+0000 7f3593055640 1 -- 172.21.15.159:0/1588540102 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f358c1f4400 con 0x7f358c070500 2024-07-24T16:36:49.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.367+0000 7f3593055640 1 -- 172.21.15.159:0/1588540102 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f358c15b3c0 con 0x7f358c070500 2024-07-24T16:36:49.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.368+0000 7f35897fa640 1 -- 172.21.15.159:0/1588540102 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f3578042070 con 0x7f358c070500 2024-07-24T16:36:49.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.368+0000 7f35897fa640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3570077010 0x7f35700794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:49.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.368+0000 7f35897fa640 1 -- 172.21.15.159:0/1588540102 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6280+0+0 (secure 0 0 0) 0x7f35780b9660 con 0x7f358c070500 2024-07-24T16:36:49.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.369+0000 7f3590df1640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3570077010 0x7f35700794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:49.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.369+0000 7f3590df1640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3570077010 0x7f35700794d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3580001720 tx=0x7f3580009040 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:49.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.372+0000 7f35897fa640 1 -- 172.21.15.159:0/1588540102 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f358c1476d0 con 0x7f358c070500 2024-07-24T16:36:49.558 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.556+0000 7f3593055640 1 -- 172.21.15.159:0/1588540102 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f358c076380 con 0x7f358c070500 2024-07-24T16:36:49.559 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.556+0000 7f35897fa640 1 -- 172.21.15.159:0/1588540102 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v54) ==== 93+0+10 (secure 0 0 0) 0x7f3578082060 con 0x7f358c070500 2024-07-24T16:36:49.559 INFO:teuthology.orchestra.run.smithi159.stdout:pg_num: 1 2024-07-24T16:36:49.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.558+0000 7f3593055640 1 -- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3570077010 msgr2=0x7f35700794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:49.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.558+0000 7f3593055640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3570077010 0x7f35700794d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3580001720 tx=0x7f3580009040 comp rx=0 tx=0).stop 2024-07-24T16:36:49.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.558+0000 7f3593055640 1 -- 172.21.15.159:0/1588540102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358c070500 msgr2=0x7f358c143d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:49.561 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.558+0000 7f3593055640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358c070500 0x7f358c143d50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f3578009850 tx=0x7f35780038a0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.559+0000 7f3593055640 1 -- 172.21.15.159:0/1588540102 shutdown_connections 2024-07-24T16:36:49.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.559+0000 7f3593055640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f358c157d50 0x7f358c1f4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.559+0000 7f3593055640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3570077010 0x7f35700794d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.559+0000 7f3593055640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f358c070500 0x7f358c143d50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.559+0000 7f3593055640 1 --2- 172.21.15.159:0/1588540102 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f358c06f1c0 0x7f358c147190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.559+0000 7f3593055640 1 -- 172.21.15.159:0/1588540102 >> 172.21.15.159:0/1588540102 conn(0x7f358c06d450 msgr2=0x7f358c0ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:49.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.559+0000 7f3593055640 1 -- 172.21.15.159:0/1588540102 shutdown_connections 2024-07-24T16:36:49.562 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.559+0000 7f3593055640 1 -- 172.21.15.159:0/1588540102 wait complete. 2024-07-24T16:36:49.572 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule' 2024-07-24T16:36:49.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.673+0000 7fe161a8d640 1 -- 172.21.15.159:0/3276766715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe15c15bf60 msgr2=0x7fe15c15c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:49.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.673+0000 7fe161a8d640 1 --2- 172.21.15.159:0/3276766715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe15c15bf60 0x7fe15c15c340 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe15c15f8f0 tx=0x7fe14c02a510 comp rx=0 tx=0).stop 2024-07-24T16:36:49.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.673+0000 7fe161a8d640 1 -- 172.21.15.159:0/3276766715 shutdown_connections 2024-07-24T16:36:49.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.673+0000 7fe161a8d640 1 --2- 172.21.15.159:0/3276766715 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe15c15bf60 0x7fe15c15c340 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.673+0000 7fe161a8d640 1 -- 172.21.15.159:0/3276766715 >> 172.21.15.159:0/3276766715 conn(0x7fe15c06fd50 msgr2=0x7fe15c070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:49.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.673+0000 7fe161a8d640 1 -- 172.21.15.159:0/3276766715 shutdown_connections 2024-07-24T16:36:49.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.673+0000 7fe161a8d640 1 -- 172.21.15.159:0/3276766715 wait complete. 2024-07-24T16:36:49.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.674+0000 7fe161a8d640 1 Processor -- start 2024-07-24T16:36:49.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.674+0000 7fe161a8d640 1 -- start start 2024-07-24T16:36:49.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe161a8d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe15c0b0bc0 0x7fe15c14a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:49.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe161a8d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe15c0b6080 0x7fe15c149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:49.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe161a8d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe15c15bf60 0x7fe15c1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:49.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe161a8d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c15fe10 con 0x7fe15c0b6080 2024-07-24T16:36:49.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe161a8d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe15c0b4d60 con 0x7fe15c0b0bc0 2024-07-24T16:36:49.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe161a8d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe15c14a410 con 0x7fe15c15bf60 2024-07-24T16:36:49.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe15affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe15c0b6080 0x7fe15c149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:49.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe15affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe15c0b6080 0x7fe15c149ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:53966/0 (socket says 172.21.15.159:53966) 2024-07-24T16:36:49.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe15affd640 1 -- 172.21.15.159:0/2959816062 learned_addr learned my addr 172.21.15.159:0/2959816062 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:49.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe15affd640 1 -- 172.21.15.159:0/2959816062 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe15c15bf60 msgr2=0x7fe15c1522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:49.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe15affd640 1 --2- 172.21.15.159:0/2959816062 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe15c15bf60 0x7fe15c1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe15affd640 1 -- 172.21.15.159:0/2959816062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe15c0b0bc0 msgr2=0x7fe15c14a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:49.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe15affd640 1 --2- 172.21.15.159:0/2959816062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe15c0b0bc0 0x7fe15c14a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:49.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.675+0000 7fe15affd640 1 -- 172.21.15.159:0/2959816062 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe15c0af610 con 0x7fe15c0b6080 2024-07-24T16:36:49.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.676+0000 7fe15affd640 1 --2- 172.21.15.159:0/2959816062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe15c0b6080 0x7fe15c149ed0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe15000c460 tx=0x7fe15000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:49.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.676+0000 7fe143fff640 1 -- 172.21.15.159:0/2959816062 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe150016020 con 0x7fe15c0b6080 2024-07-24T16:36:49.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.676+0000 7fe143fff640 1 -- 172.21.15.159:0/2959816062 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe150012960 con 0x7fe15c0b6080 2024-07-24T16:36:49.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.676+0000 7fe143fff640 1 -- 172.21.15.159:0/2959816062 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe150012db0 con 0x7fe15c0b6080 2024-07-24T16:36:49.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.676+0000 7fe161a8d640 1 -- 172.21.15.159:0/2959816062 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe15c1518f0 con 0x7fe15c0b6080 2024-07-24T16:36:49.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.676+0000 7fe161a8d640 1 -- 172.21.15.159:0/2959816062 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe15c0af8d0 con 0x7fe15c0b6080 2024-07-24T16:36:49.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.677+0000 7fe161a8d640 1 -- 172.21.15.159:0/2959816062 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe15c0b4b80 con 0x7fe15c0b6080 2024-07-24T16:36:49.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.677+0000 7fe143fff640 1 -- 172.21.15.159:0/2959816062 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fe150019020 con 0x7fe15c0b6080 2024-07-24T16:36:49.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.678+0000 7fe143fff640 1 --2- 172.21.15.159:0/2959816062 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe148077010 0x7fe1480794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:49.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.678+0000 7fe143fff640 1 -- 172.21.15.159:0/2959816062 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6280+0+0 (secure 0 0 0) 0x7fe150098620 con 0x7fe15c0b6080 2024-07-24T16:36:49.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.678+0000 7fe15b7fe640 1 --2- 172.21.15.159:0/2959816062 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe148077010 0x7fe1480794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:49.681 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.679+0000 7fe15b7fe640 1 --2- 172.21.15.159:0/2959816062 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe148077010 0x7fe1480794d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe14c034000 tx=0x7fe14c0046c0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:49.684 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.682+0000 7fe143fff640 1 -- 172.21.15.159:0/2959816062 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fe15c0b4b80 con 0x7fe15c0b6080 2024-07-24T16:36:49.936 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:49.933+0000 7fe161a8d640 1 -- 172.21.15.159:0/2959816062 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]} v 0) -- 0x7fe15c0b5250 con 0x7fe15c0b6080 2024-07-24T16:36:50.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:50.928+0000 7fe143fff640 1 -- 172.21.15.159:0/2959816062 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_snap_schedules.TestSnapSchedules.test_multi_snap_schedule"]}]=0 v447) ==== 157+0+0 (secure 0 0 0) 0x7fe150020070 con 0x7fe15c0b6080 2024-07-24T16:36:50.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:50.931+0000 7fe161a8d640 1 -- 172.21.15.159:0/2959816062 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe148077010 msgr2=0x7fe1480794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:50.934 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:50.931+0000 7fe161a8d640 1 --2- 172.21.15.159:0/2959816062 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe148077010 0x7fe1480794d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe14c034000 tx=0x7fe14c0046c0 comp rx=0 tx=0).stop 2024-07-24T16:36:50.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:50.931+0000 7fe161a8d640 1 -- 172.21.15.159:0/2959816062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe15c0b6080 msgr2=0x7fe15c149ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:50.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:50.931+0000 7fe161a8d640 1 --2- 172.21.15.159:0/2959816062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe15c0b6080 0x7fe15c149ed0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fe15000c460 tx=0x7fe15000c920 comp rx=0 tx=0).stop 2024-07-24T16:36:50.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:50.932+0000 7fe161a8d640 1 -- 172.21.15.159:0/2959816062 shutdown_connections 2024-07-24T16:36:50.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:50.932+0000 7fe161a8d640 1 --2- 172.21.15.159:0/2959816062 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe15c15bf60 0x7fe15c1522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:50.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:50.932+0000 7fe161a8d640 1 --2- 172.21.15.159:0/2959816062 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe148077010 0x7fe1480794d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:50.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:50.932+0000 7fe161a8d640 1 --2- 172.21.15.159:0/2959816062 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe15c0b6080 0x7fe15c149ed0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:50.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:50.932+0000 7fe161a8d640 1 --2- 172.21.15.159:0/2959816062 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe15c0b0bc0 0x7fe15c14a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:50.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:50.932+0000 7fe161a8d640 1 -- 172.21.15.159:0/2959816062 >> 172.21.15.159:0/2959816062 conn(0x7fe15c06fd50 msgr2=0x7fe15c15d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:50.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:50.932+0000 7fe161a8d640 1 -- 172.21.15.159:0/2959816062 shutdown_connections 2024-07-24T16:36:50.935 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:50.932+0000 7fe161a8d640 1 -- 172.21.15.159:0/2959816062 wait complete. 2024-07-24T16:36:50.948 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-07-24T16:36:51.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.054+0000 7ff8238fd640 1 -- 172.21.15.159:0/341729791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff81c157d50 msgr2=0x7ff81c0cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:51.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.054+0000 7ff8238fd640 1 --2- 172.21.15.159:0/341729791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff81c157d50 0x7ff81c0cf410 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff814005fd0 tx=0x7ff81402a8b0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.054+0000 7ff8238fd640 1 -- 172.21.15.159:0/341729791 shutdown_connections 2024-07-24T16:36:51.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.054+0000 7ff8238fd640 1 --2- 172.21.15.159:0/341729791 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff81c070500 0x7ff81c15b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.054+0000 7ff8238fd640 1 --2- 172.21.15.159:0/341729791 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff81c157d50 0x7ff81c0cf410 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.054+0000 7ff8238fd640 1 -- 172.21.15.159:0/341729791 >> 172.21.15.159:0/341729791 conn(0x7ff81c06d450 msgr2=0x7ff81c06d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:51.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.054+0000 7ff8238fd640 1 -- 172.21.15.159:0/341729791 shutdown_connections 2024-07-24T16:36:51.057 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.054+0000 7ff8238fd640 1 -- 172.21.15.159:0/341729791 wait complete. 2024-07-24T16:36:51.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.055+0000 7ff8238fd640 1 Processor -- start 2024-07-24T16:36:51.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.055+0000 7ff8238fd640 1 -- start start 2024-07-24T16:36:51.059 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff8238fd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff81c06f1c0 0x7ff81c1531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff8238fd640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff81c070500 0x7ff81c0b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff8238fd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff81c157d50 0x7ff81c1f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff8238fd640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c0cdea0 con 0x7ff81c157d50 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff8238fd640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c0cdd20 con 0x7ff81c070500 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff8238fd640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff81c0ce020 con 0x7ff81c06f1c0 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff821e9a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff81c157d50 0x7ff81c1f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff821e9a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff81c157d50 0x7ff81c1f7d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40812/0 (socket says 172.21.15.159:40812) 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff821e9a640 1 -- 172.21.15.159:0/1927587406 learned_addr learned my addr 172.21.15.159:0/1927587406 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff821699640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff81c06f1c0 0x7ff81c1531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff820e98640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff81c070500 0x7ff81c0b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff821e9a640 1 -- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff81c06f1c0 msgr2=0x7ff81c1531e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff821e9a640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff81c06f1c0 0x7ff81c1531e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff821e9a640 1 -- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff81c070500 msgr2=0x7ff81c0b3ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:51.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff821e9a640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff81c070500 0x7ff81c0b3ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.056+0000 7ff821e9a640 1 -- 172.21.15.159:0/1927587406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c1f7540 con 0x7ff81c157d50 2024-07-24T16:36:51.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.057+0000 7ff821e9a640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff81c157d50 0x7ff81c1f7d00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00e9e0 tx=0x7ff80c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:51.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.057+0000 7ff819ffb640 1 -- 172.21.15.159:0/1927587406 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c00cdb0 con 0x7ff81c157d50 2024-07-24T16:36:51.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.057+0000 7ff819ffb640 1 -- 172.21.15.159:0/1927587406 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff80c004020 con 0x7ff81c157d50 2024-07-24T16:36:51.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.057+0000 7ff8238fd640 1 -- 172.21.15.159:0/1927587406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81c0b4600 con 0x7ff81c157d50 2024-07-24T16:36:51.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.057+0000 7ff819ffb640 1 -- 172.21.15.159:0/1927587406 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80c004450 con 0x7ff81c157d50 2024-07-24T16:36:51.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.057+0000 7ff8238fd640 1 -- 172.21.15.159:0/1927587406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81c0b4bc0 con 0x7ff81c157d50 2024-07-24T16:36:51.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.058+0000 7ff8238fd640 1 -- 172.21.15.159:0/1927587406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff81c15b3c0 con 0x7ff81c157d50 2024-07-24T16:36:51.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.058+0000 7ff819ffb640 1 -- 172.21.15.159:0/1927587406 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7ff80c0035f0 con 0x7ff81c157d50 2024-07-24T16:36:51.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.059+0000 7ff819ffb640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7ff808077010 0x7ff8080794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:51.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.059+0000 7ff819ffb640 1 -- 172.21.15.159:0/1927587406 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6280+0+0 (secure 0 0 0) 0x7ff80c0992d0 con 0x7ff81c157d50 2024-07-24T16:36:51.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.059+0000 7ff821699640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7ff808077010 0x7ff8080794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:51.062 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.060+0000 7ff821699640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7ff808077010 0x7ff8080794d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff814034000 tx=0x7ff814004ab0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:51.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.063+0000 7ff819ffb640 1 -- 172.21.15.159:0/1927587406 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7ff80c061ce0 con 0x7ff81c157d50 2024-07-24T16:36:51.248 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.245+0000 7ff8238fd640 1 -- 172.21.15.159:0/1927587406 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7ff81c0b0620 con 0x7ff81c157d50 2024-07-24T16:36:51.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.246+0000 7ff819ffb640 1 -- 172.21.15.159:0/1927587406 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+1998 (secure 0 0 0) 0x7ff80c066230 con 0x7ff81c157d50 2024-07-24T16:36:51.249 INFO:teuthology.orchestra.run.smithi159.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-07-24T16:36:51.249 INFO:teuthology.orchestra.run.smithi159.stdout:mon advanced mon_op_complaint_time 120 2024-07-24T16:36:51.249 INFO:teuthology.orchestra.run.smithi159.stdout:mon dev mon_warn_on_pool_no_app false 2024-07-24T16:36:51.249 INFO:teuthology.orchestra.run.smithi159.stdout:osd advanced osd_op_complaint_time 180.000000 2024-07-24T16:36:51.249 INFO:teuthology.orchestra.run.smithi159.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 4982.532139 2024-07-24T16:36:51.249 INFO:teuthology.orchestra.run.smithi159.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 4864.100659 2024-07-24T16:36:51.249 INFO:teuthology.orchestra.run.smithi159.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 4804.732208 2024-07-24T16:36:51.249 INFO:teuthology.orchestra.run.smithi159.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 4907.470759 2024-07-24T16:36:51.250 INFO:teuthology.orchestra.run.smithi159.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 5216.011683 2024-07-24T16:36:51.250 INFO:teuthology.orchestra.run.smithi159.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 5107.248647 2024-07-24T16:36:51.250 INFO:teuthology.orchestra.run.smithi159.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5234.144198 2024-07-24T16:36:51.250 INFO:teuthology.orchestra.run.smithi159.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5443.221614 2024-07-24T16:36:51.250 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced debug_mds 20/20 2024-07-24T16:36:51.250 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced debug_mds_balancer 20/20 2024-07-24T16:36:51.250 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced debug_ms 1/1 2024-07-24T16:36:51.250 INFO:teuthology.orchestra.run.smithi159.stdout:mds dev mds_debug_frag true 2024-07-24T16:36:51.250 INFO:teuthology.orchestra.run.smithi159.stdout:mds dev mds_debug_scatterstat true 2024-07-24T16:36:51.250 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced mds_op_complaint_time 180.000000 2024-07-24T16:36:51.250 INFO:teuthology.orchestra.run.smithi159.stdout:mds dev mds_verify_scatter true 2024-07-24T16:36:51.250 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced osd_op_complaint_time 180.000000 2024-07-24T16:36:51.251 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced rados_mon_op_timeout 900 2024-07-24T16:36:51.251 INFO:teuthology.orchestra.run.smithi159.stdout:mds advanced rados_osd_op_timeout 900 2024-07-24T16:36:51.251 INFO:teuthology.orchestra.run.smithi159.stdout:client advanced client_mount_timeout 600 2024-07-24T16:36:51.251 INFO:teuthology.orchestra.run.smithi159.stdout:client advanced debug_client 20/20 2024-07-24T16:36:51.251 INFO:teuthology.orchestra.run.smithi159.stdout:client advanced debug_ms 1/1 2024-07-24T16:36:51.251 INFO:teuthology.orchestra.run.smithi159.stdout:client advanced rados_mon_op_timeout 900 2024-07-24T16:36:51.251 INFO:teuthology.orchestra.run.smithi159.stdout:client advanced rados_osd_op_timeout 900 2024-07-24T16:36:51.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.248+0000 7ff8238fd640 1 -- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7ff808077010 msgr2=0x7ff8080794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:51.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.248+0000 7ff8238fd640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7ff808077010 0x7ff8080794d0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff814034000 tx=0x7ff814004ab0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.248+0000 7ff8238fd640 1 -- 172.21.15.159:0/1927587406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff81c157d50 msgr2=0x7ff81c1f7d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:51.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.248+0000 7ff8238fd640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff81c157d50 0x7ff81c1f7d00 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff80c00e9e0 tx=0x7ff80c00eea0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.248+0000 7ff8238fd640 1 -- 172.21.15.159:0/1927587406 shutdown_connections 2024-07-24T16:36:51.252 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.248+0000 7ff8238fd640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7ff808077010 0x7ff8080794d0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.248+0000 7ff8238fd640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff81c157d50 0x7ff81c1f7d00 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.248+0000 7ff8238fd640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff81c070500 0x7ff81c0b3ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.248+0000 7ff8238fd640 1 --2- 172.21.15.159:0/1927587406 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff81c06f1c0 0x7ff81c1531e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.248+0000 7ff8238fd640 1 -- 172.21.15.159:0/1927587406 >> 172.21.15.159:0/1927587406 conn(0x7ff81c06d450 msgr2=0x7ff81c06fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:51.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.248+0000 7ff8238fd640 1 -- 172.21.15.159:0/1927587406 shutdown_connections 2024-07-24T16:36:51.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.248+0000 7ff8238fd640 1 -- 172.21.15.159:0/1927587406 wait complete. 2024-07-24T16:36:51.262 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-07-24T16:36:51.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.367+0000 7f7d99dae640 1 -- 172.21.15.159:0/2711838234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d7c004800 msgr2=0x7f7d7c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:51.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.367+0000 7f7d99dae640 1 --2- 172.21.15.159:0/2711838234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d7c004800 0x7f7d7c004c80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f7d88009b50 tx=0x7f7d7c005830 comp rx=0 tx=0).stop 2024-07-24T16:36:51.370 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.367+0000 7f7d99dae640 1 -- 172.21.15.159:0/2711838234 shutdown_connections 2024-07-24T16:36:51.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.367+0000 7f7d99dae640 1 --2- 172.21.15.159:0/2711838234 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d7c004800 0x7f7d7c004c80 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.367+0000 7f7d99dae640 1 -- 172.21.15.159:0/2711838234 >> 172.21.15.159:0/2711838234 conn(0x7f7d9406c560 msgr2=0x7f7d9406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:51.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.367+0000 7f7d99dae640 1 -- 172.21.15.159:0/2711838234 shutdown_connections 2024-07-24T16:36:51.371 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.367+0000 7f7d99dae640 1 -- 172.21.15.159:0/2711838234 wait complete. 2024-07-24T16:36:51.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.368+0000 7f7d99dae640 1 Processor -- start 2024-07-24T16:36:51.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.369+0000 7f7d99dae640 1 -- start start 2024-07-24T16:36:51.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.369+0000 7f7d99dae640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d7c004800 0x7f7d940aa5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:51.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.369+0000 7f7d99dae640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d941f8280 0x7f7d941f4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:51.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.369+0000 7f7d99dae640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7d94158f60 0x7f7d940a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:51.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.369+0000 7f7d99dae640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7d940b4610 con 0x7f7d7c004800 2024-07-24T16:36:51.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.369+0000 7f7d99dae640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7d940b4490 con 0x7f7d941f8280 2024-07-24T16:36:51.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.369+0000 7f7d99dae640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7d9406dae0 con 0x7f7d94158f60 2024-07-24T16:36:51.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.369+0000 7f7d937fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d7c004800 0x7f7d940aa5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:51.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.369+0000 7f7d937fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d7c004800 0x7f7d940aa5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40822/0 (socket says 172.21.15.159:40822) 2024-07-24T16:36:51.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.369+0000 7f7d937fe640 1 -- 172.21.15.159:0/2642954012 learned_addr learned my addr 172.21.15.159:0/2642954012 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:51.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d93fff640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7d94158f60 0x7f7d940a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:51.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d92ffd640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d941f8280 0x7f7d941f4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:51.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d937fe640 1 -- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7d94158f60 msgr2=0x7f7d940a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:51.374 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d937fe640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7d94158f60 0x7f7d940a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d937fe640 1 -- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d941f8280 msgr2=0x7f7d941f4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:51.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d937fe640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d941f8280 0x7f7d941f4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d937fe640 1 -- 172.21.15.159:0/2642954012 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d940aabf0 con 0x7f7d7c004800 2024-07-24T16:36:51.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d93fff640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7d94158f60 0x7f7d940a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:36:51.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d92ffd640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d941f8280 0x7f7d941f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:36:51.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d937fe640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d7c004800 0x7f7d940aa5e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7d84004d60 tx=0x7f7d84001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:51.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d7bfff640 1 -- 172.21.15.159:0/2642954012 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84017070 con 0x7f7d7c004800 2024-07-24T16:36:51.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d7bfff640 1 -- 172.21.15.159:0/2642954012 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d84004e50 con 0x7f7d7c004800 2024-07-24T16:36:51.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d99dae640 1 -- 172.21.15.159:0/2642954012 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d940aaed0 con 0x7f7d7c004800 2024-07-24T16:36:51.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d7bfff640 1 -- 172.21.15.159:0/2642954012 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d84010b00 con 0x7f7d7c004800 2024-07-24T16:36:51.375 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.370+0000 7f7d99dae640 1 -- 172.21.15.159:0/2642954012 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d941f4770 con 0x7f7d7c004800 2024-07-24T16:36:51.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.371+0000 7f7d99dae640 1 -- 172.21.15.159:0/2642954012 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d941f4280 con 0x7f7d7c004800 2024-07-24T16:36:51.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.372+0000 7f7d7bfff640 1 -- 172.21.15.159:0/2642954012 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f7d8401a070 con 0x7f7d7c004800 2024-07-24T16:36:51.376 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.372+0000 7f7d7bfff640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7d80077010 0x7f7d800794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:51.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.372+0000 7f7d7bfff640 1 -- 172.21.15.159:0/2642954012 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6280+0+0 (secure 0 0 0) 0x7f7d840987c0 con 0x7f7d7c004800 2024-07-24T16:36:51.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.373+0000 7f7d92ffd640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7d80077010 0x7f7d800794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:51.377 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.373+0000 7f7d92ffd640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7d80077010 0x7f7d800794d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7d88035000 tx=0x7f7d880046c0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:51.379 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.377+0000 7f7d7bfff640 1 -- 172.21.15.159:0/2642954012 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f7d84061810 con 0x7f7d7c004800 2024-07-24T16:36:51.560 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.558+0000 7f7d99dae640 1 -- 172.21.15.159:0/2642954012 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f7d940b3850 con 0x7f7d7c004800 2024-07-24T16:36:51.564 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.561+0000 7f7d7bfff640 1 -- 172.21.15.159:0/2642954012 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f7d84061110 con 0x7f7d7c004800 2024-07-24T16:36:51.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.563+0000 7f7d99dae640 1 -- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7d80077010 msgr2=0x7f7d800794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:51.566 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.563+0000 7f7d99dae640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7d80077010 0x7f7d800794d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7d88035000 tx=0x7f7d880046c0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.563+0000 7f7d99dae640 1 -- 172.21.15.159:0/2642954012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d7c004800 msgr2=0x7f7d940aa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:51.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.563+0000 7f7d99dae640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d7c004800 0x7f7d940aa5e0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f7d84004d60 tx=0x7f7d84001630 comp rx=0 tx=0).stop 2024-07-24T16:36:51.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.563+0000 7f7d99dae640 1 -- 172.21.15.159:0/2642954012 shutdown_connections 2024-07-24T16:36:51.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.563+0000 7f7d99dae640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7d94158f60 0x7f7d940a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.563+0000 7f7d99dae640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7d941f8280 0x7f7d941f4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.563+0000 7f7d99dae640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7d80077010 0x7f7d800794d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.563+0000 7f7d99dae640 1 --2- 172.21.15.159:0/2642954012 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7d7c004800 0x7f7d940aa5e0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.563+0000 7f7d99dae640 1 -- 172.21.15.159:0/2642954012 >> 172.21.15.159:0/2642954012 conn(0x7f7d9406c560 msgr2=0x7f7d9415c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:51.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.563+0000 7f7d99dae640 1 -- 172.21.15.159:0/2642954012 shutdown_connections 2024-07-24T16:36:51.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.564+0000 7f7d99dae640 1 -- 172.21.15.159:0/2642954012 wait complete. 2024-07-24T16:36:51.577 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-07-24T16:36:51.577 DEBUG:teuthology.orchestra.run.smithi159:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-24T16:36:51.614 DEBUG:teuthology.orchestra.run.smithi193:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-07-24T16:36:51.655 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-07-24T16:36:51.655 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:36:51.655 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:36:51.671 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056071,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20922 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248736k,nr_inodes=812184,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-24T16:36:51.671 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:36:51.671 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:36:51.713 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056073,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497484k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=448 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248740k,nr_inodes=812185,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497484k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-24T16:36:51.714 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:36:51.714 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:36:51.729 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056071,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20922 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248736k,nr_inodes=812184,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-24T16:36:51.729 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:36:51.729 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:36:51.772 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056073,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497484k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=448 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248740k,nr_inodes=812185,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497484k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-24T16:36:51.772 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-07-24T16:36:51.772 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:36:51.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.872+0000 7f1788de8640 1 -- 172.21.15.159:0/2594294023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17840707c0 msgr2=0x7f1784071590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:51.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.872+0000 7f1788de8640 1 --2- 172.21.15.159:0/2594294023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17840707c0 0x7f1784071590 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f176c005fd0 tx=0x7f176c02a4f0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.872+0000 7f1788de8640 1 -- 172.21.15.159:0/2594294023 shutdown_connections 2024-07-24T16:36:51.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.872+0000 7f1788de8640 1 --2- 172.21.15.159:0/2594294023 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17840cf1f0 0x7f1784071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.872+0000 7f1788de8640 1 --2- 172.21.15.159:0/2594294023 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17840707c0 0x7f1784071590 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.872+0000 7f1788de8640 1 --2- 172.21.15.159:0/2594294023 >> v2:172.21.15.193:3300/0 conn(0x7f17840cee10 0x7f17840d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.872+0000 7f1788de8640 1 -- 172.21.15.159:0/2594294023 >> 172.21.15.159:0/2594294023 conn(0x7f17840b36f0 msgr2=0x7f17840b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:51.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.872+0000 7f1788de8640 1 -- 172.21.15.159:0/2594294023 shutdown_connections 2024-07-24T16:36:51.875 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.872+0000 7f1788de8640 1 -- 172.21.15.159:0/2594294023 wait complete. 2024-07-24T16:36:51.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.873+0000 7f1788de8640 1 Processor -- start 2024-07-24T16:36:51.876 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.873+0000 7f1788de8640 1 -- start start 2024-07-24T16:36:51.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.874+0000 7f1788de8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17840707c0 0x7f17841558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:51.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.874+0000 7f1788de8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17840cee10 0x7f17841562b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:51.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.874+0000 7f1788de8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17840cf1f0 0x7f17841e69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:51.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.874+0000 7f1788de8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f178415f4e0 con 0x7f17840cf1f0 2024-07-24T16:36:51.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.874+0000 7f1788de8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f178415f360 con 0x7f17840cee10 2024-07-24T16:36:51.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.874+0000 7f1788de8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f178415f660 con 0x7f17840707c0 2024-07-24T16:36:51.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.874+0000 7f1782d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17840cf1f0 0x7f17841e69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:51.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.874+0000 7f1782d9d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17840cf1f0 0x7f17841e69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40846/0 (socket says 172.21.15.159:40846) 2024-07-24T16:36:51.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.874+0000 7f1782d9d640 1 -- 172.21.15.159:0/1302133805 learned_addr learned my addr 172.21.15.159:0/1302133805 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:51.878 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.875+0000 7f1782d9d640 1 -- 172.21.15.159:0/1302133805 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17840707c0 msgr2=0x7f17841558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:51.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.875+0000 7f1782d9d640 1 --2- 172.21.15.159:0/1302133805 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17840707c0 0x7f17841558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.875+0000 7f1782d9d640 1 -- 172.21.15.159:0/1302133805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17840cee10 msgr2=0x7f17841562b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:51.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.875+0000 7f1782d9d640 1 --2- 172.21.15.159:0/1302133805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17840cee10 0x7f17841562b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:51.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.875+0000 7f1782d9d640 1 -- 172.21.15.159:0/1302133805 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17841e5950 con 0x7f17840cf1f0 2024-07-24T16:36:51.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.875+0000 7f1782d9d640 1 --2- 172.21.15.159:0/1302133805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17840cf1f0 0x7f17841e69f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f177c00e9d0 tx=0x7f177c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:51.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.875+0000 7f177affd640 1 -- 172.21.15.159:0/1302133805 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c00cd80 con 0x7f17840cf1f0 2024-07-24T16:36:51.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.875+0000 7f177affd640 1 -- 172.21.15.159:0/1302133805 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f177c004c30 con 0x7f17840cf1f0 2024-07-24T16:36:51.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.875+0000 7f1788de8640 1 -- 172.21.15.159:0/1302133805 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17841e5c30 con 0x7f17840cf1f0 2024-07-24T16:36:51.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.875+0000 7f177affd640 1 -- 172.21.15.159:0/1302133805 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f177c005280 con 0x7f17840cf1f0 2024-07-24T16:36:51.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.875+0000 7f1788de8640 1 -- 172.21.15.159:0/1302133805 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17841e61f0 con 0x7f17840cf1f0 2024-07-24T16:36:51.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.876+0000 7f1788de8640 1 -- 172.21.15.159:0/1302133805 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f178415eed0 con 0x7f17840cf1f0 2024-07-24T16:36:51.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.877+0000 7f177affd640 1 -- 172.21.15.159:0/1302133805 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f177c005420 con 0x7f17840cf1f0 2024-07-24T16:36:51.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.877+0000 7f177affd640 1 --2- 172.21.15.159:0/1302133805 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1764077010 0x7f17640794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:51.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.877+0000 7f177affd640 1 -- 172.21.15.159:0/1302133805 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 6280+0+0 (secure 0 0 0) 0x7f177c0992c0 con 0x7f17840cf1f0 2024-07-24T16:36:51.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.877+0000 7f178259c640 1 --2- 172.21.15.159:0/1302133805 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1764077010 0x7f17640794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:51.881 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.878+0000 7f178259c640 1 --2- 172.21.15.159:0/1302133805 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1764077010 0x7f17640794d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1774005fd0 tx=0x7f1774005850 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:51.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:51.881+0000 7f177affd640 1 -- 172.21.15.159:0/1302133805 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f178415eed0 con 0x7f17840cf1f0 2024-07-24T16:36:52.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.103+0000 7f1788de8640 1 -- 172.21.15.159:0/1302133805 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17840b6400 con 0x7f17840cf1f0 2024-07-24T16:36:52.106 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.104+0000 7f177affd640 1 -- 172.21.15.159:0/1302133805 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+3920 (secure 0 0 0) 0x7f177c016030 con 0x7f17840cf1f0 2024-07-24T16:36:52.107 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:36:52.107 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":18,"btime":"2024-07-24T16:36:45:202077+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4825,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6835/2383254131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":2383254131},{"type":"v1","addr":"172.21.15.159:6835","nonce":2383254131}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6836/1682765472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":1682765472},{"type":"v1","addr":"172.21.15.193:6836","nonce":1682765472}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":4840,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/306853489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6835","nonce":306853489},{"type":"v1","addr":"172.21.15.193:6837","nonce":306853489}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":5395,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/2225011327","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":2225011327},{"type":"v1","addr":"172.21.15.159:6834","nonce":2225011327}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18}],"filesystems":[]} 2024-07-24T16:36:52.107 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 18 2024-07-24T16:36:52.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.106+0000 7f1788de8640 1 -- 172.21.15.159:0/1302133805 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1764077010 msgr2=0x7f17640794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:52.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.106+0000 7f1788de8640 1 --2- 172.21.15.159:0/1302133805 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1764077010 0x7f17640794d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1774005fd0 tx=0x7f1774005850 comp rx=0 tx=0).stop 2024-07-24T16:36:52.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.106+0000 7f1788de8640 1 -- 172.21.15.159:0/1302133805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17840cf1f0 msgr2=0x7f17841e69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:52.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.106+0000 7f1788de8640 1 --2- 172.21.15.159:0/1302133805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17840cf1f0 0x7f17841e69f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f177c00e9d0 tx=0x7f177c00ee90 comp rx=0 tx=0).stop 2024-07-24T16:36:52.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.106+0000 7f1788de8640 1 -- 172.21.15.159:0/1302133805 shutdown_connections 2024-07-24T16:36:52.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.106+0000 7f1788de8640 1 --2- 172.21.15.159:0/1302133805 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1764077010 0x7f17640794d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:52.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.106+0000 7f1788de8640 1 --2- 172.21.15.159:0/1302133805 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f17840cf1f0 0x7f17841e69f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:52.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.106+0000 7f1788de8640 1 --2- 172.21.15.159:0/1302133805 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f17840cee10 0x7f17841562b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:52.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.106+0000 7f1788de8640 1 --2- 172.21.15.159:0/1302133805 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f17840707c0 0x7f17841558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:52.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.106+0000 7f1788de8640 1 -- 172.21.15.159:0/1302133805 >> 172.21.15.159:0/1302133805 conn(0x7f17840b36f0 msgr2=0x7f17840b2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:52.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.106+0000 7f1788de8640 1 -- 172.21.15.159:0/1302133805 shutdown_connections 2024-07-24T16:36:52.109 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:52.106+0000 7f1788de8640 1 -- 172.21.15.159:0/1302133805 wait complete. 2024-07-24T16:36:52.120 INFO:tasks.ceph.mds.a:Restarting daemon 2024-07-24T16:36:52.120 INFO:tasks.ceph.mds.a:Stopping old one... 2024-07-24T16:36:52.120 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-07-24T16:36:52.120 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:36:52.120 INFO:tasks.ceph.mds.c:Restarting daemon 2024-07-24T16:36:52.121 INFO:tasks.ceph.mds.c:Stopping old one... 2024-07-24T16:36:52.121 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-07-24T16:36:52.121 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:36:52.121 INFO:tasks.ceph.mds.b:Restarting daemon 2024-07-24T16:36:52.121 INFO:tasks.ceph.mds.b:Stopping old one... 2024-07-24T16:36:52.121 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-07-24T16:36:52.121 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:36:52.122 INFO:tasks.ceph.mds.d:Restarting daemon 2024-07-24T16:36:52.122 INFO:tasks.ceph.mds.d:Stopping old one... 2024-07-24T16:36:52.122 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-07-24T16:36:52.122 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:36:52.129 INFO:tasks.ceph.mds.a:Stopped 2024-07-24T16:36:52.129 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-07-24T16:36:52.130 INFO:tasks.ceph.mds.c:Stopped 2024-07-24T16:36:52.130 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-07-24T16:36:52.134 INFO:tasks.ceph.mds.b:Stopped 2024-07-24T16:36:52.134 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-07-24T16:36:52.172 INFO:tasks.ceph.mds.a:Started 2024-07-24T16:36:52.172 DEBUG:teuthology.parallel:result is None 2024-07-24T16:36:52.172 INFO:tasks.ceph.mds.c:Started 2024-07-24T16:36:52.172 DEBUG:teuthology.parallel:result is None 2024-07-24T16:36:52.176 INFO:tasks.ceph.mds.b:Started 2024-07-24T16:36:52.177 DEBUG:teuthology.parallel:result is None 2024-07-24T16:36:52.245 INFO:tasks.ceph.mds.a.smithi159.stdout:starting mds.a at 2024-07-24T16:36:52.245 INFO:tasks.ceph.mds.c.smithi159.stdout:starting mds.c at 2024-07-24T16:36:52.246 INFO:tasks.ceph.mds.a.smithi159.stderr:2024-07-24T16:36:52.243+0000 7f0ec7547640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2024-07-24T16:36:52.257 INFO:tasks.ceph.mds.b.smithi193.stdout:starting mds.b at 2024-07-24T16:36:57.421 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-07-24T16:36:58.134 INFO:tasks.ceph.mds.d:Stopped 2024-07-24T16:36:58.135 DEBUG:teuthology.orchestra.run.smithi193:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-07-24T16:36:58.138 INFO:tasks.ceph.mds.d:Started 2024-07-24T16:36:58.138 DEBUG:teuthology.parallel:result is None 2024-07-24T16:36:58.138 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-07-24T16:36:58.222 INFO:tasks.ceph.mds.d.smithi193.stdout:starting mds.d at 2024-07-24T16:36:58.254 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.252+0000 7f18614a9640 1 -- 172.21.15.159:0/4114590840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f185c0707c0 msgr2=0x7f185c071590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.252+0000 7f18614a9640 1 --2- 172.21.15.159:0/4114590840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f185c0707c0 0x7f185c071590 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f1844005fd0 tx=0x7f184402a4f0 comp rx=0 tx=0).stop 2024-07-24T16:36:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.252+0000 7f18614a9640 1 -- 172.21.15.159:0/4114590840 shutdown_connections 2024-07-24T16:36:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.252+0000 7f18614a9640 1 --2- 172.21.15.159:0/4114590840 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f185c0cf1f0 0x7f185c071ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.252+0000 7f18614a9640 1 --2- 172.21.15.159:0/4114590840 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f185c0707c0 0x7f185c071590 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.252+0000 7f18614a9640 1 --2- 172.21.15.159:0/4114590840 >> v2:172.21.15.193:3300/0 conn(0x7f185c0cee10 0x7f185c0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.252+0000 7f18614a9640 1 -- 172.21.15.159:0/4114590840 >> 172.21.15.159:0/4114590840 conn(0x7f185c0b36f0 msgr2=0x7f185c0b3ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.252+0000 7f18614a9640 1 -- 172.21.15.159:0/4114590840 shutdown_connections 2024-07-24T16:36:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.252+0000 7f18614a9640 1 -- 172.21.15.159:0/4114590840 wait complete. 2024-07-24T16:36:58.255 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.253+0000 7f18614a9640 1 Processor -- start 2024-07-24T16:36:58.256 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.253+0000 7f18614a9640 1 -- start start 2024-07-24T16:36:58.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f18614a9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f185c0707c0 0x7f185c148090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:58.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f18614a9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f185c0cee10 0x7f185c154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:58.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f18614a9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f185c0cf1f0 0x7f185c155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:58.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f18614a9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f185c15f4e0 con 0x7f185c0cf1f0 2024-07-24T16:36:58.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f18614a9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f185c15f360 con 0x7f185c0707c0 2024-07-24T16:36:58.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f18614a9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f185c15f660 con 0x7f185c0cee10 2024-07-24T16:36:58.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f185b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f185c0cf1f0 0x7f185c155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:58.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f185b7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f185c0cf1f0 0x7f185c155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40906/0 (socket says 172.21.15.159:40906) 2024-07-24T16:36:58.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f185b7fe640 1 -- 172.21.15.159:0/2297152867 learned_addr learned my addr 172.21.15.159:0/2297152867 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:36:58.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f185affd640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f185c0707c0 0x7f185c148090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:58.258 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f18527fc640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f185c0cee10 0x7f185c154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:58.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f185b7fe640 1 -- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f185c0cee10 msgr2=0x7f185c154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:58.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f185b7fe640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f185c0cee10 0x7f185c154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:58.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f185b7fe640 1 -- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f185c0707c0 msgr2=0x7f185c148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:58.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f185b7fe640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f185c0707c0 0x7f185c148090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:58.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f185b7fe640 1 -- 172.21.15.159:0/2297152867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f185c1f6a50 con 0x7f185c0cf1f0 2024-07-24T16:36:58.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.254+0000 7f185affd640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f185c0707c0 0x7f185c148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:36:58.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.255+0000 7f185b7fe640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f185c0cf1f0 0x7f185c155300 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f185400ccb0 tx=0x7f185400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:58.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.255+0000 7f1853fff640 1 -- 172.21.15.159:0/2297152867 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185400f450 con 0x7f185c0cf1f0 2024-07-24T16:36:58.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.255+0000 7f1853fff640 1 -- 172.21.15.159:0/2297152867 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f185400f700 con 0x7f185c0cf1f0 2024-07-24T16:36:58.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.255+0000 7f1853fff640 1 -- 172.21.15.159:0/2297152867 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f185400fb90 con 0x7f185c0cf1f0 2024-07-24T16:36:58.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.255+0000 7f18614a9640 1 -- 172.21.15.159:0/2297152867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f185c1f5c90 con 0x7f185c0cf1f0 2024-07-24T16:36:58.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.255+0000 7f18614a9640 1 -- 172.21.15.159:0/2297152867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f185c1f6250 con 0x7f185c0cf1f0 2024-07-24T16:36:58.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.256+0000 7f18614a9640 1 -- 172.21.15.159:0/2297152867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f185c0d08a0 con 0x7f185c0cf1f0 2024-07-24T16:36:58.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.256+0000 7f1853fff640 1 -- 172.21.15.159:0/2297152867 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f18540213f0 con 0x7f185c0cf1f0 2024-07-24T16:36:58.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.257+0000 7f1853fff640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f183c077040 0x7f183c079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:36:58.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.257+0000 7f1853fff640 1 -- 172.21.15.159:0/2297152867 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6280+0+0 (secure 0 0 0) 0x7f18540994c0 con 0x7f185c0cf1f0 2024-07-24T16:36:58.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.257+0000 7f185affd640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f183c077040 0x7f183c079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:36:58.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.258+0000 7f185affd640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f183c077040 0x7f183c079500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f185c15e970 tx=0x7f184c005db0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:36:58.263 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.261+0000 7f1853fff640 1 -- 172.21.15.159:0/2297152867 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f1854014030 con 0x7f185c0cf1f0 2024-07-24T16:36:58.459 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:58.456+0000 7f18614a9640 1 -- 172.21.15.159:0/2297152867 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f185c0b2c90 con 0x7f185c0cf1f0 2024-07-24T16:36:59.962 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:59.959+0000 7f1853fff640 1 -- 172.21.15.159:0/2297152867 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) ==== 97+0+0 (secure 0 0 0) 0x7f18540625a0 con 0x7f185c0cf1f0 2024-07-24T16:36:59.962 INFO:teuthology.orchestra.run.smithi159.stderr: removed all blocklist entries 2024-07-24T16:36:59.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:59.962+0000 7f18614a9640 1 -- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f183c077040 msgr2=0x7f183c079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:59.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:59.962+0000 7f18614a9640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f183c077040 0x7f183c079500 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f185c15e970 tx=0x7f184c005db0 comp rx=0 tx=0).stop 2024-07-24T16:36:59.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:59.962+0000 7f18614a9640 1 -- 172.21.15.159:0/2297152867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f185c0cf1f0 msgr2=0x7f185c155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:36:59.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:59.962+0000 7f18614a9640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f185c0cf1f0 0x7f185c155300 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f185400ccb0 tx=0x7f185400a620 comp rx=0 tx=0).stop 2024-07-24T16:36:59.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:59.962+0000 7f18614a9640 1 -- 172.21.15.159:0/2297152867 shutdown_connections 2024-07-24T16:36:59.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:59.962+0000 7f18614a9640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f183c077040 0x7f183c079500 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:59.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:59.962+0000 7f18614a9640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f185c0cf1f0 0x7f185c155300 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:59.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:59.962+0000 7f18614a9640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f185c0cee10 0x7f185c154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:59.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:59.962+0000 7f18614a9640 1 --2- 172.21.15.159:0/2297152867 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f185c0707c0 0x7f185c148090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:36:59.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:59.962+0000 7f18614a9640 1 -- 172.21.15.159:0/2297152867 >> 172.21.15.159:0/2297152867 conn(0x7f185c0b36f0 msgr2=0x7f185c0b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:36:59.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:59.962+0000 7f18614a9640 1 -- 172.21.15.159:0/2297152867 shutdown_connections 2024-07-24T16:36:59.965 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:36:59.962+0000 7f18614a9640 1 -- 172.21.15.159:0/2297152867 wait complete. 2024-07-24T16:36:59.979 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-07-24T16:37:00.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.087+0000 7f79ba811640 1 -- 172.21.15.159:0/1764859211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79a0003a00 msgr2=0x7f79a0003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:00.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.087+0000 7f79ba811640 1 --2- 172.21.15.159:0/1764859211 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79a0003a00 0x7f79a0003e40 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c4a0 tx=0x7f79a0005830 comp rx=0 tx=0).stop 2024-07-24T16:37:00.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.087+0000 7f79b8dae640 1 -- 172.21.15.159:0/1764859211 reap_dead start 2024-07-24T16:37:00.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.087+0000 7f79ba811640 1 -- 172.21.15.159:0/1764859211 shutdown_connections 2024-07-24T16:37:00.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.087+0000 7f79ba811640 1 -- 172.21.15.159:0/1764859211 >> 172.21.15.159:0/1764859211 conn(0x7f79b406c560 msgr2=0x7f79b406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:00.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.087+0000 7f79ba811640 1 -- 172.21.15.159:0/1764859211 shutdown_connections 2024-07-24T16:37:00.090 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.087+0000 7f79ba811640 1 -- 172.21.15.159:0/1764859211 wait complete. 2024-07-24T16:37:00.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.088+0000 7f79ba811640 1 Processor -- start 2024-07-24T16:37:00.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.088+0000 7f79ba811640 1 -- start start 2024-07-24T16:37:00.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79ba811640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79a0003a00 0x7f79b4156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:00.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79ba811640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79b41e5f50 0x7f79b40a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:00.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79ba811640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79b40a99c0 0x7f79b4155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:00.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79ba811640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f79b40b4560 con 0x7f79a0003a00 2024-07-24T16:37:00.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79ba811640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f79b40b43e0 con 0x7f79b41e5f50 2024-07-24T16:37:00.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79ba811640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f79b40b46e0 con 0x7f79b40a99c0 2024-07-24T16:37:00.093 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79b3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79a0003a00 0x7f79b4156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:00.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79b3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79a0003a00 0x7f79b4156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40928/0 (socket says 172.21.15.159:40928) 2024-07-24T16:37:00.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79b3fff640 1 -- 172.21.15.159:0/907198675 learned_addr learned my addr 172.21.15.159:0/907198675 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:00.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79b8dae640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79b40a99c0 0x7f79b4155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:00.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79abfff640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79b41e5f50 0x7f79b40a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:00.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79b3fff640 1 -- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79b40a99c0 msgr2=0x7f79b4155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:00.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79b3fff640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79b40a99c0 0x7f79b4155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79b3fff640 1 -- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79b41e5f50 msgr2=0x7f79b40a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:00.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79b3fff640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79b41e5f50 0x7f79b40a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79b3fff640 1 -- 172.21.15.159:0/907198675 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b41f8600 con 0x7f79a0003a00 2024-07-24T16:37:00.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79abfff640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79b41e5f50 0x7f79b40a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:37:00.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.089+0000 7f79b3fff640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79a0003a00 0x7f79b4156b20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c590 tx=0x7f79a40012f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:00.094 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.090+0000 7f79b17fa640 1 -- 172.21.15.159:0/907198675 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a40064f0 con 0x7f79a0003a00 2024-07-24T16:37:00.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.090+0000 7f79b17fa640 1 -- 172.21.15.159:0/907198675 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79a402b660 con 0x7f79a0003a00 2024-07-24T16:37:00.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.090+0000 7f79ba811640 1 -- 172.21.15.159:0/907198675 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b41f7a80 con 0x7f79a0003a00 2024-07-24T16:37:00.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.090+0000 7f79b17fa640 1 -- 172.21.15.159:0/907198675 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a402bab0 con 0x7f79a0003a00 2024-07-24T16:37:00.095 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.090+0000 7f79ba811640 1 -- 172.21.15.159:0/907198675 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b41f8040 con 0x7f79a0003a00 2024-07-24T16:37:00.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.091+0000 7f79ba811640 1 -- 172.21.15.159:0/907198675 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b40cf8c0 con 0x7f79a0003a00 2024-07-24T16:37:00.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.091+0000 7f79b17fa640 1 -- 172.21.15.159:0/907198675 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f79a402bc50 con 0x7f79a0003a00 2024-07-24T16:37:00.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.092+0000 7f79b17fa640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7994077040 0x7f7994079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:00.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.092+0000 7f79b17fa640 1 -- 172.21.15.159:0/907198675 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5549+0+0 (secure 0 0 0) 0x7f79a40b8620 con 0x7f79a0003a00 2024-07-24T16:37:00.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.092+0000 7f79abfff640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7994077040 0x7f7994079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:00.096 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.092+0000 7f79abfff640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7994077040 0x7f7994079500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79b41e69f0 tx=0x7f799c005f90 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:00.098 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.096+0000 7f79b17fa640 1 -- 172.21.15.159:0/907198675 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f79b415b1e0 con 0x7f79a0003a00 2024-07-24T16:37:00.356 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.354+0000 7f79ba811640 1 -- 172.21.15.159:0/907198675 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f79b40a9da0 con 0x7f79a0003a00 2024-07-24T16:37:00.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.354+0000 7f79b17fa640 1 -- 172.21.15.159:0/907198675 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f79a40819b0 con 0x7f79a0003a00 2024-07-24T16:37:00.357 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:37:00.357 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:37:00.357 INFO:teuthology.orchestra.run.smithi159.stdout: "auth_dump": [ 2024-07-24T16:37:00.357 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.357 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "mds.a", 2024-07-24T16:37:00.357 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFm5KfHFhAAY2Za2E4Gx30qtxlasNyN8A==", 2024-07-24T16:37:00.357 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.357 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:37:00.357 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow *", 2024-07-24T16:37:00.358 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow *", 2024-07-24T16:37:00.358 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.358 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.358 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.358 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.358 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "mds.b", 2024-07-24T16:37:00.358 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFmDIh+IhAA+PC+rx36kT5DRJA9ME7ZoA==", 2024-07-24T16:37:00.358 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.358 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:37:00.358 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow *", 2024-07-24T16:37:00.358 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow *", 2024-07-24T16:37:00.358 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.359 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.359 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.359 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "mds.c", 2024-07-24T16:37:00.359 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFmEsnMHRAAb3Hsgjo+OSBszRC2eA4QAw==", 2024-07-24T16:37:00.359 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.359 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:37:00.359 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow *", 2024-07-24T16:37:00.359 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow *", 2024-07-24T16:37:00.359 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.359 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.359 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.359 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "mds.d", 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFmwVuGKRAAd1JqAKzMFph6sn3NsEKNKQ==", 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow *", 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow *", 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.0", 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQB0KqFmKfM9DxAADINqtpam4FeXnyDKqdKo8w==", 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.360 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:37:00.361 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:37:00.361 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.361 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.361 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.361 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.1", 2024-07-24T16:37:00.361 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQB3KqFmVrnhDRAAIqQelAm1HZgnifSROfOC3w==", 2024-07-24T16:37:00.361 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.361 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:37:00.361 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:37:00.361 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.361 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.361 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.362 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.362 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.2", 2024-07-24T16:37:00.362 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQB6KqFm1MyIDBAAduCyQkJJflqiatmZQnFojA==", 2024-07-24T16:37:00.362 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.362 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:37:00.362 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:37:00.362 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.362 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.362 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.362 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.362 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.3", 2024-07-24T16:37:00.362 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQB9KqFm+jV/CxAAhB1z7oYLJ5G5A19FyCxzoQ==", 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.4", 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCDKqFmRXzWEBAAcOfwJxUM0QqEhMQZJq2ttQ==", 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.363 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.5", 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCGKqFmvf7LDhAATDjsR+93NeLyzFgkMtlkIg==", 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.6", 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCJKqFm79FbDBAAvQ7mougCMteNRU0ZYhPDtw==", 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.364 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:37:00.365 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:37:00.365 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.365 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.365 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.365 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "osd.7", 2024-07-24T16:37:00.365 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQCMKqFm1kpRCxAAy674XU+yH6FDhRtEA6bQfw==", 2024-07-24T16:37:00.365 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.365 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow profile osd", 2024-07-24T16:37:00.365 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile osd", 2024-07-24T16:37:00.365 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.365 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.365 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.366 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.0", 2024-07-24T16:37:00.366 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFmSByWLRAAlc1hHDXFceGP9BYk8GpZJA==", 2024-07-24T16:37:00.366 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.366 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:37:00.366 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow r", 2024-07-24T16:37:00.366 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-07-24T16:37:00.366 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.366 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.366 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.366 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.1", 2024-07-24T16:37:00.366 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFmLnZUNhAADbBfaqZTiBxwXvsI/8Oetw==", 2024-07-24T16:37:00.366 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow r", 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow rw", 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow rwx" 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.2", 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFma6ElMxAAkFEc8XeYlEJfuiT5W/bnig==", 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow r", 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow rw", 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow rwx" 2024-07-24T16:37:00.367 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.3", 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBxKqFmWh5PABAAZbCzsIQ1u3ryno6wsxLHaw==", 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow", 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow r", 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow rw", 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow rwx" 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "client.admin", 2024-07-24T16:37:00.368 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBvKqFm0xQtNhAAd/lL8RpL+GWOV/8U74gvyw==", 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow *", 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: "mgr": "allow *", 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow *", 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "mgr.x", 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFm5PSOExAAiVy9cpsNzzUXYeHA2ObdMQ==", 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow *", 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile mgr", 2024-07-24T16:37:00.369 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.370 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.370 INFO:teuthology.orchestra.run.smithi159.stdout: }, 2024-07-24T16:37:00.370 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.370 INFO:teuthology.orchestra.run.smithi159.stdout: "entity": "mgr.y", 2024-07-24T16:37:00.370 INFO:teuthology.orchestra.run.smithi159.stdout: "key": "AQBwKqFmKFxUDxAAiFTz+i9lmpUGmYQLBlNfLg==", 2024-07-24T16:37:00.370 INFO:teuthology.orchestra.run.smithi159.stdout: "caps": { 2024-07-24T16:37:00.370 INFO:teuthology.orchestra.run.smithi159.stdout: "mds": "allow *", 2024-07-24T16:37:00.370 INFO:teuthology.orchestra.run.smithi159.stdout: "mon": "allow profile mgr", 2024-07-24T16:37:00.370 INFO:teuthology.orchestra.run.smithi159.stdout: "osd": "allow *" 2024-07-24T16:37:00.370 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.370 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.370 INFO:teuthology.orchestra.run.smithi159.stdout: ] 2024-07-24T16:37:00.370 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:37:00.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.356+0000 7f79ba811640 1 -- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7994077040 msgr2=0x7f7994079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:00.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.357+0000 7f79ba811640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7994077040 0x7f7994079500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f79b41e69f0 tx=0x7f799c005f90 comp rx=0 tx=0).stop 2024-07-24T16:37:00.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.357+0000 7f79ba811640 1 -- 172.21.15.159:0/907198675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79a0003a00 msgr2=0x7f79b4156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:00.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.357+0000 7f79ba811640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79a0003a00 0x7f79b4156b20 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f79a400c590 tx=0x7f79a40012f0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.357+0000 7f79ba811640 1 -- 172.21.15.159:0/907198675 shutdown_connections 2024-07-24T16:37:00.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.357+0000 7f79ba811640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f79b40a99c0 0x7f79b4155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.372 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.357+0000 7f79ba811640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f79b41e5f50 0x7f79b40a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.357+0000 7f79ba811640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7994077040 0x7f7994079500 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.357+0000 7f79ba811640 1 --2- 172.21.15.159:0/907198675 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f79a0003a00 0x7f79b4156b20 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.357+0000 7f79ba811640 1 -- 172.21.15.159:0/907198675 >> 172.21.15.159:0/907198675 conn(0x7f79b406c560 msgr2=0x7f79b414f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:00.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.357+0000 7f79ba811640 1 -- 172.21.15.159:0/907198675 shutdown_connections 2024-07-24T16:37:00.373 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.357+0000 7f79ba811640 1 -- 172.21.15.159:0/907198675 wait complete. 2024-07-24T16:37:00.373 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-07-24T16:37:00.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.474+0000 7efd3d70c640 1 -- 172.21.15.159:0/1572375310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd380b2ae0 msgr2=0x7efd38161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:00.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.474+0000 7efd3d70c640 1 --2- 172.21.15.159:0/1572375310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd380b2ae0 0x7efd38161f20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7efd2c005fd0 tx=0x7efd2c02a660 comp rx=0 tx=0).stop 2024-07-24T16:37:00.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.474+0000 7efd3d70c640 1 -- 172.21.15.159:0/1572375310 shutdown_connections 2024-07-24T16:37:00.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.474+0000 7efd3d70c640 1 --2- 172.21.15.159:0/1572375310 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd380cf770 0x7efd380cfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.474+0000 7efd3d70c640 1 --2- 172.21.15.159:0/1572375310 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd380b2ae0 0x7efd38161f20 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.474+0000 7efd3d70c640 1 -- 172.21.15.159:0/1572375310 >> 172.21.15.159:0/1572375310 conn(0x7efd3809cd30 msgr2=0x7efd380d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:00.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.474+0000 7efd3d70c640 1 -- 172.21.15.159:0/1572375310 shutdown_connections 2024-07-24T16:37:00.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.474+0000 7efd3d70c640 1 -- 172.21.15.159:0/1572375310 wait complete. 2024-07-24T16:37:00.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.475+0000 7efd3d70c640 1 Processor -- start 2024-07-24T16:37:00.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.475+0000 7efd3d70c640 1 -- start start 2024-07-24T16:37:00.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd3d70c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd380b2ae0 0x7efd381577f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:00.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd3d70c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd380cf770 0x7efd381f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:00.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd3d70c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd3815d950 0x7efd380c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:00.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd3d70c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7efd380d0460 con 0x7efd380b2ae0 2024-07-24T16:37:00.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd3d70c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7efd380d02e0 con 0x7efd380cf770 2024-07-24T16:37:00.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd3d70c640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7efd380d05e0 con 0x7efd3815d950 2024-07-24T16:37:00.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd36ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd380b2ae0 0x7efd381577f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:00.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd36ffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd380b2ae0 0x7efd381577f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40938/0 (socket says 172.21.15.159:40938) 2024-07-24T16:37:00.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd36ffd640 1 -- 172.21.15.159:0/2604585436 learned_addr learned my addr 172.21.15.159:0/2604585436 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:00.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd377fe640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd3815d950 0x7efd380c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:00.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd367fc640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd380cf770 0x7efd381f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:00.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd36ffd640 1 -- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd3815d950 msgr2=0x7efd380c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:00.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd36ffd640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd3815d950 0x7efd380c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd36ffd640 1 -- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd380cf770 msgr2=0x7efd381f3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:00.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd36ffd640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd380cf770 0x7efd381f3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.476+0000 7efd36ffd640 1 -- 172.21.15.159:0/2604585436 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd38157380 con 0x7efd380b2ae0 2024-07-24T16:37:00.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.477+0000 7efd36ffd640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd380b2ae0 0x7efd381577f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efd2800c3c0 tx=0x7efd2800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:00.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.477+0000 7efd1f7fe640 1 -- 172.21.15.159:0/2604585436 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28017070 con 0x7efd380b2ae0 2024-07-24T16:37:00.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.477+0000 7efd1f7fe640 1 -- 172.21.15.159:0/2604585436 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd280035f0 con 0x7efd380b2ae0 2024-07-24T16:37:00.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.477+0000 7efd3d70c640 1 -- 172.21.15.159:0/2604585436 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd38156660 con 0x7efd380b2ae0 2024-07-24T16:37:00.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.477+0000 7efd1f7fe640 1 -- 172.21.15.159:0/2604585436 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd28003a80 con 0x7efd380b2ae0 2024-07-24T16:37:00.483 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.477+0000 7efd3d70c640 1 -- 172.21.15.159:0/2604585436 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd38156c20 con 0x7efd380b2ae0 2024-07-24T16:37:00.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.478+0000 7efd3d70c640 1 -- 172.21.15.159:0/2604585436 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd380d2d20 con 0x7efd380b2ae0 2024-07-24T16:37:00.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.478+0000 7efd1f7fe640 1 -- 172.21.15.159:0/2604585436 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7efd2801a070 con 0x7efd380b2ae0 2024-07-24T16:37:00.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.479+0000 7efd1f7fe640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7efd24077010 0x7efd240794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:00.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.479+0000 7efd1f7fe640 1 -- 172.21.15.159:0/2604585436 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5549+0+0 (secure 0 0 0) 0x7efd28097ba0 con 0x7efd380b2ae0 2024-07-24T16:37:00.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.479+0000 7efd367fc640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7efd24077010 0x7efd240794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:00.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.480+0000 7efd367fc640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7efd24077010 0x7efd240794d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd2c033000 tx=0x7efd2c004730 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:00.485 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.483+0000 7efd1f7fe640 1 -- 172.21.15.159:0/2604585436 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7efd380d2d20 con 0x7efd380b2ae0 2024-07-24T16:37:00.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.667+0000 7efd3d70c640 1 -- 172.21.15.159:0/2604585436 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7efd380d0a90 con 0x7efd380b2ae0 2024-07-24T16:37:00.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.667+0000 7efd1f7fe640 1 -- 172.21.15.159:0/2604585436 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) ==== 84+0+65 (secure 0 0 0) 0x7efd28060ed0 con 0x7efd380b2ae0 2024-07-24T16:37:00.670 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:37:00.670 INFO:teuthology.orchestra.run.smithi159.stdout:[ 2024-07-24T16:37:00.670 INFO:teuthology.orchestra.run.smithi159.stdout: { 2024-07-24T16:37:00.670 INFO:teuthology.orchestra.run.smithi159.stdout: "poolnum": 1, 2024-07-24T16:37:00.670 INFO:teuthology.orchestra.run.smithi159.stdout: "poolname": ".mgr" 2024-07-24T16:37:00.670 INFO:teuthology.orchestra.run.smithi159.stdout: } 2024-07-24T16:37:00.670 INFO:teuthology.orchestra.run.smithi159.stdout:] 2024-07-24T16:37:00.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.669+0000 7efd3d70c640 1 -- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7efd24077010 msgr2=0x7efd240794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:00.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.669+0000 7efd3d70c640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7efd24077010 0x7efd240794d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efd2c033000 tx=0x7efd2c004730 comp rx=0 tx=0).stop 2024-07-24T16:37:00.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.669+0000 7efd3d70c640 1 -- 172.21.15.159:0/2604585436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd380b2ae0 msgr2=0x7efd381577f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:00.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.669+0000 7efd3d70c640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd380b2ae0 0x7efd381577f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7efd2800c3c0 tx=0x7efd2800c880 comp rx=0 tx=0).stop 2024-07-24T16:37:00.672 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.670+0000 7efd3d70c640 1 -- 172.21.15.159:0/2604585436 shutdown_connections 2024-07-24T16:37:00.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.670+0000 7efd3d70c640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7efd3815d950 0x7efd380c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.670+0000 7efd3d70c640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7efd380cf770 0x7efd381f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.670+0000 7efd3d70c640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7efd24077010 0x7efd240794d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.670+0000 7efd3d70c640 1 --2- 172.21.15.159:0/2604585436 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7efd380b2ae0 0x7efd381577f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.670+0000 7efd3d70c640 1 -- 172.21.15.159:0/2604585436 >> 172.21.15.159:0/2604585436 conn(0x7efd3809cd30 msgr2=0x7efd380b6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:00.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.670+0000 7efd3d70c640 1 -- 172.21.15.159:0/2604585436 shutdown_connections 2024-07-24T16:37:00.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.670+0000 7efd3d70c640 1 -- 172.21.15.159:0/2604585436 wait complete. 2024-07-24T16:37:00.683 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-07-24T16:37:00.683 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-07-24T16:37:00.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.789+0000 7ff3d71ec640 1 -- 172.21.15.159:0/1682218466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3b8003a30 msgr2=0x7ff3b8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:00.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.789+0000 7ff3d71ec640 1 --2- 172.21.15.159:0/1682218466 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3b8003a30 0x7ff3b8003e50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0006fd0 tx=0x7ff3b8005830 comp rx=0 tx=0).stop 2024-07-24T16:37:00.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.789+0000 7ff3d5789640 1 -- 172.21.15.159:0/1682218466 reap_dead start 2024-07-24T16:37:00.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.789+0000 7ff3d71ec640 1 -- 172.21.15.159:0/1682218466 shutdown_connections 2024-07-24T16:37:00.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.789+0000 7ff3d71ec640 1 -- 172.21.15.159:0/1682218466 >> 172.21.15.159:0/1682218466 conn(0x7ff3d006da90 msgr2=0x7ff3d006dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:00.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.789+0000 7ff3d71ec640 1 -- 172.21.15.159:0/1682218466 shutdown_connections 2024-07-24T16:37:00.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.789+0000 7ff3d71ec640 1 -- 172.21.15.159:0/1682218466 wait complete. 2024-07-24T16:37:00.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.790+0000 7ff3d71ec640 1 Processor -- start 2024-07-24T16:37:00.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.790+0000 7ff3d71ec640 1 -- start start 2024-07-24T16:37:00.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.791+0000 7ff3d71ec640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff3b8003a30 0x7ff3d01f46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:00.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.791+0000 7ff3d71ec640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3d0151ea0 0x7ff3d01515f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:00.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.791+0000 7ff3d71ec640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d0156ef0 0x7ff3d0157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:00.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.791+0000 7ff3d71ec640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d00739a0 con 0x7ff3d0156ef0 2024-07-24T16:37:00.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.791+0000 7ff3d71ec640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7ff3d0073820 con 0x7ff3d0151ea0 2024-07-24T16:37:00.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.791+0000 7ff3d71ec640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7ff3d006eb50 con 0x7ff3b8003a30 2024-07-24T16:37:00.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.791+0000 7ff3d5789640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d0156ef0 0x7ff3d0157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:00.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3d5789640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d0156ef0 0x7ff3d0157370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:40954/0 (socket says 172.21.15.159:40954) 2024-07-24T16:37:00.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3d5789640 1 -- 172.21.15.159:0/3841896874 learned_addr learned my addr 172.21.15.159:0/3841896874 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:00.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3d4f88640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff3b8003a30 0x7ff3d01f46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:00.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3cffff640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3d0151ea0 0x7ff3d01515f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:00.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3d5789640 1 -- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff3b8003a30 msgr2=0x7ff3d01f46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:00.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3d5789640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff3b8003a30 0x7ff3d01f46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3d5789640 1 -- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3d0151ea0 msgr2=0x7ff3d01515f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:00.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3d5789640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3d0151ea0 0x7ff3d01515f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:00.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3d5789640 1 -- 172.21.15.159:0/3841896874 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3d00a9480 con 0x7ff3d0156ef0 2024-07-24T16:37:00.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3cffff640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3d0151ea0 0x7ff3d01515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:37:00.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3d5789640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d0156ef0 0x7ff3d0157370 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8005fd0 tx=0x7ff3c8010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:00.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3cd7fa640 1 -- 172.21.15.159:0/3841896874 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8003970 con 0x7ff3d0156ef0 2024-07-24T16:37:00.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3cd7fa640 1 -- 172.21.15.159:0/3841896874 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3c8015070 con 0x7ff3d0156ef0 2024-07-24T16:37:00.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3d71ec640 1 -- 172.21.15.159:0/3841896874 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3d01f4f30 con 0x7ff3d0156ef0 2024-07-24T16:37:00.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3cd7fa640 1 -- 172.21.15.159:0/3841896874 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3c8004030 con 0x7ff3d0156ef0 2024-07-24T16:37:00.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.792+0000 7ff3d71ec640 1 -- 172.21.15.159:0/3841896874 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3d01f54f0 con 0x7ff3d0156ef0 2024-07-24T16:37:00.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.793+0000 7ff3d71ec640 1 -- 172.21.15.159:0/3841896874 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3d00b4000 con 0x7ff3d0156ef0 2024-07-24T16:37:00.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.794+0000 7ff3cd7fa640 1 -- 172.21.15.159:0/3841896874 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7ff3c80041d0 con 0x7ff3d0156ef0 2024-07-24T16:37:00.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.794+0000 7ff3cd7fa640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7ff3bc077040 0x7ff3bc079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:00.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.794+0000 7ff3cd7fa640 1 -- 172.21.15.159:0/3841896874 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5549+0+0 (secure 0 0 0) 0x7ff3c8099280 con 0x7ff3d0156ef0 2024-07-24T16:37:00.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.795+0000 7ff3d4f88640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7ff3bc077040 0x7ff3bc079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:00.798 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.795+0000 7ff3d4f88640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7ff3bc077040 0x7ff3bc079500 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0033000 tx=0x7ff3d015b4e0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:00.801 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.798+0000 7ff3cd7fa640 1 -- 172.21.15.159:0/3841896874 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7ff3c80625b0 con 0x7ff3d0156ef0 2024-07-24T16:37:00.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:00.982+0000 7ff3d71ec640 1 -- 172.21.15.159:0/3841896874 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff3d006e180 con 0x7ff3d0156ef0 2024-07-24T16:37:01.977 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:01.974+0000 7ff3cd7fa640 1 -- 172.21.15.159:0/3841896874 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) ==== 138+0+0 (secure 0 0 0) 0x7ff3c8061eb0 con 0x7ff3d0156ef0 2024-07-24T16:37:01.977 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_metadata' created 2024-07-24T16:37:01.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:01.979+0000 7ff3d71ec640 1 -- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7ff3bc077040 msgr2=0x7ff3bc079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:01.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:01.979+0000 7ff3d71ec640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7ff3bc077040 0x7ff3bc079500 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff3c0033000 tx=0x7ff3d015b4e0 comp rx=0 tx=0).stop 2024-07-24T16:37:01.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:01.979+0000 7ff3d71ec640 1 -- 172.21.15.159:0/3841896874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d0156ef0 msgr2=0x7ff3d0157370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:01.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:01.979+0000 7ff3d71ec640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d0156ef0 0x7ff3d0157370 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7ff3c8005fd0 tx=0x7ff3c8010f40 comp rx=0 tx=0).stop 2024-07-24T16:37:01.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:01.980+0000 7ff3d71ec640 1 -- 172.21.15.159:0/3841896874 shutdown_connections 2024-07-24T16:37:01.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:01.980+0000 7ff3d71ec640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7ff3bc077040 0x7ff3bc079500 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:01.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:01.980+0000 7ff3d71ec640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7ff3d0156ef0 0x7ff3d0157370 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:01.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:01.980+0000 7ff3d71ec640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7ff3d0151ea0 0x7ff3d01515f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:01.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:01.980+0000 7ff3d71ec640 1 --2- 172.21.15.159:0/3841896874 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7ff3b8003a30 0x7ff3d01f46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:01.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:01.980+0000 7ff3d71ec640 1 -- 172.21.15.159:0/3841896874 >> 172.21.15.159:0/3841896874 conn(0x7ff3d006da90 msgr2=0x7ff3d00b22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:01.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:01.980+0000 7ff3d71ec640 1 -- 172.21.15.159:0/3841896874 shutdown_connections 2024-07-24T16:37:01.984 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:01.980+0000 7ff3d71ec640 1 -- 172.21.15.159:0/3841896874 wait complete. 2024-07-24T16:37:01.999 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-07-24T16:37:02.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.112+0000 7f7a7e16f640 1 -- 172.21.15.159:0/1881131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a780b2ae0 msgr2=0x7f7a780b0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:02.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.112+0000 7f7a7e16f640 1 --2- 172.21.15.159:0/1881131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a780b2ae0 0x7f7a780b0620 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f7a7808c710 tx=0x7f7a6c02a680 comp rx=0 tx=0).stop 2024-07-24T16:37:02.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.112+0000 7f7a7e16f640 1 -- 172.21.15.159:0/1881131 shutdown_connections 2024-07-24T16:37:02.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.112+0000 7f7a7e16f640 1 --2- 172.21.15.159:0/1881131 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a780b2ae0 0x7f7a780b0620 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:02.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.112+0000 7f7a7e16f640 1 --2- 172.21.15.159:0/1881131 >> v2:172.21.15.193:3300/0 conn(0x7f7a7815d950 0x7f7a78161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:02.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.112+0000 7f7a7e16f640 1 -- 172.21.15.159:0/1881131 >> 172.21.15.159:0/1881131 conn(0x7f7a7809cd30 msgr2=0x7f7a780d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:02.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.113+0000 7f7a7e16f640 1 -- 172.21.15.159:0/1881131 shutdown_connections 2024-07-24T16:37:02.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.113+0000 7f7a7e16f640 1 -- 172.21.15.159:0/1881131 wait complete. 2024-07-24T16:37:02.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.114+0000 7f7a7e16f640 1 Processor -- start 2024-07-24T16:37:02.117 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.114+0000 7f7a7e16f640 1 -- start start 2024-07-24T16:37:02.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a7e16f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a780b0b60 0x7f7a781544f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:02.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a7e16f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a780b2ae0 0x7f7a781f7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:02.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a7e16f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a7815d950 0x7f7a781f83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:02.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a7e16f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7a780d02e0 con 0x7f7a7815d950 2024-07-24T16:37:02.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a7e16f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7a780d0090 con 0x7f7a780b2ae0 2024-07-24T16:37:02.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a7e16f640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7a780d0460 con 0x7f7a780b0b60 2024-07-24T16:37:02.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a77fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a7815d950 0x7f7a781f83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:02.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a77fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a7815d950 0x7f7a781f83d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47092/0 (socket says 172.21.15.159:47092) 2024-07-24T16:37:02.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a77fff640 1 -- 172.21.15.159:0/3806365122 learned_addr learned my addr 172.21.15.159:0/3806365122 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:02.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a777fe640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a780b0b60 0x7f7a781544f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:02.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a76ffd640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a780b2ae0 0x7f7a781f7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:02.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a77fff640 1 -- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a780b0b60 msgr2=0x7f7a781544f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:02.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a77fff640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a780b0b60 0x7f7a781544f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:02.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a77fff640 1 -- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a780b2ae0 msgr2=0x7f7a781f7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:02.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a77fff640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a780b2ae0 0x7f7a781f7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:02.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a77fff640 1 -- 172.21.15.159:0/3806365122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a781f4290 con 0x7f7a7815d950 2024-07-24T16:37:02.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a76ffd640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a780b2ae0 0x7f7a781f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:37:02.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a77fff640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a7815d950 0x7f7a781f83d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c730 tx=0x7f7a7000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:02.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a5ffff640 1 -- 172.21.15.159:0/3806365122 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a70003da0 con 0x7f7a7815d950 2024-07-24T16:37:02.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a5ffff640 1 -- 172.21.15.159:0/3806365122 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a7000ce40 con 0x7f7a7815d950 2024-07-24T16:37:02.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a7e16f640 1 -- 172.21.15.159:0/3806365122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a781f4550 con 0x7f7a7815d950 2024-07-24T16:37:02.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a5ffff640 1 -- 172.21.15.159:0/3806365122 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a700052d0 con 0x7f7a7815d950 2024-07-24T16:37:02.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.115+0000 7f7a7e16f640 1 -- 172.21.15.159:0/3806365122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a781f4b10 con 0x7f7a7815d950 2024-07-24T16:37:02.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.116+0000 7f7a7e16f640 1 -- 172.21.15.159:0/3806365122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a780b7c30 con 0x7f7a7815d950 2024-07-24T16:37:02.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.117+0000 7f7a5ffff640 1 -- 172.21.15.159:0/3806365122 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f7a70005470 con 0x7f7a7815d950 2024-07-24T16:37:02.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.118+0000 7f7a5ffff640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7a64077010 0x7f7a640794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:02.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.118+0000 7f7a5ffff640 1 -- 172.21.15.159:0/3806365122 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5919+0+0 (secure 0 0 0) 0x7f7a700993a0 con 0x7f7a7815d950 2024-07-24T16:37:02.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.118+0000 7f7a777fe640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7a64077010 0x7f7a640794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:02.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.118+0000 7f7a777fe640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7a64077010 0x7f7a640794d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009ac0 tx=0x7f7a68005f90 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:02.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.121+0000 7f7a5ffff640 1 -- 172.21.15.159:0/3806365122 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f7a780b7c30 con 0x7f7a7815d950 2024-07-24T16:37:02.309 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.306+0000 7f7a7e16f640 1 -- 172.21.15.159:0/3806365122 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7a780d0980 con 0x7f7a7815d950 2024-07-24T16:37:02.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.983+0000 7f7a5ffff640 1 -- 172.21.15.159:0/3806365122 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) ==== 170+0+0 (secure 0 0 0) 0x7f7a70061f10 con 0x7f7a7815d950 2024-07-24T16:37:02.986 INFO:teuthology.orchestra.run.smithi159.stderr:pool 'cephfs_data' created 2024-07-24T16:37:02.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.986+0000 7f7a7e16f640 1 -- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7a64077010 msgr2=0x7f7a640794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:02.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.986+0000 7f7a7e16f640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7a64077010 0x7f7a640794d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7a68009ac0 tx=0x7f7a68005f90 comp rx=0 tx=0).stop 2024-07-24T16:37:02.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.986+0000 7f7a7e16f640 1 -- 172.21.15.159:0/3806365122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a7815d950 msgr2=0x7f7a781f83d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:02.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.986+0000 7f7a7e16f640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a7815d950 0x7f7a781f83d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f7a7000c730 tx=0x7f7a7000cbf0 comp rx=0 tx=0).stop 2024-07-24T16:37:02.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.986+0000 7f7a7e16f640 1 -- 172.21.15.159:0/3806365122 shutdown_connections 2024-07-24T16:37:02.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.986+0000 7f7a7e16f640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7a64077010 0x7f7a640794d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:02.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.986+0000 7f7a7e16f640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a7815d950 0x7f7a781f83d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:02.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.986+0000 7f7a7e16f640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a780b2ae0 0x7f7a781f7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:02.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.986+0000 7f7a7e16f640 1 --2- 172.21.15.159:0/3806365122 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a780b0b60 0x7f7a781544f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:02.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.986+0000 7f7a7e16f640 1 -- 172.21.15.159:0/3806365122 >> 172.21.15.159:0/3806365122 conn(0x7f7a7809cd30 msgr2=0x7f7a780cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:02.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.986+0000 7f7a7e16f640 1 -- 172.21.15.159:0/3806365122 shutdown_connections 2024-07-24T16:37:02.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:02.986+0000 7f7a7e16f640 1 -- 172.21.15.159:0/3806365122 wait complete. 2024-07-24T16:37:03.013 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-07-24T16:37:03.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.120+0000 7f281e708640 1 -- 172.21.15.159:0/3972400985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2800004d40 msgr2=0x7f28000051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:03.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.120+0000 7f281e708640 1 --2- 172.21.15.159:0/3972400985 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f2800004d40 0x7f28000051c0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f2810009ed0 tx=0x7f2800005830 comp rx=0 tx=0).stop 2024-07-24T16:37:03.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.120+0000 7f281cca5640 1 -- 172.21.15.159:0/3972400985 reap_dead start 2024-07-24T16:37:03.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.120+0000 7f281e708640 1 -- 172.21.15.159:0/3972400985 shutdown_connections 2024-07-24T16:37:03.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.120+0000 7f281e708640 1 -- 172.21.15.159:0/3972400985 >> 172.21.15.159:0/3972400985 conn(0x7f281806c560 msgr2=0x7f281806c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:03.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.120+0000 7f281e708640 1 -- 172.21.15.159:0/3972400985 shutdown_connections 2024-07-24T16:37:03.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.120+0000 7f281e708640 1 -- 172.21.15.159:0/3972400985 wait complete. 2024-07-24T16:37:03.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.121+0000 7f281e708640 1 Processor -- start 2024-07-24T16:37:03.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.121+0000 7f281e708640 1 -- start start 2024-07-24T16:37:03.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281e708640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2800004d40 0x7f28180b1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:03.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281e708640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28180aa4d0 0x7f2818147300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:03.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281e708640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28181f7c70 0x7f2818159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:03.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281e708640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f28180ae4d0 con 0x7f28181f7c70 2024-07-24T16:37:03.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281e708640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f281815b800 con 0x7f28180aa4d0 2024-07-24T16:37:03.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281e708640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f28180ae650 con 0x7f2800004d40 2024-07-24T16:37:03.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281cca5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28181f7c70 0x7f2818159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:03.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281cca5640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28181f7c70 0x7f2818159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47124/0 (socket says 172.21.15.159:47124) 2024-07-24T16:37:03.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281cca5640 1 -- 172.21.15.159:0/3027290441 learned_addr learned my addr 172.21.15.159:0/3027290441 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:03.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f28177fe640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28180aa4d0 0x7f2818147300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:03.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f2817fff640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2800004d40 0x7f28180b1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:03.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281cca5640 1 -- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2800004d40 msgr2=0x7f28180b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:03.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281cca5640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2800004d40 0x7f28180b1a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:03.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281cca5640 1 -- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28180aa4d0 msgr2=0x7f2818147300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:03.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281cca5640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28180aa4d0 0x7f2818147300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:03.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281cca5640 1 -- 172.21.15.159:0/3027290441 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28180aaa40 con 0x7f28181f7c70 2024-07-24T16:37:03.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.122+0000 7f281cca5640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28181f7c70 0x7f2818159220 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f281002b860 tx=0x7f2810033c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:03.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.123+0000 7f2814ff9640 1 -- 172.21.15.159:0/3027290441 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810038040 con 0x7f28181f7c70 2024-07-24T16:37:03.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.123+0000 7f2814ff9640 1 -- 172.21.15.159:0/3027290441 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f281002bc30 con 0x7f28181f7c70 2024-07-24T16:37:03.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.123+0000 7f281e708640 1 -- 172.21.15.159:0/3027290441 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28180b0f30 con 0x7f28181f7c70 2024-07-24T16:37:03.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.123+0000 7f2814ff9640 1 -- 172.21.15.159:0/3027290441 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2810004d80 con 0x7f28181f7c70 2024-07-24T16:37:03.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.123+0000 7f281e708640 1 -- 172.21.15.159:0/3027290441 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28181f8120 con 0x7f28181f7c70 2024-07-24T16:37:03.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.124+0000 7f281e708640 1 -- 172.21.15.159:0/3027290441 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28180aeb70 con 0x7f28181f7c70 2024-07-24T16:37:03.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.124+0000 7f2814ff9640 1 -- 172.21.15.159:0/3027290441 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f2810043030 con 0x7f28181f7c70 2024-07-24T16:37:03.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.125+0000 7f2814ff9640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f2804077040 0x7f2804079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:03.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.125+0000 7f2814ff9640 1 -- 172.21.15.159:0/3027290441 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6301+0+0 (secure 0 0 0) 0x7f28100b9eb0 con 0x7f28181f7c70 2024-07-24T16:37:03.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.125+0000 7f2817fff640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f2804077040 0x7f2804079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:03.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.126+0000 7f2817fff640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f2804077040 0x7f2804079500 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2808001c20 tx=0x7f2808001bb0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:03.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.128+0000 7f2814ff9640 1 -- 172.21.15.159:0/3027290441 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f281004a020 con 0x7f28181f7c70 2024-07-24T16:37:03.353 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.351+0000 7f281e708640 1 -- 172.21.15.159:0/3027290441 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f28180ce1d0 con 0x7f28181f7c70 2024-07-24T16:37:03.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.984+0000 7f2814ff9640 1 -- 172.21.15.159:0/3027290441 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v22) ==== 172+0+0 (secure 0 0 0) 0x7f2810082fd0 con 0x7f28181f7c70 2024-07-24T16:37:03.987 INFO:teuthology.orchestra.run.smithi159.stderr:new fs with metadata pool 7 and data pool 8 2024-07-24T16:37:03.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.987+0000 7f281e708640 1 -- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f2804077040 msgr2=0x7f2804079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:03.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.987+0000 7f281e708640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f2804077040 0x7f2804079500 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2808001c20 tx=0x7f2808001bb0 comp rx=0 tx=0).stop 2024-07-24T16:37:03.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.987+0000 7f281e708640 1 -- 172.21.15.159:0/3027290441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28181f7c70 msgr2=0x7f2818159220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:03.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.987+0000 7f281e708640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28181f7c70 0x7f2818159220 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f281002b860 tx=0x7f2810033c10 comp rx=0 tx=0).stop 2024-07-24T16:37:03.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.987+0000 7f281e708640 1 -- 172.21.15.159:0/3027290441 shutdown_connections 2024-07-24T16:37:03.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.987+0000 7f281e708640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f2804077040 0x7f2804079500 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:03.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.987+0000 7f281e708640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f28181f7c70 0x7f2818159220 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:03.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.987+0000 7f281e708640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f28180aa4d0 0x7f2818147300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:03.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.987+0000 7f281e708640 1 --2- 172.21.15.159:0/3027290441 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f2800004d40 0x7f28180b1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:03.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.987+0000 7f281e708640 1 -- 172.21.15.159:0/3027290441 >> 172.21.15.159:0/3027290441 conn(0x7f281806c560 msgr2=0x7f281815bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:03.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.988+0000 7f281e708640 1 -- 172.21.15.159:0/3027290441 shutdown_connections 2024-07-24T16:37:03.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:03.988+0000 7f281e708640 1 -- 172.21.15.159:0/3027290441 wait complete. 2024-07-24T16:37:04.016 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:37:04.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.121+0000 7f7a92dc6640 1 -- 172.21.15.159:0/4028630817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a8c0cf770 msgr2=0x7f7a8c15b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:04.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.121+0000 7f7a92dc6640 1 --2- 172.21.15.159:0/4028630817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a8c0cf770 0x7f7a8c15b4b0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c009860 tx=0x7f7a7c02a540 comp rx=0 tx=0).stop 2024-07-24T16:37:04.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.121+0000 7f7a92dc6640 1 -- 172.21.15.159:0/4028630817 shutdown_connections 2024-07-24T16:37:04.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.121+0000 7f7a92dc6640 1 --2- 172.21.15.159:0/4028630817 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a8c0cf770 0x7f7a8c15b4b0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.121+0000 7f7a92dc6640 1 -- 172.21.15.159:0/4028630817 >> 172.21.15.159:0/4028630817 conn(0x7f7a8c06c560 msgr2=0x7f7a8c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:04.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.121+0000 7f7a92dc6640 1 -- 172.21.15.159:0/4028630817 shutdown_connections 2024-07-24T16:37:04.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.121+0000 7f7a92dc6640 1 -- 172.21.15.159:0/4028630817 wait complete. 2024-07-24T16:37:04.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.122+0000 7f7a92dc6640 1 Processor -- start 2024-07-24T16:37:04.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.122+0000 7f7a92dc6640 1 -- start start 2024-07-24T16:37:04.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a92dc6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a8c06dba0 0x7f7a8c1f2eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:04.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a92dc6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a8c0cf770 0x7f7a8c141840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:04.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a92dc6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a8c0cfb50 0x7f7a8c0b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:04.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a92dc6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c0cbd90 con 0x7f7a8c0cf770 2024-07-24T16:37:04.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a92dc6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8c0cbc10 con 0x7f7a8c0cfb50 2024-07-24T16:37:04.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a92dc6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f7a8c0cbf10 con 0x7f7a8c06dba0 2024-07-24T16:37:04.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a8bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a8c0cf770 0x7f7a8c141840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:04.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a8bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a8c0cf770 0x7f7a8c141840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47144/0 (socket says 172.21.15.159:47144) 2024-07-24T16:37:04.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a8bfff640 1 -- 172.21.15.159:0/1104843497 learned_addr learned my addr 172.21.15.159:0/1104843497 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:04.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a91363640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a8c0cfb50 0x7f7a8c0b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:04.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a8bfff640 1 -- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a8c06dba0 msgr2=0x7f7a8c1f2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:04.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a8bfff640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a8c06dba0 0x7f7a8c1f2eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a8bfff640 1 -- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a8c0cfb50 msgr2=0x7f7a8c0b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:04.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a8bfff640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a8c0cfb50 0x7f7a8c0b1090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a8bfff640 1 -- 172.21.15.159:0/1104843497 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8c1504c0 con 0x7f7a8c0cf770 2024-07-24T16:37:04.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a91363640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a8c0cfb50 0x7f7a8c0b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:37:04.128 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.123+0000 7f7a8bfff640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a8c0cf770 0x7f7a8c141840 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000c430 tx=0x7f7a8000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:04.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.124+0000 7f7a897fa640 1 -- 172.21.15.159:0/1104843497 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80017070 con 0x7f7a8c0cf770 2024-07-24T16:37:04.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.124+0000 7f7a897fa640 1 -- 172.21.15.159:0/1104843497 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7a800035f0 con 0x7f7a8c0cf770 2024-07-24T16:37:04.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.124+0000 7f7a92dc6640 1 -- 172.21.15.159:0/1104843497 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a8c0aa180 con 0x7f7a8c0cf770 2024-07-24T16:37:04.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.124+0000 7f7a897fa640 1 -- 172.21.15.159:0/1104843497 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80003a40 con 0x7f7a8c0cf770 2024-07-24T16:37:04.129 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.124+0000 7f7a92dc6640 1 -- 172.21.15.159:0/1104843497 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a8c1f6770 con 0x7f7a8c0cf770 2024-07-24T16:37:04.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.125+0000 7f7a92dc6640 1 -- 172.21.15.159:0/1104843497 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a8c0aeea0 con 0x7f7a8c0cf770 2024-07-24T16:37:04.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.125+0000 7f7a897fa640 1 -- 172.21.15.159:0/1104843497 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f7a8001a070 con 0x7f7a8c0cf770 2024-07-24T16:37:04.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.126+0000 7f7a897fa640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7a78077010 0x7f7a780794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:04.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.126+0000 7f7a897fa640 1 -- 172.21.15.159:0/1104843497 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6401+0+0 (secure 0 0 0) 0x7f7a80097ed0 con 0x7f7a8c0cf770 2024-07-24T16:37:04.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.126+0000 7f7a90b62640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7a78077010 0x7f7a780794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:04.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.127+0000 7f7a90b62640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7a78077010 0x7f7a780794d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c034000 tx=0x7f7a7c0046c0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:04.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.130+0000 7f7a897fa640 1 -- 172.21.15.159:0/1104843497 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f7a80060850 con 0x7f7a8c0cf770 2024-07-24T16:37:04.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-07-24T16:37:04.317 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.314+0000 7f7a92dc6640 1 -- 172.21.15.159:0/1104843497 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7a8c06fc30 con 0x7f7a8c0cf770 2024-07-24T16:37:04.318 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.315+0000 7f7a897fa640 1 -- 172.21.15.159:0/1104843497 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+17445 (secure 0 0 0) 0x7f7a800690e0 con 0x7f7a8c0cf770 2024-07-24T16:37:04.318 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:37:04.318 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":62,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:37:03.352877+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:37:00.987259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-07-24T16:37:02.311704+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":4,"length":1},{"begin":14,"length":1},{"begin":24,"length":1},{"begin":35,"length":1},{"begin":41,"length":2},{"begin":46,"length":1},{"begin":52,"length":1},{"begin":56,"length":1},{"begin":63,"length":1},{"begin":67,"length":1},{"begin":74,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":88,"length":1},{"begin":95,"length":1},{"begin":99,"length":1},{"begin":106,"length":1},{"begin":203,"length":18}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:37:04.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.318+0000 7f7a92dc6640 1 -- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7a78077010 msgr2=0x7f7a780794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:04.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.318+0000 7f7a92dc6640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7a78077010 0x7f7a780794d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c034000 tx=0x7f7a7c0046c0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.318+0000 7f7a92dc6640 1 -- 172.21.15.159:0/1104843497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a8c0cf770 msgr2=0x7f7a8c141840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:04.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.318+0000 7f7a92dc6640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a8c0cf770 0x7f7a8c141840 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000c430 tx=0x7f7a8000c8f0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.318+0000 7f7a92dc6640 1 -- 172.21.15.159:0/1104843497 shutdown_connections 2024-07-24T16:37:04.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.318+0000 7f7a92dc6640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f7a8c0cfb50 0x7f7a8c0b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.318+0000 7f7a92dc6640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7a78077010 0x7f7a780794d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.318+0000 7f7a92dc6640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f7a8c0cf770 0x7f7a8c141840 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.321 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.318+0000 7f7a92dc6640 1 --2- 172.21.15.159:0/1104843497 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f7a8c06dba0 0x7f7a8c1f2eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.318+0000 7f7a92dc6640 1 -- 172.21.15.159:0/1104843497 >> 172.21.15.159:0/1104843497 conn(0x7f7a8c06c560 msgr2=0x7f7a8c072bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:04.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.318+0000 7f7a92dc6640 1 -- 172.21.15.159:0/1104843497 shutdown_connections 2024-07-24T16:37:04.322 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.318+0000 7f7a92dc6640 1 -- 172.21.15.159:0/1104843497 wait complete. 2024-07-24T16:37:04.332 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:37:04.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.431+0000 7f129d341640 1 -- 172.21.15.159:0/2079253311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f129815d950 msgr2=0x7f1298161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:04.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.431+0000 7f129d341640 1 --2- 172.21.15.159:0/2079253311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f129815d950 0x7f1298161f20 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f1288009830 tx=0x7f128802a4a0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.431+0000 7f129d341640 1 -- 172.21.15.159:0/2079253311 shutdown_connections 2024-07-24T16:37:04.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.431+0000 7f129d341640 1 --2- 172.21.15.159:0/2079253311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f129815d950 0x7f1298161f20 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.431+0000 7f129d341640 1 -- 172.21.15.159:0/2079253311 >> 172.21.15.159:0/2079253311 conn(0x7f129809cd30 msgr2=0x7f12980d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:04.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.432+0000 7f129d341640 1 -- 172.21.15.159:0/2079253311 shutdown_connections 2024-07-24T16:37:04.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.432+0000 7f129d341640 1 -- 172.21.15.159:0/2079253311 wait complete. 2024-07-24T16:37:04.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.433+0000 7f129d341640 1 Processor -- start 2024-07-24T16:37:04.435 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.433+0000 7f129d341640 1 -- start start 2024-07-24T16:37:04.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f129d341640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12980b2ae0 0x7f12981f4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:04.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f129d341640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12980cf770 0x7f12980b3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:04.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f129d341640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f129815d950 0x7f129815b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:04.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f129d341640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f12980d0b70 con 0x7f12980cf770 2024-07-24T16:37:04.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f129d341640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f12980d09f0 con 0x7f12980b2ae0 2024-07-24T16:37:04.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f129d341640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f12980cfbc0 con 0x7f129815d950 2024-07-24T16:37:04.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f128e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12980cf770 0x7f12980b3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:04.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f128e7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12980cf770 0x7f12980b3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47176/0 (socket says 172.21.15.159:47176) 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f128e7fc640 1 -- 172.21.15.159:0/3637853139 learned_addr learned my addr 172.21.15.159:0/3637853139 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f12977fe640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f129815d950 0x7f129815b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f1296ffd640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12980b2ae0 0x7f12981f4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f128e7fc640 1 -- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f129815d950 msgr2=0x7f129815b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f128e7fc640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f129815d950 0x7f129815b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f128e7fc640 1 -- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12980b2ae0 msgr2=0x7f12981f4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f128e7fc640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12980b2ae0 0x7f12981f4b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f128e7fc640 1 -- 172.21.15.159:0/3637853139 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12981f5050 con 0x7f12980cf770 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f128e7fc640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12980cf770 0x7f12980b3150 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f128000c730 tx=0x7f128000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f128ffff640 1 -- 172.21.15.159:0/3637853139 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280017070 con 0x7f12980cf770 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f128ffff640 1 -- 172.21.15.159:0/3637853139 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1280005380 con 0x7f12980cf770 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f128ffff640 1 -- 172.21.15.159:0/3637853139 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f128000a8a0 con 0x7f12980cf770 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f129d341640 1 -- 172.21.15.159:0/3637853139 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12980b4580 con 0x7f12980cf770 2024-07-24T16:37:04.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.434+0000 7f129d341640 1 -- 172.21.15.159:0/3637853139 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12980b4b40 con 0x7f12980cf770 2024-07-24T16:37:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.435+0000 7f129d341640 1 -- 172.21.15.159:0/3637853139 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1298161f20 con 0x7f12980cf770 2024-07-24T16:37:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.436+0000 7f128ffff640 1 -- 172.21.15.159:0/3637853139 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f128001a070 con 0x7f12980cf770 2024-07-24T16:37:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.436+0000 7f128ffff640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1278077010 0x7f12780794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:04.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.436+0000 7f128ffff640 1 -- 172.21.15.159:0/3637853139 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6401+0+0 (secure 0 0 0) 0x7f1280098020 con 0x7f12980cf770 2024-07-24T16:37:04.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.437+0000 7f1296ffd640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1278077010 0x7f12780794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:04.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.437+0000 7f1296ffd640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1278077010 0x7f12780794d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1288034000 tx=0x7f1288004730 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:04.443 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.441+0000 7f128ffff640 1 -- 172.21.15.159:0/3637853139 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f12981f5050 con 0x7f12980cf770 2024-07-24T16:37:04.625 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.623+0000 7f129d341640 1 -- 172.21.15.159:0/3637853139 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12980b4e80 con 0x7f12980cf770 2024-07-24T16:37:04.626 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.624+0000 7f128ffff640 1 -- 172.21.15.159:0/3637853139 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) ==== 74+0+17445 (secure 0 0 0) 0x7f12800692c0 con 0x7f12980cf770 2024-07-24T16:37:04.627 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:37:04.627 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":62,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:37:03.352877+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:37:00.987259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-07-24T16:37:02.311704+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":4,"length":1},{"begin":14,"length":1},{"begin":24,"length":1},{"begin":35,"length":1},{"begin":41,"length":2},{"begin":46,"length":1},{"begin":52,"length":1},{"begin":56,"length":1},{"begin":63,"length":1},{"begin":67,"length":1},{"begin":74,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":88,"length":1},{"begin":95,"length":1},{"begin":99,"length":1},{"begin":106,"length":1},{"begin":203,"length":18}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:37:04.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.626+0000 7f129d341640 1 -- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1278077010 msgr2=0x7f12780794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:04.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.626+0000 7f129d341640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1278077010 0x7f12780794d0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f1288034000 tx=0x7f1288004730 comp rx=0 tx=0).stop 2024-07-24T16:37:04.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.626+0000 7f129d341640 1 -- 172.21.15.159:0/3637853139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12980cf770 msgr2=0x7f12980b3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:04.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.626+0000 7f129d341640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12980cf770 0x7f12980b3150 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f128000c730 tx=0x7f128000cbf0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.626+0000 7f129d341640 1 -- 172.21.15.159:0/3637853139 shutdown_connections 2024-07-24T16:37:04.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.626+0000 7f129d341640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f129815d950 0x7f129815b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.626+0000 7f129d341640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1278077010 0x7f12780794d0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.626+0000 7f129d341640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f12980cf770 0x7f12980b3150 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.629 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.626+0000 7f129d341640 1 --2- 172.21.15.159:0/3637853139 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f12980b2ae0 0x7f12981f4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.626+0000 7f129d341640 1 -- 172.21.15.159:0/3637853139 >> 172.21.15.159:0/3637853139 conn(0x7f129809cd30 msgr2=0x7f12980b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:04.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.626+0000 7f129d341640 1 -- 172.21.15.159:0/3637853139 shutdown_connections 2024-07-24T16:37:04.630 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.626+0000 7f129d341640 1 -- 172.21.15.159:0/3637853139 wait complete. 2024-07-24T16:37:04.640 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-07-24T16:37:04.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.742+0000 7f4d98bc2640 1 -- 172.21.15.159:0/3303114392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d9415b4d0 msgr2=0x7f4d94070750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:04.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.742+0000 7f4d98bc2640 1 --2- 172.21.15.159:0/3303114392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d9415b4d0 0x7f4d94070750 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c005fd0 tx=0x7f4d8c02a5c0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.742+0000 7f4d98bc2640 1 -- 172.21.15.159:0/3303114392 shutdown_connections 2024-07-24T16:37:04.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.742+0000 7f4d98bc2640 1 --2- 172.21.15.159:0/3303114392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d9409af50 0x7f4d9415f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.745 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.742+0000 7f4d98bc2640 1 --2- 172.21.15.159:0/3303114392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d9415b4d0 0x7f4d94070750 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.742+0000 7f4d98bc2640 1 -- 172.21.15.159:0/3303114392 >> 172.21.15.159:0/3303114392 conn(0x7f4d9409aa20 msgr2=0x7f4d940d1880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:04.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.742+0000 7f4d98bc2640 1 -- 172.21.15.159:0/3303114392 shutdown_connections 2024-07-24T16:37:04.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.742+0000 7f4d98bc2640 1 -- 172.21.15.159:0/3303114392 wait complete. 2024-07-24T16:37:04.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.744+0000 7f4d98bc2640 1 Processor -- start 2024-07-24T16:37:04.746 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.744+0000 7f4d98bc2640 1 -- start start 2024-07-24T16:37:04.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.744+0000 7f4d98bc2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d9409af50 0x7f4d940cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:04.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.744+0000 7f4d98bc2640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d9415b4d0 0x7f4d94155590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:04.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.744+0000 7f4d98bc2640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d9415b8b0 0x7f4d94154b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:04.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.744+0000 7f4d98bc2640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9415fb60 con 0x7f4d9409af50 2024-07-24T16:37:04.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.744+0000 7f4d98bc2640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4d9415f9e0 con 0x7f4d9415b4d0 2024-07-24T16:37:04.748 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.744+0000 7f4d98bc2640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4d940c8950 con 0x7f4d9415b8b0 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d9259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d9409af50 0x7f4d940cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d9259c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d9409af50 0x7f4d940cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47196/0 (socket says 172.21.15.159:47196) 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d9259c640 1 -- 172.21.15.159:0/220230336 learned_addr learned my addr 172.21.15.159:0/220230336 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d91d9b640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d9415b4d0 0x7f4d94155590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d92d9d640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d9415b8b0 0x7f4d94154b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d9259c640 1 -- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d9415b8b0 msgr2=0x7f4d94154b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d9259c640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d9415b8b0 0x7f4d94154b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d9259c640 1 -- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d9415b4d0 msgr2=0x7f4d94155590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d9259c640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d9415b4d0 0x7f4d94155590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d9259c640 1 -- 172.21.15.159:0/220230336 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d94155ad0 con 0x7f4d9409af50 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d92d9d640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d9415b8b0 0x7f4d94154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d9259c640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d9409af50 0x7f4d940cb800 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009850 tx=0x7f4d8c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d8affd640 1 -- 172.21.15.159:0/220230336 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c03f070 con 0x7f4d9409af50 2024-07-24T16:37:04.749 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d8affd640 1 -- 172.21.15.159:0/220230336 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d8c004890 con 0x7f4d9409af50 2024-07-24T16:37:04.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d8affd640 1 -- 172.21.15.159:0/220230336 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d8c035030 con 0x7f4d9409af50 2024-07-24T16:37:04.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d98bc2640 1 -- 172.21.15.159:0/220230336 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d94155d80 con 0x7f4d9409af50 2024-07-24T16:37:04.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.745+0000 7f4d98bc2640 1 -- 172.21.15.159:0/220230336 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d94156340 con 0x7f4d9409af50 2024-07-24T16:37:04.750 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.746+0000 7f4d98bc2640 1 -- 172.21.15.159:0/220230336 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d9415f290 con 0x7f4d9409af50 2024-07-24T16:37:04.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.747+0000 7f4d8affd640 1 -- 172.21.15.159:0/220230336 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f4d8c042070 con 0x7f4d9409af50 2024-07-24T16:37:04.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.747+0000 7f4d8affd640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4d74077010 0x7f4d740794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:04.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.747+0000 7f4d8affd640 1 -- 172.21.15.159:0/220230336 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6401+0+0 (secure 0 0 0) 0x7f4d8c0b9840 con 0x7f4d9409af50 2024-07-24T16:37:04.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.748+0000 7f4d91d9b640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4d74077010 0x7f4d740794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:04.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.748+0000 7f4d91d9b640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4d74077010 0x7f4d740794d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00a490 tx=0x7f4d7c00a420 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:04.754 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.751+0000 7f4d8affd640 1 -- 172.21.15.159:0/220230336 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f4d8c082250 con 0x7f4d9409af50 2024-07-24T16:37:04.974 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.972+0000 7f4d98bc2640 1 -- 172.21.15.159:0/220230336 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f4d940b7800 con 0x7f4d9409af50 2024-07-24T16:37:05.001 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:04.999+0000 7f4d8affd640 1 -- 172.21.15.159:0/220230336 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v23) ==== 118+0+0 (secure 0 0 0) 0x7f4d8c0867a0 con 0x7f4d9409af50 2024-07-24T16:37:05.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.002+0000 7f4d98bc2640 1 -- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4d74077010 msgr2=0x7f4d740794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:05.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.002+0000 7f4d98bc2640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4d74077010 0x7f4d740794d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4d7c00a490 tx=0x7f4d7c00a420 comp rx=0 tx=0).stop 2024-07-24T16:37:05.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.002+0000 7f4d98bc2640 1 -- 172.21.15.159:0/220230336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d9409af50 msgr2=0x7f4d940cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:05.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.002+0000 7f4d98bc2640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d9409af50 0x7f4d940cb800 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c009850 tx=0x7f4d8c0039e0 comp rx=0 tx=0).stop 2024-07-24T16:37:05.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.002+0000 7f4d98bc2640 1 -- 172.21.15.159:0/220230336 shutdown_connections 2024-07-24T16:37:05.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.002+0000 7f4d98bc2640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4d9415b8b0 0x7f4d94154b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:05.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.002+0000 7f4d98bc2640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4d9415b4d0 0x7f4d94155590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:05.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.002+0000 7f4d98bc2640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4d74077010 0x7f4d740794d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:05.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.002+0000 7f4d98bc2640 1 --2- 172.21.15.159:0/220230336 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4d9409af50 0x7f4d940cb800 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:05.005 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.002+0000 7f4d98bc2640 1 -- 172.21.15.159:0/220230336 >> 172.21.15.159:0/220230336 conn(0x7f4d9409aa20 msgr2=0x7f4d940b6940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:05.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.002+0000 7f4d98bc2640 1 -- 172.21.15.159:0/220230336 shutdown_connections 2024-07-24T16:37:05.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.002+0000 7f4d98bc2640 1 -- 172.21.15.159:0/220230336 wait complete. 2024-07-24T16:37:05.016 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-07-24T16:37:05.016 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-07-24T16:37:05.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.120+0000 7f9702d12640 1 -- 172.21.15.159:0/660716924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96fc070500 msgr2=0x7f96fc15b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:05.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.120+0000 7f9702d12640 1 --2- 172.21.15.159:0/660716924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96fc070500 0x7f96fc15b3c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f96fc075410 tx=0x7f96f402a5f0 comp rx=0 tx=0).stop 2024-07-24T16:37:05.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.120+0000 7f9702d12640 1 -- 172.21.15.159:0/660716924 shutdown_connections 2024-07-24T16:37:05.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.120+0000 7f9702d12640 1 --2- 172.21.15.159:0/660716924 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96fc070500 0x7f96fc15b3c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:05.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.120+0000 7f9702d12640 1 --2- 172.21.15.159:0/660716924 >> v2:172.21.15.193:3300/0 conn(0x7f96fc157d50 0x7f96fc0cf410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:05.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.120+0000 7f9702d12640 1 -- 172.21.15.159:0/660716924 >> 172.21.15.159:0/660716924 conn(0x7f96fc06d450 msgr2=0x7f96fc06d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:05.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.120+0000 7f9702d12640 1 -- 172.21.15.159:0/660716924 shutdown_connections 2024-07-24T16:37:05.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.120+0000 7f9702d12640 1 -- 172.21.15.159:0/660716924 wait complete. 2024-07-24T16:37:05.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.121+0000 7f9702d12640 1 Processor -- start 2024-07-24T16:37:05.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.121+0000 7f9702d12640 1 -- start start 2024-07-24T16:37:05.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f9702d12640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96fc06f1c0 0x7f96fc0aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:05.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f9702d12640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f96fc070500 0x7f96fc1441d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:05.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f9702d12640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96fc157d50 0x7f96fc0a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:05.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f9702d12640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f96fc0cdea0 con 0x7f96fc157d50 2024-07-24T16:37:05.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f9702d12640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f96fc0cdd20 con 0x7f96fc06f1c0 2024-07-24T16:37:05.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f9702d12640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f96fc0ce020 con 0x7f96fc070500 2024-07-24T16:37:05.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f97012af640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96fc157d50 0x7f96fc0a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:05.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f97012af640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96fc157d50 0x7f96fc0a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47222/0 (socket says 172.21.15.159:47222) 2024-07-24T16:37:05.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f97012af640 1 -- 172.21.15.159:0/1514189327 learned_addr learned my addr 172.21.15.159:0/1514189327 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:05.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f9700aae640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96fc06f1c0 0x7f96fc0aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:05.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f96fbfff640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f96fc070500 0x7f96fc1441d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:05.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f97012af640 1 -- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f96fc070500 msgr2=0x7f96fc1441d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:05.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f97012af640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f96fc070500 0x7f96fc1441d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:05.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f97012af640 1 -- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96fc06f1c0 msgr2=0x7f96fc0aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:05.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f97012af640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96fc06f1c0 0x7f96fc0aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:05.132 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f97012af640 1 -- 172.21.15.159:0/1514189327 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96fc0a9bf0 con 0x7f96fc157d50 2024-07-24T16:37:05.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.122+0000 7f97012af640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96fc157d50 0x7f96fc0a9480 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f96f40099c0 tx=0x7f96f4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:05.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.123+0000 7f96f97fa640 1 -- 172.21.15.159:0/1514189327 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f403f070 con 0x7f96fc157d50 2024-07-24T16:37:05.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.123+0000 7f96f97fa640 1 -- 172.21.15.159:0/1514189327 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96f40047a0 con 0x7f96fc157d50 2024-07-24T16:37:05.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.123+0000 7f9702d12640 1 -- 172.21.15.159:0/1514189327 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96fc0a9ed0 con 0x7f96fc157d50 2024-07-24T16:37:05.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.123+0000 7f96f97fa640 1 -- 172.21.15.159:0/1514189327 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96f4035030 con 0x7f96fc157d50 2024-07-24T16:37:05.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.123+0000 7f9702d12640 1 -- 172.21.15.159:0/1514189327 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96fc0aa490 con 0x7f96fc157d50 2024-07-24T16:37:05.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.124+0000 7f9702d12640 1 -- 172.21.15.159:0/1514189327 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96fc15b3c0 con 0x7f96fc157d50 2024-07-24T16:37:05.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.124+0000 7f96f97fa640 1 -- 172.21.15.159:0/1514189327 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f96f4042070 con 0x7f96fc157d50 2024-07-24T16:37:05.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.125+0000 7f96f97fa640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f96e8077010 0x7f96e80794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:05.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.125+0000 7f96f97fa640 1 -- 172.21.15.159:0/1514189327 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6401+0+0 (secure 0 0 0) 0x7f96f40b98c0 con 0x7f96fc157d50 2024-07-24T16:37:05.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.125+0000 7f9700aae640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f96e8077010 0x7f96e80794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:05.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.125+0000 7f9700aae640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f96e8077010 0x7f96e80794d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f96ec004630 tx=0x7f96ec00b2e0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:05.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.129+0000 7f96f97fa640 1 -- 172.21.15.159:0/1514189327 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f96f4082240 con 0x7f96fc157d50 2024-07-24T16:37:05.352 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:05.349+0000 7f9702d12640 1 -- 172.21.15.159:0/1514189327 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f96fc155f60 con 0x7f96fc157d50 2024-07-24T16:37:06.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.001+0000 7f96f97fa640 1 -- 172.21.15.159:0/1514189327 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v24) ==== 122+0+0 (secure 0 0 0) 0x7f96f4086790 con 0x7f96fc157d50 2024-07-24T16:37:06.006 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.003+0000 7f9702d12640 1 -- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f96e8077010 msgr2=0x7f96e80794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.003+0000 7f9702d12640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f96e8077010 0x7f96e80794d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f96ec004630 tx=0x7f96ec00b2e0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.003+0000 7f9702d12640 1 -- 172.21.15.159:0/1514189327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96fc157d50 msgr2=0x7f96fc0a9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.003+0000 7f9702d12640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96fc157d50 0x7f96fc0a9480 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f96f40099c0 tx=0x7f96f4003910 comp rx=0 tx=0).stop 2024-07-24T16:37:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.004+0000 7f9702d12640 1 -- 172.21.15.159:0/1514189327 shutdown_connections 2024-07-24T16:37:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.004+0000 7f9702d12640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f96e8077010 0x7f96e80794d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.004+0000 7f9702d12640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f96fc157d50 0x7f96fc0a9480 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.004+0000 7f9702d12640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f96fc070500 0x7f96fc1441d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.004+0000 7f9702d12640 1 --2- 172.21.15.159:0/1514189327 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f96fc06f1c0 0x7f96fc0aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.004+0000 7f9702d12640 1 -- 172.21.15.159:0/1514189327 >> 172.21.15.159:0/1514189327 conn(0x7f96fc06d450 msgr2=0x7f96fc0b1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.004+0000 7f9702d12640 1 -- 172.21.15.159:0/1514189327 shutdown_connections 2024-07-24T16:37:06.007 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.004+0000 7f9702d12640 1 -- 172.21.15.159:0/1514189327 wait complete. 2024-07-24T16:37:06.020 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-07-24T16:37:06.021 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:37:06.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.127+0000 7f9f12f32640 1 -- 172.21.15.159:0/869982075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef80040d0 msgr2=0x7f9ef8004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.127+0000 7f9f12f32640 1 --2- 172.21.15.159:0/869982075 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef80040d0 0x7f9ef8004800 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00c610 tx=0x7f9ef8005830 comp rx=0 tx=0).stop 2024-07-24T16:37:06.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.127+0000 7f9f114cf640 1 -- 172.21.15.159:0/869982075 reap_dead start 2024-07-24T16:37:06.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.127+0000 7f9f12f32640 1 -- 172.21.15.159:0/869982075 shutdown_connections 2024-07-24T16:37:06.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.127+0000 7f9f12f32640 1 -- 172.21.15.159:0/869982075 >> 172.21.15.159:0/869982075 conn(0x7f9f0c09cd30 msgr2=0x7f9f0c0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:06.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.127+0000 7f9f12f32640 1 -- 172.21.15.159:0/869982075 shutdown_connections 2024-07-24T16:37:06.130 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.127+0000 7f9f12f32640 1 -- 172.21.15.159:0/869982075 wait complete. 2024-07-24T16:37:06.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.128+0000 7f9f12f32640 1 Processor -- start 2024-07-24T16:37:06.131 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.128+0000 7f9f12f32640 1 -- start start 2024-07-24T16:37:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f12f32640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef80040d0 0x7f9f0c1601d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f12f32640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9f0c0cab60 0x7f9f0c1575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f12f32640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9f0c1f4b80 0x7f9f0c1f5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f12f32640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c0cfd80 con 0x7f9ef80040d0 2024-07-24T16:37:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f12f32640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f9f0c0cfc00 con 0x7f9f0c1f4b80 2024-07-24T16:37:06.133 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f12f32640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f9f0c0cff00 con 0x7f9f0c0cab60 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f10cce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef80040d0 0x7f9f0c1601d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f10cce640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef80040d0 0x7f9f0c1601d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47244/0 (socket says 172.21.15.159:47244) 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f10cce640 1 -- 172.21.15.159:0/705820410 learned_addr learned my addr 172.21.15.159:0/705820410 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f114cf640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9f0c1f4b80 0x7f9f0c1f5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f0bfff640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9f0c0cab60 0x7f9f0c1575b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f10cce640 1 -- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9f0c0cab60 msgr2=0x7f9f0c1575b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f10cce640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9f0c0cab60 0x7f9f0c1575b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f10cce640 1 -- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9f0c1f4b80 msgr2=0x7f9f0c1f5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f10cce640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9f0c1f4b80 0x7f9f0c1f5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f10cce640 1 -- 172.21.15.159:0/705820410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f0c160e20 con 0x7f9ef80040d0 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.129+0000 7f9f114cf640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9f0c1f4b80 0x7f9f0c1f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.130+0000 7f9f10cce640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef80040d0 0x7f9f0c1601d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9f04004650 tx=0x7f9f0400bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.130+0000 7f9f097fa640 1 -- 172.21.15.159:0/705820410 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f04010b10 con 0x7f9ef80040d0 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.130+0000 7f9f097fa640 1 -- 172.21.15.159:0/705820410 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f04015070 con 0x7f9ef80040d0 2024-07-24T16:37:06.134 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.130+0000 7f9f12f32640 1 -- 172.21.15.159:0/705820410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f0c15a500 con 0x7f9ef80040d0 2024-07-24T16:37:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.130+0000 7f9f097fa640 1 -- 172.21.15.159:0/705820410 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f0401a470 con 0x7f9ef80040d0 2024-07-24T16:37:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.130+0000 7f9f12f32640 1 -- 172.21.15.159:0/705820410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f0c160b40 con 0x7f9ef80040d0 2024-07-24T16:37:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.131+0000 7f9f12f32640 1 -- 172.21.15.159:0/705820410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f0c161f20 con 0x7f9ef80040d0 2024-07-24T16:37:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.131+0000 7f9f097fa640 1 -- 172.21.15.159:0/705820410 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f9f0401a610 con 0x7f9ef80040d0 2024-07-24T16:37:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.132+0000 7f9f097fa640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f9eec077040 0x7f9eec079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:06.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.132+0000 7f9f097fa640 1 -- 172.21.15.159:0/705820410 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6401+0+0 (secure 0 0 0) 0x7f9f04099860 con 0x7f9ef80040d0 2024-07-24T16:37:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.132+0000 7f9f0bfff640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f9eec077040 0x7f9eec079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:06.136 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.132+0000 7f9f0bfff640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f9eec077040 0x7f9eec079500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00c610 tx=0x7f9efc038040 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:06.138 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.136+0000 7f9f097fa640 1 -- 172.21.15.159:0/705820410 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f9f0c160e20 con 0x7f9ef80040d0 2024-07-24T16:37:06.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.354+0000 7f9f12f32640 1 -- 172.21.15.159:0/705820410 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f0c0b8850 con 0x7f9ef80040d0 2024-07-24T16:37:06.357 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.355+0000 7f9f097fa640 1 -- 172.21.15.159:0/705820410 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5229 (secure 0 0 0) 0x7f9f04062830 con 0x7f9ef80040d0 2024-07-24T16:37:06.358 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:37:06.358 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-07-24T16:37:06:000526+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2788613741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":2788613741},{"type":"v1","addr":"172.21.15.193:6837","nonce":2788613741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/804895322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":804895322},{"type":"v1","addr":"172.21.15.193:6835","nonce":804895322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/4181924724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4181924724},{"type":"v1","addr":"172.21.15.159:6834","nonce":4181924724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:37:03.352837+0000","modified":"2024-07-24T16:37:05.351191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5796":{"gid":5796,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6835/433186879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":433186879},{"type":"v1","addr":"172.21.15.159:6835","nonce":433186879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5796,"qdb_cluster":[5796]},"id":3}]} 2024-07-24T16:37:06.358 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-07-24T16:37:06.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.357+0000 7f9f12f32640 1 -- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f9eec077040 msgr2=0x7f9eec079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.357+0000 7f9f12f32640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f9eec077040 0x7f9eec079500 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9efc00c610 tx=0x7f9efc038040 comp rx=0 tx=0).stop 2024-07-24T16:37:06.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.357+0000 7f9f12f32640 1 -- 172.21.15.159:0/705820410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef80040d0 msgr2=0x7f9f0c1601d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.357+0000 7f9f12f32640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef80040d0 0x7f9f0c1601d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f9f04004650 tx=0x7f9f0400bac0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.357+0000 7f9f12f32640 1 -- 172.21.15.159:0/705820410 shutdown_connections 2024-07-24T16:37:06.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.357+0000 7f9f12f32640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f9f0c1f4b80 0x7f9f0c1f5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.357+0000 7f9f12f32640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f9f0c0cab60 0x7f9f0c1575b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.357+0000 7f9f12f32640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f9eec077040 0x7f9eec079500 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.357+0000 7f9f12f32640 1 --2- 172.21.15.159:0/705820410 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f9ef80040d0 0x7f9f0c1601d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.357+0000 7f9f12f32640 1 -- 172.21.15.159:0/705820410 >> 172.21.15.159:0/705820410 conn(0x7f9f0c09cd30 msgr2=0x7f9f0c0b9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:06.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.357+0000 7f9f12f32640 1 -- 172.21.15.159:0/705820410 shutdown_connections 2024-07-24T16:37:06.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.357+0000 7f9f12f32640 1 -- 172.21.15.159:0/705820410 wait complete. 2024-07-24T16:37:06.372 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:37:06.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.472+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1955076776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c10004800 msgr2=0x7f3c10004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.475 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.472+0000 7f3c2bebe640 1 --2- 172.21.15.159:0/1955076776 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c10004800 0x7f3c10004c80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f3c240aead0 tx=0x7f3c10005830 comp rx=0 tx=0).stop 2024-07-24T16:37:06.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.472+0000 7f3c2a45b640 1 -- 172.21.15.159:0/1955076776 reap_dead start 2024-07-24T16:37:06.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.472+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1955076776 shutdown_connections 2024-07-24T16:37:06.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.472+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1955076776 >> 172.21.15.159:0/1955076776 conn(0x7f3c2406c560 msgr2=0x7f3c2406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:06.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.473+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1955076776 shutdown_connections 2024-07-24T16:37:06.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.473+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1955076776 wait complete. 2024-07-24T16:37:06.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.474+0000 7f3c2bebe640 1 Processor -- start 2024-07-24T16:37:06.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.474+0000 7f3c2bebe640 1 -- start start 2024-07-24T16:37:06.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.474+0000 7f3c2bebe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3c10004800 0x7f3c241f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:06.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.474+0000 7f3c2bebe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3c241e4670 0x7f3c24156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:06.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.474+0000 7f3c2bebe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c241f5f90 0x7f3c2415bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:06.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.474+0000 7f3c2bebe640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3c24159d80 con 0x7f3c241f5f90 2024-07-24T16:37:06.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.474+0000 7f3c2bebe640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3c2406fd00 con 0x7f3c10004800 2024-07-24T16:37:06.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.474+0000 7f3c2bebe640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3c24159f00 con 0x7f3c241e4670 2024-07-24T16:37:06.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c2a45b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c241f5f90 0x7f3c2415bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:06.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c2a45b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c241f5f90 0x7f3c2415bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47272/0 (socket says 172.21.15.159:47272) 2024-07-24T16:37:06.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c2a45b640 1 -- 172.21.15.159:0/1957274524 learned_addr learned my addr 172.21.15.159:0/1957274524 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:06.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c29c5a640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3c10004800 0x7f3c241f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:06.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c29459640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3c241e4670 0x7f3c24156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:06.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c2a45b640 1 -- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3c241e4670 msgr2=0x7f3c24156040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c2a45b640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3c241e4670 0x7f3c24156040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c2a45b640 1 -- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3c10004800 msgr2=0x7f3c241f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c2a45b640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3c10004800 0x7f3c241f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c2a45b640 1 -- 172.21.15.159:0/1957274524 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c241e4d10 con 0x7f3c241f5f90 2024-07-24T16:37:06.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c29459640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3c241e4670 0x7f3c24156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:37:06.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c2a45b640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c241f5f90 0x7f3c2415bdd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3c240b2fd0 tx=0x7f3c20011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:06.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c1a7fc640 1 -- 172.21.15.159:0/1957274524 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c2000fc20 con 0x7f3c241f5f90 2024-07-24T16:37:06.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c1a7fc640 1 -- 172.21.15.159:0/1957274524 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c2000fde0 con 0x7f3c241f5f90 2024-07-24T16:37:06.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1957274524 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c241f20f0 con 0x7f3c241f5f90 2024-07-24T16:37:06.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c1a7fc640 1 -- 172.21.15.159:0/1957274524 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c20004280 con 0x7f3c241f5f90 2024-07-24T16:37:06.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.475+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1957274524 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c241e4ff0 con 0x7f3c241f5f90 2024-07-24T16:37:06.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.476+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1957274524 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c2415a280 con 0x7f3c241f5f90 2024-07-24T16:37:06.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.477+0000 7f3c1a7fc640 1 -- 172.21.15.159:0/1957274524 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f3c20020020 con 0x7f3c241f5f90 2024-07-24T16:37:06.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.477+0000 7f3c1a7fc640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3c08077040 0x7f3c08079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:06.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.478+0000 7f3c1a7fc640 1 -- 172.21.15.159:0/1957274524 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6401+0+0 (secure 0 0 0) 0x7f3c20099010 con 0x7f3c241f5f90 2024-07-24T16:37:06.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.478+0000 7f3c29c5a640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3c08077040 0x7f3c08079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:06.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.478+0000 7f3c29c5a640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3c08077040 0x7f3c08079500 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c001330 tx=0x7f3c1c006aa0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:06.484 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.482+0000 7f3c1a7fc640 1 -- 172.21.15.159:0/1957274524 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f3c20062070 con 0x7f3c241f5f90 2024-07-24T16:37:06.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.666+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1957274524 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c241e4a50 con 0x7f3c241f5f90 2024-07-24T16:37:06.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.668+0000 7f3c1a7fc640 1 -- 172.21.15.159:0/1957274524 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) ==== 74+0+17432 (secure 0 0 0) 0x7f3c2006a2b0 con 0x7f3c241f5f90 2024-07-24T16:37:06.671 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:37:06.671 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":63,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:37:04.995881+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:37:00.987259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-07-24T16:37:02.311704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":4,"length":1},{"begin":14,"length":1},{"begin":24,"length":1},{"begin":35,"length":1},{"begin":41,"length":2},{"begin":46,"length":1},{"begin":52,"length":1},{"begin":56,"length":1},{"begin":63,"length":1},{"begin":67,"length":1},{"begin":74,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":88,"length":1},{"begin":95,"length":1},{"begin":99,"length":1},{"begin":106,"length":1},{"begin":203,"length":18}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:37:06.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.670+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3c08077040 msgr2=0x7f3c08079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.670+0000 7f3c2bebe640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3c08077040 0x7f3c08079500 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c001330 tx=0x7f3c1c006aa0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.670+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1957274524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c241f5f90 msgr2=0x7f3c2415bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.670+0000 7f3c2bebe640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c241f5f90 0x7f3c2415bdd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f3c240b2fd0 tx=0x7f3c20011e70 comp rx=0 tx=0).stop 2024-07-24T16:37:06.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.670+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1957274524 shutdown_connections 2024-07-24T16:37:06.673 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.670+0000 7f3c2bebe640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3c08077040 0x7f3c08079500 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.670+0000 7f3c2bebe640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3c241f5f90 0x7f3c2415bdd0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.670+0000 7f3c2bebe640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3c241e4670 0x7f3c24156040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.670+0000 7f3c2bebe640 1 --2- 172.21.15.159:0/1957274524 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3c10004800 0x7f3c241f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.670+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1957274524 >> 172.21.15.159:0/1957274524 conn(0x7f3c2406c560 msgr2=0x7f3c2406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:06.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.670+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1957274524 shutdown_connections 2024-07-24T16:37:06.674 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.670+0000 7f3c2bebe640 1 -- 172.21.15.159:0/1957274524 wait complete. 2024-07-24T16:37:06.683 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-07-24T16:37:06.683 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:37:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.785+0000 7fb5ea119640 1 -- 172.21.15.159:0/474719392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e406dba0 msgr2=0x7fb5e40cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.785+0000 7fb5ea119640 1 --2- 172.21.15.159:0/474719392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e406dba0 0x7fb5e40cbc10 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fb5d8005fd0 tx=0x7fb5d802a5d0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.785+0000 7fb5ea119640 1 -- 172.21.15.159:0/474719392 shutdown_connections 2024-07-24T16:37:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.785+0000 7fb5ea119640 1 --2- 172.21.15.159:0/474719392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5e40cfb50 0x7fb5e415b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.785+0000 7fb5ea119640 1 --2- 172.21.15.159:0/474719392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e406dba0 0x7fb5e40cbc10 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.785+0000 7fb5ea119640 1 -- 172.21.15.159:0/474719392 >> 172.21.15.159:0/474719392 conn(0x7fb5e406c560 msgr2=0x7fb5e406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.785+0000 7fb5ea119640 1 -- 172.21.15.159:0/474719392 shutdown_connections 2024-07-24T16:37:06.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.785+0000 7fb5ea119640 1 -- 172.21.15.159:0/474719392 wait complete. 2024-07-24T16:37:06.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.786+0000 7fb5ea119640 1 Processor -- start 2024-07-24T16:37:06.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.786+0000 7fb5ea119640 1 -- start start 2024-07-24T16:37:06.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5ea119640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5e406dba0 0x7fb5e41484b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:06.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5ea119640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5e40cf770 0x7fb5e40b0b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:06.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5ea119640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e40cfb50 0x7fb5e40b10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:06.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5ea119640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e40aeab0 con 0x7fb5e40cfb50 2024-07-24T16:37:06.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5ea119640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e40ae930 con 0x7fb5e40cf770 2024-07-24T16:37:06.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5ea119640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb5e40aec30 con 0x7fb5e406dba0 2024-07-24T16:37:06.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5e3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e40cfb50 0x7fb5e40b10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:06.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5e3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e40cfb50 0x7fb5e40b10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47288/0 (socket says 172.21.15.159:47288) 2024-07-24T16:37:06.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5e3fff640 1 -- 172.21.15.159:0/2837944939 learned_addr learned my addr 172.21.15.159:0/2837944939 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:06.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5e37fe640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5e406dba0 0x7fb5e41484b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:06.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5e3fff640 1 -- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5e406dba0 msgr2=0x7fb5e41484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5e2ffd640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5e40cf770 0x7fb5e40b0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:06.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5e3fff640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5e406dba0 0x7fb5e41484b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5e3fff640 1 -- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5e40cf770 msgr2=0x7fb5e40b0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5e3fff640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5e40cf770 0x7fb5e40b0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5e3fff640 1 -- 172.21.15.159:0/2837944939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e40afb30 con 0x7fb5e40cfb50 2024-07-24T16:37:06.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5e37fe640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5e406dba0 0x7fb5e41484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:37:06.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5e2ffd640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5e40cf770 0x7fb5e40b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:37:06.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.787+0000 7fb5e3fff640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e40cfb50 0x7fb5e40b10d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00b440 tx=0x7fb5dc00b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:06.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.788+0000 7fb5cbfff640 1 -- 172.21.15.159:0/2837944939 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc015020 con 0x7fb5e40cfb50 2024-07-24T16:37:06.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.788+0000 7fb5cbfff640 1 -- 172.21.15.159:0/2837944939 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5dc011940 con 0x7fb5e40cfb50 2024-07-24T16:37:06.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.788+0000 7fb5ea119640 1 -- 172.21.15.159:0/2837944939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e40afe10 con 0x7fb5e40cfb50 2024-07-24T16:37:06.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.788+0000 7fb5cbfff640 1 -- 172.21.15.159:0/2837944939 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc011d90 con 0x7fb5e40cfb50 2024-07-24T16:37:06.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.788+0000 7fb5ea119640 1 -- 172.21.15.159:0/2837944939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e40b03d0 con 0x7fb5e40cfb50 2024-07-24T16:37:06.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.789+0000 7fb5ea119640 1 -- 172.21.15.159:0/2837944939 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e415b4b0 con 0x7fb5e40cfb50 2024-07-24T16:37:06.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.789+0000 7fb5cbfff640 1 -- 172.21.15.159:0/2837944939 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fb5dc018020 con 0x7fb5e40cfb50 2024-07-24T16:37:06.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.790+0000 7fb5cbfff640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb5d0077010 0x7fb5d00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:06.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.790+0000 7fb5cbfff640 1 -- 172.21.15.159:0/2837944939 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6401+0+0 (secure 0 0 0) 0x7fb5dc098ba0 con 0x7fb5e40cfb50 2024-07-24T16:37:06.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.790+0000 7fb5e37fe640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb5d0077010 0x7fb5d00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:06.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.790+0000 7fb5e37fe640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb5d0077010 0x7fb5d00794d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40b0b40 tx=0x7fb5d4009040 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:06.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.794+0000 7fb5cbfff640 1 -- 172.21.15.159:0/2837944939 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fb5dc01f020 con 0x7fb5e40cfb50 2024-07-24T16:37:06.979 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.976+0000 7fb5ea119640 1 -- 172.21.15.159:0/2837944939 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5e40ce5b0 con 0x7fb5d0077010 2024-07-24T16:37:06.983 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.982+0000 7fb5cbfff640 1 -- 172.21.15.159:0/2837944939 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7fb5e40ce5b0 con 0x7fb5d0077010 2024-07-24T16:37:06.987 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:37:06.988 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:37:06.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.984+0000 7fb5ea119640 1 -- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb5d0077010 msgr2=0x7fb5d00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.984+0000 7fb5ea119640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb5d0077010 0x7fb5d00794d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40b0b40 tx=0x7fb5d4009040 comp rx=0 tx=0).stop 2024-07-24T16:37:06.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.984+0000 7fb5ea119640 1 -- 172.21.15.159:0/2837944939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e40cfb50 msgr2=0x7fb5e40b10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:06.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.984+0000 7fb5ea119640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e40cfb50 0x7fb5e40b10d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc00b440 tx=0x7fb5dc00b840 comp rx=0 tx=0).stop 2024-07-24T16:37:06.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.984+0000 7fb5ea119640 1 -- 172.21.15.159:0/2837944939 shutdown_connections 2024-07-24T16:37:06.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.984+0000 7fb5ea119640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb5d0077010 0x7fb5d00794d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.984+0000 7fb5ea119640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb5e40cfb50 0x7fb5e40b10d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.984+0000 7fb5ea119640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb5e40cf770 0x7fb5e40b0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.984+0000 7fb5ea119640 1 --2- 172.21.15.159:0/2837944939 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb5e406dba0 0x7fb5e41484b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:06.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.984+0000 7fb5ea119640 1 -- 172.21.15.159:0/2837944939 >> 172.21.15.159:0/2837944939 conn(0x7fb5e406c560 msgr2=0x7fb5e40728d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:06.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.984+0000 7fb5ea119640 1 -- 172.21.15.159:0/2837944939 shutdown_connections 2024-07-24T16:37:06.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:06.984+0000 7fb5ea119640 1 -- 172.21.15.159:0/2837944939 wait complete. 2024-07-24T16:37:06.998 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-07-24T16:37:06.546900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":169,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":318992,"kb_used_data":7052,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754655728,"statfs":{"total":773094113280,"available":772767465472,"internally_reserved":0,"allocated":7221248,"data_stored":4141116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.570476"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.004267+0000","last_change":"2024-07-24T16:37:04.000283+0000","last_active":"2024-07-24T16:37:04.004267+0000","last_peered":"2024-07-24T16:37:04.004267+0000","last_clean":"2024-07-24T16:37:04.004267+0000","last_became_active":"2024-07-24T16:37:04.000007+0000","last_became_peered":"2024-07-24T16:37:04.000007+0000","last_unstale":"2024-07-24T16:37:04.004267+0000","last_undegraded":"2024-07-24T16:37:04.004267+0000","last_fullsized":"2024-07-24T16:37:04.004267+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:32:24.649601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.015451+0000","last_change":"2024-07-24T16:37:04.011891+0000","last_active":"2024-07-24T16:37:04.015451+0000","last_peered":"2024-07-24T16:37:04.015451+0000","last_clean":"2024-07-24T16:37:04.015451+0000","last_became_active":"2024-07-24T16:37:04.011627+0000","last_became_peered":"2024-07-24T16:37:04.011627+0000","last_unstale":"2024-07-24T16:37:04.015451+0000","last_undegraded":"2024-07-24T16:37:04.015451+0000","last_fullsized":"2024-07-24T16:37:04.015451+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:09:05.945632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.022969+0000","last_change":"2024-07-24T16:37:04.014901+0000","last_active":"2024-07-24T16:37:04.022969+0000","last_peered":"2024-07-24T16:37:04.022969+0000","last_clean":"2024-07-24T16:37:04.022969+0000","last_became_active":"2024-07-24T16:37:04.014649+0000","last_became_peered":"2024-07-24T16:37:04.014649+0000","last_unstale":"2024-07-24T16:37:04.022969+0000","last_undegraded":"2024-07-24T16:37:04.022969+0000","last_fullsized":"2024-07-24T16:37:04.022969+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:57:00.375546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.015438+0000","last_change":"2024-07-24T16:37:04.011677+0000","last_active":"2024-07-24T16:37:04.015438+0000","last_peered":"2024-07-24T16:37:04.015438+0000","last_clean":"2024-07-24T16:37:04.015438+0000","last_became_active":"2024-07-24T16:37:04.011002+0000","last_became_peered":"2024-07-24T16:37:04.011002+0000","last_unstale":"2024-07-24T16:37:04.015438+0000","last_undegraded":"2024-07-24T16:37:04.015438+0000","last_fullsized":"2024-07-24T16:37:04.015438+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:27:03.173404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003931+0000","last_change":"2024-07-24T16:37:04.005188+0000","last_active":"2024-07-24T16:37:05.003931+0000","last_peered":"2024-07-24T16:37:05.003931+0000","last_clean":"2024-07-24T16:37:05.003931+0000","last_became_active":"2024-07-24T16:37:04.004895+0000","last_became_peered":"2024-07-24T16:37:04.004895+0000","last_unstale":"2024-07-24T16:37:05.003931+0000","last_undegraded":"2024-07-24T16:37:05.003931+0000","last_fullsized":"2024-07-24T16:37:05.003931+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:22:29.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.012918+0000","last_change":"2024-07-24T16:37:04.009148+0000","last_active":"2024-07-24T16:37:04.012918+0000","last_peered":"2024-07-24T16:37:04.012918+0000","last_clean":"2024-07-24T16:37:04.012918+0000","last_became_active":"2024-07-24T16:37:04.008866+0000","last_became_peered":"2024-07-24T16:37:04.008866+0000","last_unstale":"2024-07-24T16:37:04.012918+0000","last_undegraded":"2024-07-24T16:37:04.012918+0000","last_fullsized":"2024-07-24T16:37:04.012918+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:24.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024536+0000","last_change":"2024-07-24T16:37:04.020944+0000","last_active":"2024-07-24T16:37:04.024536+0000","last_peered":"2024-07-24T16:37:04.024536+0000","last_clean":"2024-07-24T16:37:04.024536+0000","last_became_active":"2024-07-24T16:37:04.019103+0000","last_became_peered":"2024-07-24T16:37:04.019103+0000","last_unstale":"2024-07-24T16:37:04.024536+0000","last_undegraded":"2024-07-24T16:37:04.024536+0000","last_fullsized":"2024-07-24T16:37:04.024536+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:07:32.475581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024933+0000","last_change":"2024-07-24T16:37:04.022838+0000","last_active":"2024-07-24T16:37:04.024933+0000","last_peered":"2024-07-24T16:37:04.024933+0000","last_clean":"2024-07-24T16:37:04.024933+0000","last_became_active":"2024-07-24T16:37:04.022559+0000","last_became_peered":"2024-07-24T16:37:04.022559+0000","last_unstale":"2024-07-24T16:37:04.024933+0000","last_undegraded":"2024-07-24T16:37:04.024933+0000","last_fullsized":"2024-07-24T16:37:04.024933+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:57:38.812681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.025102+0000","last_change":"2024-07-24T16:37:04.024211+0000","last_active":"2024-07-24T16:37:04.025102+0000","last_peered":"2024-07-24T16:37:04.025102+0000","last_clean":"2024-07-24T16:37:04.025102+0000","last_became_active":"2024-07-24T16:37:04.023933+0000","last_became_peered":"2024-07-24T16:37:04.023933+0000","last_unstale":"2024-07-24T16:37:04.025102+0000","last_undegraded":"2024-07-24T16:37:04.025102+0000","last_fullsized":"2024-07-24T16:37:04.025102+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:47:32.209575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.001058+0000","last_change":"2024-07-24T16:37:03.998622+0000","last_active":"2024-07-24T16:37:04.001058+0000","last_peered":"2024-07-24T16:37:04.001058+0000","last_clean":"2024-07-24T16:37:04.001058+0000","last_became_active":"2024-07-24T16:37:03.997985+0000","last_became_peered":"2024-07-24T16:37:03.997985+0000","last_unstale":"2024-07-24T16:37:04.001058+0000","last_undegraded":"2024-07-24T16:37:04.001058+0000","last_fullsized":"2024-07-24T16:37:04.001058+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:45:37.666598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.004765+0000","last_change":"2024-07-24T16:37:04.008205+0000","last_active":"2024-07-24T16:37:05.004765+0000","last_peered":"2024-07-24T16:37:05.004765+0000","last_clean":"2024-07-24T16:37:05.004765+0000","last_became_active":"2024-07-24T16:37:04.006298+0000","last_became_peered":"2024-07-24T16:37:04.006298+0000","last_unstale":"2024-07-24T16:37:05.004765+0000","last_undegraded":"2024-07-24T16:37:05.004765+0000","last_fullsized":"2024-07-24T16:37:05.004765+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:51:24.513752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.014418+0000","last_change":"2024-07-24T16:37:04.006667+0000","last_active":"2024-07-24T16:37:04.014418+0000","last_peered":"2024-07-24T16:37:04.014418+0000","last_clean":"2024-07-24T16:37:04.014418+0000","last_became_active":"2024-07-24T16:37:04.005908+0000","last_became_peered":"2024-07-24T16:37:04.005908+0000","last_unstale":"2024-07-24T16:37:04.014418+0000","last_undegraded":"2024-07-24T16:37:04.014418+0000","last_fullsized":"2024-07-24T16:37:04.014418+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:27:17.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.009319+0000","last_change":"2024-07-24T16:37:04.002494+0000","last_active":"2024-07-24T16:37:04.009319+0000","last_peered":"2024-07-24T16:37:04.009319+0000","last_clean":"2024-07-24T16:37:04.009319+0000","last_became_active":"2024-07-24T16:37:04.001872+0000","last_became_peered":"2024-07-24T16:37:04.001872+0000","last_unstale":"2024-07-24T16:37:04.009319+0000","last_undegraded":"2024-07-24T16:37:04.009319+0000","last_fullsized":"2024-07-24T16:37:04.009319+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:45.075854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024415+0000","last_change":"2024-07-24T16:37:04.018574+0000","last_active":"2024-07-24T16:37:04.024415+0000","last_peered":"2024-07-24T16:37:04.024415+0000","last_clean":"2024-07-24T16:37:04.024415+0000","last_became_active":"2024-07-24T16:37:04.018314+0000","last_became_peered":"2024-07-24T16:37:04.018314+0000","last_unstale":"2024-07-24T16:37:04.024415+0000","last_undegraded":"2024-07-24T16:37:04.024415+0000","last_fullsized":"2024-07-24T16:37:04.024415+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:57.680599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.015073+0000","last_change":"2024-07-24T16:37:04.009736+0000","last_active":"2024-07-24T16:37:04.015073+0000","last_peered":"2024-07-24T16:37:04.015073+0000","last_clean":"2024-07-24T16:37:04.015073+0000","last_became_active":"2024-07-24T16:37:04.009473+0000","last_became_peered":"2024-07-24T16:37:04.009473+0000","last_unstale":"2024-07-24T16:37:04.015073+0000","last_undegraded":"2024-07-24T16:37:04.015073+0000","last_fullsized":"2024-07-24T16:37:04.015073+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:38:58.077671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.007615+0000","last_change":"2024-07-24T16:37:04.001780+0000","last_active":"2024-07-24T16:37:04.007615+0000","last_peered":"2024-07-24T16:37:04.007615+0000","last_clean":"2024-07-24T16:37:04.007615+0000","last_became_active":"2024-07-24T16:37:04.001535+0000","last_became_peered":"2024-07-24T16:37:04.001535+0000","last_unstale":"2024-07-24T16:37:04.007615+0000","last_undegraded":"2024-07-24T16:37:04.007615+0000","last_fullsized":"2024-07-24T16:37:04.007615+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:20.158902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024469+0000","last_change":"2024-07-24T16:37:04.021471+0000","last_active":"2024-07-24T16:37:04.024469+0000","last_peered":"2024-07-24T16:37:04.024469+0000","last_clean":"2024-07-24T16:37:04.024469+0000","last_became_active":"2024-07-24T16:37:04.019159+0000","last_became_peered":"2024-07-24T16:37:04.019159+0000","last_unstale":"2024-07-24T16:37:04.024469+0000","last_undegraded":"2024-07-24T16:37:04.024469+0000","last_fullsized":"2024-07-24T16:37:04.024469+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:12:33.200486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.015417+0000","last_change":"2024-07-24T16:37:04.011422+0000","last_active":"2024-07-24T16:37:04.015417+0000","last_peered":"2024-07-24T16:37:04.015417+0000","last_clean":"2024-07-24T16:37:04.015417+0000","last_became_active":"2024-07-24T16:37:04.011166+0000","last_became_peered":"2024-07-24T16:37:04.011166+0000","last_unstale":"2024-07-24T16:37:04.015417+0000","last_undegraded":"2024-07-24T16:37:04.015417+0000","last_fullsized":"2024-07-24T16:37:04.015417+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:56.542664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.022945+0000","last_change":"2024-07-24T16:37:04.008292+0000","last_active":"2024-07-24T16:37:04.022945+0000","last_peered":"2024-07-24T16:37:04.022945+0000","last_clean":"2024-07-24T16:37:04.022945+0000","last_became_active":"2024-07-24T16:37:04.008030+0000","last_became_peered":"2024-07-24T16:37:04.008030+0000","last_unstale":"2024-07-24T16:37:04.022945+0000","last_undegraded":"2024-07-24T16:37:04.022945+0000","last_fullsized":"2024-07-24T16:37:04.022945+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:01:38.702060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003311+0000","last_change":"2024-07-24T16:37:04.007961+0000","last_active":"2024-07-24T16:37:05.003311+0000","last_peered":"2024-07-24T16:37:05.003311+0000","last_clean":"2024-07-24T16:37:05.003311+0000","last_became_active":"2024-07-24T16:37:04.007154+0000","last_became_peered":"2024-07-24T16:37:04.007154+0000","last_unstale":"2024-07-24T16:37:05.003311+0000","last_undegraded":"2024-07-24T16:37:05.003311+0000","last_fullsized":"2024-07-24T16:37:05.003311+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:45.075854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003311+0000","last_change":"2024-07-24T16:37:04.007037+0000","last_active":"2024-07-24T16:37:05.003311+0000","last_peered":"2024-07-24T16:37:05.003311+0000","last_clean":"2024-07-24T16:37:05.003311+0000","last_became_active":"2024-07-24T16:37:04.006749+0000","last_became_peered":"2024-07-24T16:37:04.006749+0000","last_unstale":"2024-07-24T16:37:05.003311+0000","last_undegraded":"2024-07-24T16:37:05.003311+0000","last_fullsized":"2024-07-24T16:37:05.003311+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:20.158902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.022115+0000","last_change":"2024-07-24T16:37:04.020205+0000","last_active":"2024-07-24T16:37:04.022115+0000","last_peered":"2024-07-24T16:37:04.022115+0000","last_clean":"2024-07-24T16:37:04.022115+0000","last_became_active":"2024-07-24T16:37:04.019931+0000","last_became_peered":"2024-07-24T16:37:04.019931+0000","last_unstale":"2024-07-24T16:37:04.022115+0000","last_undegraded":"2024-07-24T16:37:04.022115+0000","last_fullsized":"2024-07-24T16:37:04.022115+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:32.563976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.004449+0000","last_change":"2024-07-24T16:37:04.003751+0000","last_active":"2024-07-24T16:37:05.004449+0000","last_peered":"2024-07-24T16:37:05.004449+0000","last_clean":"2024-07-24T16:37:05.004449+0000","last_became_active":"2024-07-24T16:37:04.003501+0000","last_became_peered":"2024-07-24T16:37:04.003501+0000","last_unstale":"2024-07-24T16:37:05.004449+0000","last_undegraded":"2024-07-24T16:37:05.004449+0000","last_fullsized":"2024-07-24T16:37:05.004449+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:47:41.761372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024846+0000","last_change":"2024-07-24T16:37:04.023076+0000","last_active":"2024-07-24T16:37:04.024846+0000","last_peered":"2024-07-24T16:37:04.024846+0000","last_clean":"2024-07-24T16:37:04.024846+0000","last_became_active":"2024-07-24T16:37:04.021397+0000","last_became_peered":"2024-07-24T16:37:04.021397+0000","last_unstale":"2024-07-24T16:37:04.024846+0000","last_undegraded":"2024-07-24T16:37:04.024846+0000","last_fullsized":"2024-07-24T16:37:04.024846+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:17.190878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024970+0000","last_change":"2024-07-24T16:37:04.021808+0000","last_active":"2024-07-24T16:37:04.024970+0000","last_peered":"2024-07-24T16:37:04.024970+0000","last_clean":"2024-07-24T16:37:04.024970+0000","last_became_active":"2024-07-24T16:37:04.021195+0000","last_became_peered":"2024-07-24T16:37:04.021195+0000","last_unstale":"2024-07-24T16:37:04.024970+0000","last_undegraded":"2024-07-24T16:37:04.024970+0000","last_fullsized":"2024-07-24T16:37:04.024970+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:20:36.220044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.014439+0000","last_change":"2024-07-24T16:37:04.005510+0000","last_active":"2024-07-24T16:37:04.014439+0000","last_peered":"2024-07-24T16:37:04.014439+0000","last_clean":"2024-07-24T16:37:04.014439+0000","last_became_active":"2024-07-24T16:37:04.004807+0000","last_became_peered":"2024-07-24T16:37:04.004807+0000","last_unstale":"2024-07-24T16:37:04.014439+0000","last_undegraded":"2024-07-24T16:37:04.014439+0000","last_fullsized":"2024-07-24T16:37:04.014439+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:13:56.585430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.017188+0000","last_change":"2024-07-24T16:37:04.016153+0000","last_active":"2024-07-24T16:37:04.017188+0000","last_peered":"2024-07-24T16:37:04.017188+0000","last_clean":"2024-07-24T16:37:04.017188+0000","last_became_active":"2024-07-24T16:37:04.015860+0000","last_became_peered":"2024-07-24T16:37:04.015860+0000","last_unstale":"2024-07-24T16:37:04.017188+0000","last_undegraded":"2024-07-24T16:37:04.017188+0000","last_fullsized":"2024-07-24T16:37:04.017188+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:04:21.439720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003493+0000","last_change":"2024-07-24T16:37:04.006057+0000","last_active":"2024-07-24T16:37:05.003493+0000","last_peered":"2024-07-24T16:37:05.003493+0000","last_clean":"2024-07-24T16:37:05.003493+0000","last_became_active":"2024-07-24T16:37:04.005597+0000","last_became_peered":"2024-07-24T16:37:04.005597+0000","last_unstale":"2024-07-24T16:37:05.003493+0000","last_undegraded":"2024-07-24T16:37:05.003493+0000","last_fullsized":"2024-07-24T16:37:05.003493+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:24.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.023088+0000","last_change":"2024-07-24T16:37:04.015925+0000","last_active":"2024-07-24T16:37:04.023088+0000","last_peered":"2024-07-24T16:37:04.023088+0000","last_clean":"2024-07-24T16:37:04.023088+0000","last_became_active":"2024-07-24T16:37:04.015678+0000","last_became_peered":"2024-07-24T16:37:04.015678+0000","last_unstale":"2024-07-24T16:37:04.023088+0000","last_undegraded":"2024-07-24T16:37:04.023088+0000","last_fullsized":"2024-07-24T16:37:04.023088+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:17:08.333763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.016859+0000","last_change":"2024-07-24T16:37:04.014588+0000","last_active":"2024-07-24T16:37:04.016859+0000","last_peered":"2024-07-24T16:37:04.016859+0000","last_clean":"2024-07-24T16:37:04.016859+0000","last_became_active":"2024-07-24T16:37:04.014310+0000","last_became_peered":"2024-07-24T16:37:04.014310+0000","last_unstale":"2024-07-24T16:37:04.016859+0000","last_undegraded":"2024-07-24T16:37:04.016859+0000","last_fullsized":"2024-07-24T16:37:04.016859+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:31:41.870538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.018879+0000","last_change":"2024-07-24T16:37:04.007655+0000","last_active":"2024-07-24T16:37:04.018879+0000","last_peered":"2024-07-24T16:37:04.018879+0000","last_clean":"2024-07-24T16:37:04.018879+0000","last_became_active":"2024-07-24T16:37:04.007367+0000","last_became_peered":"2024-07-24T16:37:04.007367+0000","last_unstale":"2024-07-24T16:37:04.018879+0000","last_undegraded":"2024-07-24T16:37:04.018879+0000","last_fullsized":"2024-07-24T16:37:04.018879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:07:10.844077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.012926+0000","last_change":"2024-07-24T16:37:04.011681+0000","last_active":"2024-07-24T16:37:04.012926+0000","last_peered":"2024-07-24T16:37:04.012926+0000","last_clean":"2024-07-24T16:37:04.012926+0000","last_became_active":"2024-07-24T16:37:04.011439+0000","last_became_peered":"2024-07-24T16:37:04.011439+0000","last_unstale":"2024-07-24T16:37:04.012926+0000","last_undegraded":"2024-07-24T16:37:04.012926+0000","last_fullsized":"2024-07-24T16:37:04.012926+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:58:11.471962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.009787+0000","last_change":"2024-07-24T16:37:04.008494+0000","last_active":"2024-07-24T16:37:04.009787+0000","last_peered":"2024-07-24T16:37:04.009787+0000","last_clean":"2024-07-24T16:37:04.009787+0000","last_became_active":"2024-07-24T16:37:04.008128+0000","last_became_peered":"2024-07-24T16:37:04.008128+0000","last_unstale":"2024-07-24T16:37:04.009787+0000","last_undegraded":"2024-07-24T16:37:04.009787+0000","last_fullsized":"2024-07-24T16:37:04.009787+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:51:49.010336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"62'4","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003495+0000","last_change":"2024-07-24T16:37:03.003544+0000","last_active":"2024-07-24T16:37:05.003495+0000","last_peered":"2024-07-24T16:37:05.003495+0000","last_clean":"2024-07-24T16:37:05.003495+0000","last_became_active":"2024-07-24T16:37:03.003212+0000","last_became_peered":"2024-07-24T16:37:03.003212+0000","last_unstale":"2024-07-24T16:37:05.003495+0000","last_undegraded":"2024-07-24T16:37:05.003495+0000","last_fullsized":"2024-07-24T16:37:05.003495+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:10.767177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.011282+0000","last_change":"2024-07-24T16:37:04.007097+0000","last_active":"2024-07-24T16:37:04.011282+0000","last_peered":"2024-07-24T16:37:04.011282+0000","last_clean":"2024-07-24T16:37:04.011282+0000","last_became_active":"2024-07-24T16:37:04.006833+0000","last_became_peered":"2024-07-24T16:37:04.006833+0000","last_unstale":"2024-07-24T16:37:04.011282+0000","last_undegraded":"2024-07-24T16:37:04.011282+0000","last_fullsized":"2024-07-24T16:37:04.011282+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:30:30.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.017832+0000","last_change":"2024-07-24T16:37:03.008723+0000","last_active":"2024-07-24T16:37:04.017832+0000","last_peered":"2024-07-24T16:37:04.017832+0000","last_clean":"2024-07-24T16:37:04.017832+0000","last_became_active":"2024-07-24T16:37:03.008450+0000","last_became_peered":"2024-07-24T16:37:03.008450+0000","last_unstale":"2024-07-24T16:37:04.017832+0000","last_undegraded":"2024-07-24T16:37:04.017832+0000","last_fullsized":"2024-07-24T16:37:04.017832+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:00:20.422519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003059+0000","last_change":"2024-07-24T16:37:04.009602+0000","last_active":"2024-07-24T16:37:05.003059+0000","last_peered":"2024-07-24T16:37:05.003059+0000","last_clean":"2024-07-24T16:37:05.003059+0000","last_became_active":"2024-07-24T16:37:04.009341+0000","last_became_peered":"2024-07-24T16:37:04.009341+0000","last_unstale":"2024-07-24T16:37:05.003059+0000","last_undegraded":"2024-07-24T16:37:05.003059+0000","last_fullsized":"2024-07-24T16:37:05.003059+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:40.906131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.016423+0000","last_change":"2024-07-24T16:37:02.999430+0000","last_active":"2024-07-24T16:37:04.016423+0000","last_peered":"2024-07-24T16:37:04.016423+0000","last_clean":"2024-07-24T16:37:04.016423+0000","last_became_active":"2024-07-24T16:37:02.999177+0000","last_became_peered":"2024-07-24T16:37:02.999177+0000","last_unstale":"2024-07-24T16:37:04.016423+0000","last_undegraded":"2024-07-24T16:37:04.016423+0000","last_fullsized":"2024-07-24T16:37:04.016423+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:14:39.765664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.014458+0000","last_change":"2024-07-24T16:37:04.005041+0000","last_active":"2024-07-24T16:37:04.014458+0000","last_peered":"2024-07-24T16:37:04.014458+0000","last_clean":"2024-07-24T16:37:04.014458+0000","last_became_active":"2024-07-24T16:37:04.004752+0000","last_became_peered":"2024-07-24T16:37:04.004752+0000","last_unstale":"2024-07-24T16:37:04.014458+0000","last_undegraded":"2024-07-24T16:37:04.014458+0000","last_fullsized":"2024-07-24T16:37:04.014458+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:40:36.400835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.011940+0000","last_change":"2024-07-24T16:37:03.013833+0000","last_active":"2024-07-24T16:37:04.011940+0000","last_peered":"2024-07-24T16:37:04.011940+0000","last_clean":"2024-07-24T16:37:04.011940+0000","last_became_active":"2024-07-24T16:37:03.013501+0000","last_became_peered":"2024-07-24T16:37:03.013501+0000","last_unstale":"2024-07-24T16:37:04.011940+0000","last_undegraded":"2024-07-24T16:37:04.011940+0000","last_fullsized":"2024-07-24T16:37:04.011940+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:55.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.004042+0000","last_change":"2024-07-24T16:37:04.008541+0000","last_active":"2024-07-24T16:37:05.004042+0000","last_peered":"2024-07-24T16:37:05.004042+0000","last_clean":"2024-07-24T16:37:05.004042+0000","last_became_active":"2024-07-24T16:37:04.008251+0000","last_became_peered":"2024-07-24T16:37:04.008251+0000","last_unstale":"2024-07-24T16:37:05.004042+0000","last_undegraded":"2024-07-24T16:37:05.004042+0000","last_fullsized":"2024-07-24T16:37:05.004042+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:23:03.807268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.021030+0000","last_change":"2024-07-24T16:37:03.000053+0000","last_active":"2024-07-24T16:37:04.021030+0000","last_peered":"2024-07-24T16:37:04.021030+0000","last_clean":"2024-07-24T16:37:04.021030+0000","last_became_active":"2024-07-24T16:37:02.999733+0000","last_became_peered":"2024-07-24T16:37:02.999733+0000","last_unstale":"2024-07-24T16:37:04.021030+0000","last_undegraded":"2024-07-24T16:37:04.021030+0000","last_fullsized":"2024-07-24T16:37:04.021030+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:43:16.732334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.009867+0000","last_change":"2024-07-24T16:37:04.008622+0000","last_active":"2024-07-24T16:37:04.009867+0000","last_peered":"2024-07-24T16:37:04.009867+0000","last_clean":"2024-07-24T16:37:04.009867+0000","last_became_active":"2024-07-24T16:37:04.008293+0000","last_became_peered":"2024-07-24T16:37:04.008293+0000","last_unstale":"2024-07-24T16:37:04.009867+0000","last_undegraded":"2024-07-24T16:37:04.009867+0000","last_fullsized":"2024-07-24T16:37:04.009867+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:11:02.137962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.002979+0000","last_change":"2024-07-24T16:37:03.005837+0000","last_active":"2024-07-24T16:37:05.002979+0000","last_peered":"2024-07-24T16:37:05.002979+0000","last_clean":"2024-07-24T16:37:05.002979+0000","last_became_active":"2024-07-24T16:37:03.005494+0000","last_became_peered":"2024-07-24T16:37:03.005494+0000","last_unstale":"2024-07-24T16:37:05.002979+0000","last_undegraded":"2024-07-24T16:37:05.002979+0000","last_fullsized":"2024-07-24T16:37:05.002979+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:19.152923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.009439+0000","last_change":"2024-07-24T16:37:04.001679+0000","last_active":"2024-07-24T16:37:04.009439+0000","last_peered":"2024-07-24T16:37:04.009439+0000","last_clean":"2024-07-24T16:37:04.009439+0000","last_became_active":"2024-07-24T16:37:04.001396+0000","last_became_peered":"2024-07-24T16:37:04.001396+0000","last_unstale":"2024-07-24T16:37:04.009439+0000","last_undegraded":"2024-07-24T16:37:04.009439+0000","last_fullsized":"2024-07-24T16:37:04.009439+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:30:23.341481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003296+0000","last_change":"2024-07-24T16:37:03.003994+0000","last_active":"2024-07-24T16:37:05.003296+0000","last_peered":"2024-07-24T16:37:05.003296+0000","last_clean":"2024-07-24T16:37:05.003296+0000","last_became_active":"2024-07-24T16:37:03.003689+0000","last_became_peered":"2024-07-24T16:37:03.003689+0000","last_unstale":"2024-07-24T16:37:05.003296+0000","last_undegraded":"2024-07-24T16:37:05.003296+0000","last_fullsized":"2024-07-24T16:37:05.003296+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:17:37.057978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024578+0000","last_change":"2024-07-24T16:37:04.024282+0000","last_active":"2024-07-24T16:37:04.024578+0000","last_peered":"2024-07-24T16:37:04.024578+0000","last_clean":"2024-07-24T16:37:04.024578+0000","last_became_active":"2024-07-24T16:37:04.024040+0000","last_became_peered":"2024-07-24T16:37:04.024040+0000","last_unstale":"2024-07-24T16:37:04.024578+0000","last_undegraded":"2024-07-24T16:37:04.024578+0000","last_fullsized":"2024-07-24T16:37:04.024578+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:51:38.899349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.013985+0000","last_change":"2024-07-24T16:37:02.999879+0000","last_active":"2024-07-24T16:37:04.013985+0000","last_peered":"2024-07-24T16:37:04.013985+0000","last_clean":"2024-07-24T16:37:04.013985+0000","last_became_active":"2024-07-24T16:37:02.999554+0000","last_became_peered":"2024-07-24T16:37:02.999554+0000","last_unstale":"2024-07-24T16:37:04.013985+0000","last_undegraded":"2024-07-24T16:37:04.013985+0000","last_fullsized":"2024-07-24T16:37:04.013985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:10:25.228026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.002940+0000","last_change":"2024-07-24T16:37:04.012481+0000","last_active":"2024-07-24T16:37:05.002940+0000","last_peered":"2024-07-24T16:37:05.002940+0000","last_clean":"2024-07-24T16:37:05.002940+0000","last_became_active":"2024-07-24T16:37:04.012217+0000","last_became_peered":"2024-07-24T16:37:04.012217+0000","last_unstale":"2024-07-24T16:37:05.002940+0000","last_undegraded":"2024-07-24T16:37:05.002940+0000","last_fullsized":"2024-07-24T16:37:05.002940+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:10:47.439606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.002917+0000","last_change":"2024-07-24T16:37:03.005534+0000","last_active":"2024-07-24T16:37:04.002917+0000","last_peered":"2024-07-24T16:37:04.002917+0000","last_clean":"2024-07-24T16:37:04.002917+0000","last_became_active":"2024-07-24T16:37:03.005232+0000","last_became_peered":"2024-07-24T16:37:03.005232+0000","last_unstale":"2024-07-24T16:37:04.002917+0000","last_undegraded":"2024-07-24T16:37:04.002917+0000","last_fullsized":"2024-07-24T16:37:04.002917+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:18:00.748831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:03.997382+0000","last_change":"2024-07-24T16:37:03.995253+0000","last_active":"2024-07-24T16:37:03.997382+0000","last_peered":"2024-07-24T16:37:03.997382+0000","last_clean":"2024-07-24T16:37:03.997382+0000","last_became_active":"2024-07-24T16:37:03.994904+0000","last_became_peered":"2024-07-24T16:37:03.994904+0000","last_unstale":"2024-07-24T16:37:03.997382+0000","last_undegraded":"2024-07-24T16:37:03.997382+0000","last_fullsized":"2024-07-24T16:37:03.997382+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:09:05.945632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.004003+0000","last_change":"2024-07-24T16:37:03.004109+0000","last_active":"2024-07-24T16:37:05.004003+0000","last_peered":"2024-07-24T16:37:05.004003+0000","last_clean":"2024-07-24T16:37:05.004003+0000","last_became_active":"2024-07-24T16:37:03.003813+0000","last_became_peered":"2024-07-24T16:37:03.003813+0000","last_unstale":"2024-07-24T16:37:05.004003+0000","last_undegraded":"2024-07-24T16:37:05.004003+0000","last_fullsized":"2024-07-24T16:37:05.004003+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:44.069876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.023137+0000","last_change":"2024-07-24T16:37:04.015827+0000","last_active":"2024-07-24T16:37:04.023137+0000","last_peered":"2024-07-24T16:37:04.023137+0000","last_clean":"2024-07-24T16:37:04.023137+0000","last_became_active":"2024-07-24T16:37:04.015577+0000","last_became_peered":"2024-07-24T16:37:04.015577+0000","last_unstale":"2024-07-24T16:37:04.023137+0000","last_undegraded":"2024-07-24T16:37:04.023137+0000","last_fullsized":"2024-07-24T16:37:04.023137+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:04:44.330674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"62'3","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.015539+0000","last_change":"2024-07-24T16:37:03.002358+0000","last_active":"2024-07-24T16:37:04.015539+0000","last_peered":"2024-07-24T16:37:04.015539+0000","last_clean":"2024-07-24T16:37:04.015539+0000","last_became_active":"2024-07-24T16:37:03.001970+0000","last_became_peered":"2024-07-24T16:37:03.001970+0000","last_unstale":"2024-07-24T16:37:04.015539+0000","last_undegraded":"2024-07-24T16:37:04.015539+0000","last_fullsized":"2024-07-24T16:37:04.015539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:18:18.548923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003978+0000","last_change":"2024-07-24T16:37:03.996498+0000","last_active":"2024-07-24T16:37:05.003978+0000","last_peered":"2024-07-24T16:37:05.003978+0000","last_clean":"2024-07-24T16:37:05.003978+0000","last_became_active":"2024-07-24T16:37:03.996235+0000","last_became_peered":"2024-07-24T16:37:03.996235+0000","last_unstale":"2024-07-24T16:37:05.003978+0000","last_undegraded":"2024-07-24T16:37:05.003978+0000","last_fullsized":"2024-07-24T16:37:05.003978+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:50:22.080512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"62'6","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.025180+0000","last_change":"2024-07-24T16:37:03.008087+0000","last_active":"2024-07-24T16:37:04.025180+0000","last_peered":"2024-07-24T16:37:04.025180+0000","last_clean":"2024-07-24T16:37:04.025180+0000","last_became_active":"2024-07-24T16:37:03.007813+0000","last_became_peered":"2024-07-24T16:37:03.007813+0000","last_unstale":"2024-07-24T16:37:04.025180+0000","last_undegraded":"2024-07-24T16:37:04.025180+0000","last_fullsized":"2024-07-24T16:37:04.025180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:45:09.480096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.011996+0000","last_change":"2024-07-24T16:37:04.007864+0000","last_active":"2024-07-24T16:37:04.011996+0000","last_peered":"2024-07-24T16:37:04.011996+0000","last_clean":"2024-07-24T16:37:04.011996+0000","last_became_active":"2024-07-24T16:37:04.007559+0000","last_became_peered":"2024-07-24T16:37:04.007559+0000","last_unstale":"2024-07-24T16:37:04.011996+0000","last_undegraded":"2024-07-24T16:37:04.011996+0000","last_fullsized":"2024-07-24T16:37:04.011996+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:36.298799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.021146+0000","last_change":"2024-07-24T16:37:03.003657+0000","last_active":"2024-07-24T16:37:04.021146+0000","last_peered":"2024-07-24T16:37:04.021146+0000","last_clean":"2024-07-24T16:37:04.021146+0000","last_became_active":"2024-07-24T16:37:03.003386+0000","last_became_peered":"2024-07-24T16:37:03.003386+0000","last_unstale":"2024-07-24T16:37:04.021146+0000","last_undegraded":"2024-07-24T16:37:04.021146+0000","last_fullsized":"2024-07-24T16:37:04.021146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:08:09.502445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024361+0000","last_change":"2024-07-24T16:37:04.019133+0000","last_active":"2024-07-24T16:37:04.024361+0000","last_peered":"2024-07-24T16:37:04.024361+0000","last_clean":"2024-07-24T16:37:04.024361+0000","last_became_active":"2024-07-24T16:37:04.018826+0000","last_became_peered":"2024-07-24T16:37:04.018826+0000","last_unstale":"2024-07-24T16:37:04.024361+0000","last_undegraded":"2024-07-24T16:37:04.024361+0000","last_fullsized":"2024-07-24T16:37:04.024361+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:44:26.797367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003159+0000","last_change":"2024-07-24T16:37:03.003836+0000","last_active":"2024-07-24T16:37:05.003159+0000","last_peered":"2024-07-24T16:37:05.003159+0000","last_clean":"2024-07-24T16:37:05.003159+0000","last_became_active":"2024-07-24T16:37:03.003542+0000","last_became_peered":"2024-07-24T16:37:03.003542+0000","last_unstale":"2024-07-24T16:37:05.003159+0000","last_undegraded":"2024-07-24T16:37:05.003159+0000","last_fullsized":"2024-07-24T16:37:05.003159+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:40:08.258903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.017692+0000","last_change":"2024-07-24T16:37:04.011095+0000","last_active":"2024-07-24T16:37:04.017692+0000","last_peered":"2024-07-24T16:37:04.017692+0000","last_clean":"2024-07-24T16:37:04.017692+0000","last_became_active":"2024-07-24T16:37:04.010791+0000","last_became_peered":"2024-07-24T16:37:04.010791+0000","last_unstale":"2024-07-24T16:37:04.017692+0000","last_undegraded":"2024-07-24T16:37:04.017692+0000","last_fullsized":"2024-07-24T16:37:04.017692+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:44:23.934817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.002577+0000","last_change":"2024-07-24T16:37:03.010829+0000","last_active":"2024-07-24T16:37:04.002577+0000","last_peered":"2024-07-24T16:37:04.002577+0000","last_clean":"2024-07-24T16:37:04.002577+0000","last_became_active":"2024-07-24T16:37:03.010566+0000","last_became_peered":"2024-07-24T16:37:03.010566+0000","last_unstale":"2024-07-24T16:37:04.002577+0000","last_undegraded":"2024-07-24T16:37:04.002577+0000","last_fullsized":"2024-07-24T16:37:04.002577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:58:26.392478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024991+0000","last_change":"2024-07-24T16:37:04.023416+0000","last_active":"2024-07-24T16:37:04.024991+0000","last_peered":"2024-07-24T16:37:04.024991+0000","last_clean":"2024-07-24T16:37:04.024991+0000","last_became_active":"2024-07-24T16:37:04.020968+0000","last_became_peered":"2024-07-24T16:37:04.020968+0000","last_unstale":"2024-07-24T16:37:04.024991+0000","last_undegraded":"2024-07-24T16:37:04.024991+0000","last_fullsized":"2024-07-24T16:37:04.024991+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:41:16.939071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"62'8","reported_seq":21,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.018506+0000","last_change":"2024-07-24T16:37:03.006180+0000","last_active":"2024-07-24T16:37:04.018506+0000","last_peered":"2024-07-24T16:37:04.018506+0000","last_clean":"2024-07-24T16:37:04.018506+0000","last_became_active":"2024-07-24T16:37:03.005719+0000","last_became_peered":"2024-07-24T16:37:03.005719+0000","last_unstale":"2024-07-24T16:37:04.018506+0000","last_undegraded":"2024-07-24T16:37:04.018506+0000","last_fullsized":"2024-07-24T16:37:04.018506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:05.170486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.016071+0000","last_change":"2024-07-24T16:37:04.005089+0000","last_active":"2024-07-24T16:37:04.016071+0000","last_peered":"2024-07-24T16:37:04.016071+0000","last_clean":"2024-07-24T16:37:04.016071+0000","last_became_active":"2024-07-24T16:37:04.004750+0000","last_became_peered":"2024-07-24T16:37:04.004750+0000","last_unstale":"2024-07-24T16:37:04.016071+0000","last_undegraded":"2024-07-24T16:37:04.016071+0000","last_fullsized":"2024-07-24T16:37:04.016071+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:23:03.806832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.021653+0000","last_change":"2024-07-24T16:37:03.013805+0000","last_active":"2024-07-24T16:37:04.021653+0000","last_peered":"2024-07-24T16:37:04.021653+0000","last_clean":"2024-07-24T16:37:04.021653+0000","last_became_active":"2024-07-24T16:37:03.013485+0000","last_became_peered":"2024-07-24T16:37:03.013485+0000","last_unstale":"2024-07-24T16:37:04.021653+0000","last_undegraded":"2024-07-24T16:37:04.021653+0000","last_fullsized":"2024-07-24T16:37:04.021653+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:45:47.297991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.022251+0000","last_change":"2024-07-24T16:37:04.019820+0000","last_active":"2024-07-24T16:37:04.022251+0000","last_peered":"2024-07-24T16:37:04.022251+0000","last_clean":"2024-07-24T16:37:04.022251+0000","last_became_active":"2024-07-24T16:37:04.019539+0000","last_became_peered":"2024-07-24T16:37:04.019539+0000","last_unstale":"2024-07-24T16:37:04.022251+0000","last_undegraded":"2024-07-24T16:37:04.022251+0000","last_fullsized":"2024-07-24T16:37:04.022251+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:43:11.475416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.004608+0000","last_change":"2024-07-24T16:37:02.998295+0000","last_active":"2024-07-24T16:37:05.004608+0000","last_peered":"2024-07-24T16:37:05.004608+0000","last_clean":"2024-07-24T16:37:05.004608+0000","last_became_active":"2024-07-24T16:37:02.998007+0000","last_became_peered":"2024-07-24T16:37:02.998007+0000","last_unstale":"2024-07-24T16:37:05.004608+0000","last_undegraded":"2024-07-24T16:37:05.004608+0000","last_fullsized":"2024-07-24T16:37:05.004608+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:32:49.184726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.002854+0000","last_change":"2024-07-24T16:37:04.022338+0000","last_active":"2024-07-24T16:37:05.002854+0000","last_peered":"2024-07-24T16:37:05.002854+0000","last_clean":"2024-07-24T16:37:05.002854+0000","last_became_active":"2024-07-24T16:37:04.022113+0000","last_became_peered":"2024-07-24T16:37:04.022113+0000","last_unstale":"2024-07-24T16:37:05.002854+0000","last_undegraded":"2024-07-24T16:37:05.002854+0000","last_fullsized":"2024-07-24T16:37:05.002854+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:26:46.966508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003399+0000","last_change":"2024-07-24T16:37:03.001292+0000","last_active":"2024-07-24T16:37:05.003399+0000","last_peered":"2024-07-24T16:37:05.003399+0000","last_clean":"2024-07-24T16:37:05.003399+0000","last_became_active":"2024-07-24T16:37:03.001003+0000","last_became_peered":"2024-07-24T16:37:03.001003+0000","last_unstale":"2024-07-24T16:37:05.003399+0000","last_undegraded":"2024-07-24T16:37:05.003399+0000","last_fullsized":"2024-07-24T16:37:05.003399+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:51:36.249129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.004226+0000","last_change":"2024-07-24T16:37:03.999104+0000","last_active":"2024-07-24T16:37:04.004226+0000","last_peered":"2024-07-24T16:37:04.004226+0000","last_clean":"2024-07-24T16:37:04.004226+0000","last_became_active":"2024-07-24T16:37:03.998825+0000","last_became_peered":"2024-07-24T16:37:03.998825+0000","last_unstale":"2024-07-24T16:37:04.004226+0000","last_undegraded":"2024-07-24T16:37:04.004226+0000","last_fullsized":"2024-07-24T16:37:04.004226+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:28:19.279886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003438+0000","last_change":"2024-07-24T16:37:03.013889+0000","last_active":"2024-07-24T16:37:05.003438+0000","last_peered":"2024-07-24T16:37:05.003438+0000","last_clean":"2024-07-24T16:37:05.003438+0000","last_became_active":"2024-07-24T16:37:03.013550+0000","last_became_peered":"2024-07-24T16:37:03.013550+0000","last_unstale":"2024-07-24T16:37:05.003438+0000","last_undegraded":"2024-07-24T16:37:05.003438+0000","last_fullsized":"2024-07-24T16:37:05.003438+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:32.419679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.003348+0000","last_change":"2024-07-24T16:37:04.000366+0000","last_active":"2024-07-24T16:37:04.003348+0000","last_peered":"2024-07-24T16:37:04.003348+0000","last_clean":"2024-07-24T16:37:04.003348+0000","last_became_active":"2024-07-24T16:37:04.000074+0000","last_became_peered":"2024-07-24T16:37:04.000074+0000","last_unstale":"2024-07-24T16:37:04.003348+0000","last_undegraded":"2024-07-24T16:37:04.003348+0000","last_fullsized":"2024-07-24T16:37:04.003348+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:31:41.870538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.013197+0000","last_change":"2024-07-24T16:37:02.995822+0000","last_active":"2024-07-24T16:37:04.013197+0000","last_peered":"2024-07-24T16:37:04.013197+0000","last_clean":"2024-07-24T16:37:04.013197+0000","last_became_active":"2024-07-24T16:37:02.995536+0000","last_became_peered":"2024-07-24T16:37:02.995536+0000","last_unstale":"2024-07-24T16:37:04.013197+0000","last_undegraded":"2024-07-24T16:37:04.013197+0000","last_fullsized":"2024-07-24T16:37:04.013197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:00:55.075881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003014+0000","last_change":"2024-07-24T16:37:04.004492+0000","last_active":"2024-07-24T16:37:05.003014+0000","last_peered":"2024-07-24T16:37:05.003014+0000","last_clean":"2024-07-24T16:37:05.003014+0000","last_became_active":"2024-07-24T16:37:04.004210+0000","last_became_peered":"2024-07-24T16:37:04.004210+0000","last_unstale":"2024-07-24T16:37:05.003014+0000","last_undegraded":"2024-07-24T16:37:05.003014+0000","last_fullsized":"2024-07-24T16:37:05.003014+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:28:19.279886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:03.994349+0000","last_change":"2024-07-24T16:37:03.007200+0000","last_active":"2024-07-24T16:37:03.994349+0000","last_peered":"2024-07-24T16:37:03.994349+0000","last_clean":"2024-07-24T16:37:03.994349+0000","last_became_active":"2024-07-24T16:37:03.006461+0000","last_became_peered":"2024-07-24T16:37:03.006461+0000","last_unstale":"2024-07-24T16:37:03.994349+0000","last_undegraded":"2024-07-24T16:37:03.994349+0000","last_fullsized":"2024-07-24T16:37:03.994349+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:58:10.465983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.020954+0000","last_change":"2024-07-24T16:37:04.011548+0000","last_active":"2024-07-24T16:37:04.020954+0000","last_peered":"2024-07-24T16:37:04.020954+0000","last_clean":"2024-07-24T16:37:04.020954+0000","last_became_active":"2024-07-24T16:37:04.011301+0000","last_became_peered":"2024-07-24T16:37:04.011301+0000","last_unstale":"2024-07-24T16:37:04.020954+0000","last_undegraded":"2024-07-24T16:37:04.020954+0000","last_fullsized":"2024-07-24T16:37:04.020954+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:58:27.147847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.007168+0000","last_change":"2024-07-24T16:37:03.000155+0000","last_active":"2024-07-24T16:37:04.007168+0000","last_peered":"2024-07-24T16:37:04.007168+0000","last_clean":"2024-07-24T16:37:04.007168+0000","last_became_active":"2024-07-24T16:37:02.999863+0000","last_became_peered":"2024-07-24T16:37:02.999863+0000","last_unstale":"2024-07-24T16:37:04.007168+0000","last_undegraded":"2024-07-24T16:37:04.007168+0000","last_fullsized":"2024-07-24T16:37:04.007168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:03.005579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.012901+0000","last_change":"2024-07-24T16:37:04.009717+0000","last_active":"2024-07-24T16:37:04.012901+0000","last_peered":"2024-07-24T16:37:04.012901+0000","last_clean":"2024-07-24T16:37:04.012901+0000","last_became_active":"2024-07-24T16:37:04.009453+0000","last_became_peered":"2024-07-24T16:37:04.009453+0000","last_unstale":"2024-07-24T16:37:04.012901+0000","last_undegraded":"2024-07-24T16:37:04.012901+0000","last_fullsized":"2024-07-24T16:37:04.012901+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:16:16.326020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.004394+0000","last_change":"2024-07-24T16:37:03.000905+0000","last_active":"2024-07-24T16:37:05.004394+0000","last_peered":"2024-07-24T16:37:05.004394+0000","last_clean":"2024-07-24T16:37:05.004394+0000","last_became_active":"2024-07-24T16:37:03.000630+0000","last_became_peered":"2024-07-24T16:37:03.000630+0000","last_unstale":"2024-07-24T16:37:05.004394+0000","last_undegraded":"2024-07-24T16:37:05.004394+0000","last_fullsized":"2024-07-24T16:37:05.004394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:26:24.140079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.003372+0000","last_change":"2024-07-24T16:37:04.001385+0000","last_active":"2024-07-24T16:37:04.003372+0000","last_peered":"2024-07-24T16:37:04.003372+0000","last_clean":"2024-07-24T16:37:04.003372+0000","last_became_active":"2024-07-24T16:37:04.001124+0000","last_became_peered":"2024-07-24T16:37:04.001124+0000","last_unstale":"2024-07-24T16:37:04.003372+0000","last_undegraded":"2024-07-24T16:37:04.003372+0000","last_fullsized":"2024-07-24T16:37:04.003372+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:51:38.899349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003525+0000","last_change":"2024-07-24T16:37:03.003668+0000","last_active":"2024-07-24T16:37:05.003525+0000","last_peered":"2024-07-24T16:37:05.003525+0000","last_clean":"2024-07-24T16:37:05.003525+0000","last_became_active":"2024-07-24T16:37:03.003387+0000","last_became_peered":"2024-07-24T16:37:03.003387+0000","last_unstale":"2024-07-24T16:37:05.003525+0000","last_undegraded":"2024-07-24T16:37:05.003525+0000","last_fullsized":"2024-07-24T16:37:05.003525+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:50:35.318606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.004747+0000","last_change":"2024-07-24T16:37:04.000123+0000","last_active":"2024-07-24T16:37:04.004747+0000","last_peered":"2024-07-24T16:37:04.004747+0000","last_clean":"2024-07-24T16:37:04.004747+0000","last_became_active":"2024-07-24T16:37:03.999841+0000","last_became_peered":"2024-07-24T16:37:03.999841+0000","last_unstale":"2024-07-24T16:37:04.004747+0000","last_undegraded":"2024-07-24T16:37:04.004747+0000","last_fullsized":"2024-07-24T16:37:04.004747+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:40.906131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.004127+0000","last_change":"2024-07-24T16:37:03.003110+0000","last_active":"2024-07-24T16:37:04.004127+0000","last_peered":"2024-07-24T16:37:04.004127+0000","last_clean":"2024-07-24T16:37:04.004127+0000","last_became_active":"2024-07-24T16:37:03.002819+0000","last_became_peered":"2024-07-24T16:37:03.002819+0000","last_unstale":"2024-07-24T16:37:04.004127+0000","last_undegraded":"2024-07-24T16:37:04.004127+0000","last_fullsized":"2024-07-24T16:37:04.004127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:32:42.309475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.017836+0000","last_change":"2024-07-24T16:37:04.007895+0000","last_active":"2024-07-24T16:37:04.017836+0000","last_peered":"2024-07-24T16:37:04.017836+0000","last_clean":"2024-07-24T16:37:04.017836+0000","last_became_active":"2024-07-24T16:37:04.007614+0000","last_became_peered":"2024-07-24T16:37:04.007614+0000","last_unstale":"2024-07-24T16:37:04.017836+0000","last_undegraded":"2024-07-24T16:37:04.017836+0000","last_fullsized":"2024-07-24T16:37:04.017836+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:42:56.839993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.000875+0000","last_change":"2024-07-24T16:37:03.002515+0000","last_active":"2024-07-24T16:37:04.000875+0000","last_peered":"2024-07-24T16:37:04.000875+0000","last_clean":"2024-07-24T16:37:04.000875+0000","last_became_active":"2024-07-24T16:37:03.002219+0000","last_became_peered":"2024-07-24T16:37:03.002219+0000","last_unstale":"2024-07-24T16:37:04.000875+0000","last_undegraded":"2024-07-24T16:37:04.000875+0000","last_fullsized":"2024-07-24T16:37:04.000875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:29:44.553198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024464+0000","last_change":"2024-07-24T16:37:04.021367+0000","last_active":"2024-07-24T16:37:04.024464+0000","last_peered":"2024-07-24T16:37:04.024464+0000","last_clean":"2024-07-24T16:37:04.024464+0000","last_became_active":"2024-07-24T16:37:04.021059+0000","last_became_peered":"2024-07-24T16:37:04.021059+0000","last_unstale":"2024-07-24T16:37:04.024464+0000","last_undegraded":"2024-07-24T16:37:04.024464+0000","last_fullsized":"2024-07-24T16:37:04.024464+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:49:30.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:03.996813+0000","last_change":"2024-07-24T16:37:03.009702+0000","last_active":"2024-07-24T16:37:03.996813+0000","last_peered":"2024-07-24T16:37:03.996813+0000","last_clean":"2024-07-24T16:37:03.996813+0000","last_became_active":"2024-07-24T16:37:03.009216+0000","last_became_peered":"2024-07-24T16:37:03.009216+0000","last_unstale":"2024-07-24T16:37:03.996813+0000","last_undegraded":"2024-07-24T16:37:03.996813+0000","last_fullsized":"2024-07-24T16:37:03.996813+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:33.301368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.011259+0000","last_change":"2024-07-24T16:37:04.007332+0000","last_active":"2024-07-24T16:37:04.011259+0000","last_peered":"2024-07-24T16:37:04.011259+0000","last_clean":"2024-07-24T16:37:04.011259+0000","last_became_active":"2024-07-24T16:37:04.007096+0000","last_became_peered":"2024-07-24T16:37:04.007096+0000","last_unstale":"2024-07-24T16:37:04.011259+0000","last_undegraded":"2024-07-24T16:37:04.011259+0000","last_fullsized":"2024-07-24T16:37:04.011259+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:05:05.128427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:03.995741+0000","last_change":"2024-07-24T16:37:03.008273+0000","last_active":"2024-07-24T16:37:03.995741+0000","last_peered":"2024-07-24T16:37:03.995741+0000","last_clean":"2024-07-24T16:37:03.995741+0000","last_became_active":"2024-07-24T16:37:03.008025+0000","last_became_peered":"2024-07-24T16:37:03.008025+0000","last_unstale":"2024-07-24T16:37:03.995741+0000","last_undegraded":"2024-07-24T16:37:03.995741+0000","last_fullsized":"2024-07-24T16:37:03.995741+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:54.564511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.022955+0000","last_change":"2024-07-24T16:37:04.018001+0000","last_active":"2024-07-24T16:37:04.022955+0000","last_peered":"2024-07-24T16:37:04.022955+0000","last_clean":"2024-07-24T16:37:04.022955+0000","last_became_active":"2024-07-24T16:37:04.017748+0000","last_became_peered":"2024-07-24T16:37:04.017748+0000","last_unstale":"2024-07-24T16:37:04.022955+0000","last_undegraded":"2024-07-24T16:37:04.022955+0000","last_fullsized":"2024-07-24T16:37:04.022955+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:22.247786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003639+0000","last_change":"2024-07-24T16:37:03.008246+0000","last_active":"2024-07-24T16:37:05.003639+0000","last_peered":"2024-07-24T16:37:05.003639+0000","last_clean":"2024-07-24T16:37:05.003639+0000","last_became_active":"2024-07-24T16:37:03.008010+0000","last_became_peered":"2024-07-24T16:37:03.008010+0000","last_unstale":"2024-07-24T16:37:05.003639+0000","last_undegraded":"2024-07-24T16:37:05.003639+0000","last_fullsized":"2024-07-24T16:37:05.003639+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:23.842357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.014508+0000","last_change":"2024-07-24T16:37:04.004696+0000","last_active":"2024-07-24T16:37:04.014508+0000","last_peered":"2024-07-24T16:37:04.014508+0000","last_clean":"2024-07-24T16:37:04.014508+0000","last_became_active":"2024-07-24T16:37:04.004446+0000","last_became_peered":"2024-07-24T16:37:04.004446+0000","last_unstale":"2024-07-24T16:37:04.014508+0000","last_undegraded":"2024-07-24T16:37:04.014508+0000","last_fullsized":"2024-07-24T16:37:04.014508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:05:50.615617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:03.990932+0000","last_change":"2024-07-24T16:37:02.997130+0000","last_active":"2024-07-24T16:37:03.990932+0000","last_peered":"2024-07-24T16:37:03.990932+0000","last_clean":"2024-07-24T16:37:03.990932+0000","last_became_active":"2024-07-24T16:37:02.996841+0000","last_became_peered":"2024-07-24T16:37:02.996841+0000","last_unstale":"2024-07-24T16:37:03.990932+0000","last_undegraded":"2024-07-24T16:37:03.990932+0000","last_fullsized":"2024-07-24T16:37:03.990932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:27:02.167426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003201+0000","last_change":"2024-07-24T16:37:04.005886+0000","last_active":"2024-07-24T16:37:05.003201+0000","last_peered":"2024-07-24T16:37:05.003201+0000","last_clean":"2024-07-24T16:37:05.003201+0000","last_became_active":"2024-07-24T16:37:04.005578+0000","last_became_peered":"2024-07-24T16:37:04.005578+0000","last_unstale":"2024-07-24T16:37:05.003201+0000","last_undegraded":"2024-07-24T16:37:05.003201+0000","last_fullsized":"2024-07-24T16:37:05.003201+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:32:24.649601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:03.999551+0000","last_change":"2024-07-24T16:37:03.002115+0000","last_active":"2024-07-24T16:37:03.999551+0000","last_peered":"2024-07-24T16:37:03.999551+0000","last_clean":"2024-07-24T16:37:03.999551+0000","last_became_active":"2024-07-24T16:37:03.001758+0000","last_became_peered":"2024-07-24T16:37:03.001758+0000","last_unstale":"2024-07-24T16:37:03.999551+0000","last_undegraded":"2024-07-24T16:37:03.999551+0000","last_fullsized":"2024-07-24T16:37:03.999551+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:10:49.225665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'86","reported_seq":242,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.002695+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:37:04.002695+0000","last_peered":"2024-07-24T16:37:04.002695+0000","last_clean":"2024-07-24T16:37:04.002695+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:37:04.002695+0000","last_undegraded":"2024-07-24T16:37:04.002695+0000","last_fullsized":"2024-07-24T16:37:04.002695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575007,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54700,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317140,"statfs":{"total":96636764160,"available":96580751360,"internally_reserved":0,"allocated":1343488,"data_stored":957315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575007,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":761856,"data_stored":374467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575007,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49952,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321888,"statfs":{"total":96636764160,"available":96585613312,"internally_reserved":0,"allocated":741376,"data_stored":366823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575008,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":757760,"data_stored":374397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575008,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":757760,"data_stored":368457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575008,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54140,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317700,"statfs":{"total":96636764160,"available":96581324800,"internally_reserved":0,"allocated":765952,"data_stored":375427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":749568,"data_stored":366983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575008,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1343488,"data_stored":957247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:37:07.002 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:37:07.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.138+0000 7f19768e8640 1 -- 172.21.15.159:0/3961458543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f197015d950 msgr2=0x7f1970161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:07.141 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.138+0000 7f19768e8640 1 --2- 172.21.15.159:0/3961458543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f197015d950 0x7f1970161f20 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f1970161470 tx=0x7f196002a5f0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.138+0000 7f19768e8640 1 -- 172.21.15.159:0/3961458543 shutdown_connections 2024-07-24T16:37:07.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.138+0000 7f19768e8640 1 --2- 172.21.15.159:0/3961458543 >> v2:172.21.15.193:3300/0 conn(0x7f19700b2ae0 0x7f19700b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.138+0000 7f19768e8640 1 --2- 172.21.15.159:0/3961458543 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f197015d950 0x7f1970161f20 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.138+0000 7f19768e8640 1 -- 172.21.15.159:0/3961458543 >> 172.21.15.159:0/3961458543 conn(0x7f197009cd30 msgr2=0x7f19700d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:07.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.138+0000 7f19768e8640 1 -- 172.21.15.159:0/3961458543 shutdown_connections 2024-07-24T16:37:07.142 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.138+0000 7f19768e8640 1 -- 172.21.15.159:0/3961458543 wait complete. 2024-07-24T16:37:07.144 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.140+0000 7f19768e8640 1 Processor -- start 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.140+0000 7f19768e8640 1 -- start start 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.140+0000 7f19768e8640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19700b0b60 0x7f19701526f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.140+0000 7f19768e8640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19700b2ae0 0x7f19700b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.140+0000 7f19768e8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f197015d950 0x7f19700b4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.140+0000 7f19768e8640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f19700d02e0 con 0x7f197015d950 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f19768e8640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f19700d0090 con 0x7f19700b0b60 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f19768e8640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f19700d0460 con 0x7f19700b2ae0 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f1974e85640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f197015d950 0x7f19700b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f1974e85640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f197015d950 0x7f19700b4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47304/0 (socket says 172.21.15.159:47304) 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f1974e85640 1 -- 172.21.15.159:0/3079756443 learned_addr learned my addr 172.21.15.159:0/3079756443 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f196ffff640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19700b0b60 0x7f19701526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f196f7fe640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19700b2ae0 0x7f19700b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f1974e85640 1 -- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19700b2ae0 msgr2=0x7f19700b4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:07.145 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f1974e85640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19700b2ae0 0x7f19700b4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f1974e85640 1 -- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19700b0b60 msgr2=0x7f19701526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:07.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f1974e85640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19700b0b60 0x7f19701526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f1974e85640 1 -- 172.21.15.159:0/3079756443 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19700c8360 con 0x7f197015d950 2024-07-24T16:37:07.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f1974e85640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f197015d950 0x7f19700b4890 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f196800c780 tx=0x7f196800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:07.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f196cff9640 1 -- 172.21.15.159:0/3079756443 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1968017070 con 0x7f197015d950 2024-07-24T16:37:07.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f196cff9640 1 -- 172.21.15.159:0/3079756443 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1968003c80 con 0x7f197015d950 2024-07-24T16:37:07.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f19768e8640 1 -- 172.21.15.159:0/3079756443 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19700c8640 con 0x7f197015d950 2024-07-24T16:37:07.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f196cff9640 1 -- 172.21.15.159:0/3079756443 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19680052d0 con 0x7f197015d950 2024-07-24T16:37:07.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.141+0000 7f19768e8640 1 -- 172.21.15.159:0/3079756443 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19700c8c00 con 0x7f197015d950 2024-07-24T16:37:07.146 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.142+0000 7f19768e8640 1 -- 172.21.15.159:0/3079756443 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19700d2d20 con 0x7f197015d950 2024-07-24T16:37:07.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.143+0000 7f196cff9640 1 -- 172.21.15.159:0/3079756443 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f196801a070 con 0x7f197015d950 2024-07-24T16:37:07.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.144+0000 7f196cff9640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1950077010 0x7f19500794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:07.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.144+0000 7f196cff9640 1 -- 172.21.15.159:0/3079756443 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6401+0+0 (secure 0 0 0) 0x7f19680981b0 con 0x7f197015d950 2024-07-24T16:37:07.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.144+0000 7f196ffff640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1950077010 0x7f19500794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:07.147 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.144+0000 7f196ffff640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1950077010 0x7f19500794d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1960033000 tx=0x7f1960004730 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:07.150 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.148+0000 7f196cff9640 1 -- 172.21.15.159:0/3079756443 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f19700d2d20 con 0x7f197015d950 2024-07-24T16:37:07.331 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.329+0000 7f19768e8640 1 -- 172.21.15.159:0/3079756443 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f19700d0a00 con 0x7f1950077010 2024-07-24T16:37:07.336 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.333+0000 7f196cff9640 1 -- 172.21.15.159:0/3079756443 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251947 (secure 0 0 0) 0x7f19700d0a00 con 0x7f1950077010 2024-07-24T16:37:07.339 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:37:07.340 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:37:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.336+0000 7f19768e8640 1 -- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1950077010 msgr2=0x7f19500794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.336+0000 7f19768e8640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1950077010 0x7f19500794d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1960033000 tx=0x7f1960004730 comp rx=0 tx=0).stop 2024-07-24T16:37:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.336+0000 7f19768e8640 1 -- 172.21.15.159:0/3079756443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f197015d950 msgr2=0x7f19700b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.336+0000 7f19768e8640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f197015d950 0x7f19700b4890 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f196800c780 tx=0x7f196800cb80 comp rx=0 tx=0).stop 2024-07-24T16:37:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.336+0000 7f19768e8640 1 -- 172.21.15.159:0/3079756443 shutdown_connections 2024-07-24T16:37:07.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.336+0000 7f19768e8640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f1950077010 0x7f19500794d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.336+0000 7f19768e8640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f197015d950 0x7f19700b4890 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.336+0000 7f19768e8640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f19700b2ae0 0x7f19700b4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.336+0000 7f19768e8640 1 --2- 172.21.15.159:0/3079756443 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f19700b0b60 0x7f19701526f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.336+0000 7f19768e8640 1 -- 172.21.15.159:0/3079756443 >> 172.21.15.159:0/3079756443 conn(0x7f197009cd30 msgr2=0x7f19700cf770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.336+0000 7f19768e8640 1 -- 172.21.15.159:0/3079756443 shutdown_connections 2024-07-24T16:37:07.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.337+0000 7f19768e8640 1 -- 172.21.15.159:0/3079756443 wait complete. 2024-07-24T16:37:07.350 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-07-24T16:37:06.546900+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":169,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":124,"ondisk_log_size":124,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":99,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":318992,"kb_used_data":7052,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754655728,"statfs":{"total":773094113280,"available":772767465472,"internally_reserved":0,"allocated":7221248,"data_stored":4141116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.570476"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.004267+0000","last_change":"2024-07-24T16:37:04.000283+0000","last_active":"2024-07-24T16:37:04.004267+0000","last_peered":"2024-07-24T16:37:04.004267+0000","last_clean":"2024-07-24T16:37:04.004267+0000","last_became_active":"2024-07-24T16:37:04.000007+0000","last_became_peered":"2024-07-24T16:37:04.000007+0000","last_unstale":"2024-07-24T16:37:04.004267+0000","last_undegraded":"2024-07-24T16:37:04.004267+0000","last_fullsized":"2024-07-24T16:37:04.004267+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:32:24.649601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.015451+0000","last_change":"2024-07-24T16:37:04.011891+0000","last_active":"2024-07-24T16:37:04.015451+0000","last_peered":"2024-07-24T16:37:04.015451+0000","last_clean":"2024-07-24T16:37:04.015451+0000","last_became_active":"2024-07-24T16:37:04.011627+0000","last_became_peered":"2024-07-24T16:37:04.011627+0000","last_unstale":"2024-07-24T16:37:04.015451+0000","last_undegraded":"2024-07-24T16:37:04.015451+0000","last_fullsized":"2024-07-24T16:37:04.015451+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:09:05.945632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.022969+0000","last_change":"2024-07-24T16:37:04.014901+0000","last_active":"2024-07-24T16:37:04.022969+0000","last_peered":"2024-07-24T16:37:04.022969+0000","last_clean":"2024-07-24T16:37:04.022969+0000","last_became_active":"2024-07-24T16:37:04.014649+0000","last_became_peered":"2024-07-24T16:37:04.014649+0000","last_unstale":"2024-07-24T16:37:04.022969+0000","last_undegraded":"2024-07-24T16:37:04.022969+0000","last_fullsized":"2024-07-24T16:37:04.022969+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:57:00.375546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.015438+0000","last_change":"2024-07-24T16:37:04.011677+0000","last_active":"2024-07-24T16:37:04.015438+0000","last_peered":"2024-07-24T16:37:04.015438+0000","last_clean":"2024-07-24T16:37:04.015438+0000","last_became_active":"2024-07-24T16:37:04.011002+0000","last_became_peered":"2024-07-24T16:37:04.011002+0000","last_unstale":"2024-07-24T16:37:04.015438+0000","last_undegraded":"2024-07-24T16:37:04.015438+0000","last_fullsized":"2024-07-24T16:37:04.015438+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:27:03.173404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003931+0000","last_change":"2024-07-24T16:37:04.005188+0000","last_active":"2024-07-24T16:37:05.003931+0000","last_peered":"2024-07-24T16:37:05.003931+0000","last_clean":"2024-07-24T16:37:05.003931+0000","last_became_active":"2024-07-24T16:37:04.004895+0000","last_became_peered":"2024-07-24T16:37:04.004895+0000","last_unstale":"2024-07-24T16:37:05.003931+0000","last_undegraded":"2024-07-24T16:37:05.003931+0000","last_fullsized":"2024-07-24T16:37:05.003931+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:22:29.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.012918+0000","last_change":"2024-07-24T16:37:04.009148+0000","last_active":"2024-07-24T16:37:04.012918+0000","last_peered":"2024-07-24T16:37:04.012918+0000","last_clean":"2024-07-24T16:37:04.012918+0000","last_became_active":"2024-07-24T16:37:04.008866+0000","last_became_peered":"2024-07-24T16:37:04.008866+0000","last_unstale":"2024-07-24T16:37:04.012918+0000","last_undegraded":"2024-07-24T16:37:04.012918+0000","last_fullsized":"2024-07-24T16:37:04.012918+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:24.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024536+0000","last_change":"2024-07-24T16:37:04.020944+0000","last_active":"2024-07-24T16:37:04.024536+0000","last_peered":"2024-07-24T16:37:04.024536+0000","last_clean":"2024-07-24T16:37:04.024536+0000","last_became_active":"2024-07-24T16:37:04.019103+0000","last_became_peered":"2024-07-24T16:37:04.019103+0000","last_unstale":"2024-07-24T16:37:04.024536+0000","last_undegraded":"2024-07-24T16:37:04.024536+0000","last_fullsized":"2024-07-24T16:37:04.024536+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:07:32.475581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024933+0000","last_change":"2024-07-24T16:37:04.022838+0000","last_active":"2024-07-24T16:37:04.024933+0000","last_peered":"2024-07-24T16:37:04.024933+0000","last_clean":"2024-07-24T16:37:04.024933+0000","last_became_active":"2024-07-24T16:37:04.022559+0000","last_became_peered":"2024-07-24T16:37:04.022559+0000","last_unstale":"2024-07-24T16:37:04.024933+0000","last_undegraded":"2024-07-24T16:37:04.024933+0000","last_fullsized":"2024-07-24T16:37:04.024933+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:57:38.812681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.025102+0000","last_change":"2024-07-24T16:37:04.024211+0000","last_active":"2024-07-24T16:37:04.025102+0000","last_peered":"2024-07-24T16:37:04.025102+0000","last_clean":"2024-07-24T16:37:04.025102+0000","last_became_active":"2024-07-24T16:37:04.023933+0000","last_became_peered":"2024-07-24T16:37:04.023933+0000","last_unstale":"2024-07-24T16:37:04.025102+0000","last_undegraded":"2024-07-24T16:37:04.025102+0000","last_fullsized":"2024-07-24T16:37:04.025102+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:47:32.209575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.001058+0000","last_change":"2024-07-24T16:37:03.998622+0000","last_active":"2024-07-24T16:37:04.001058+0000","last_peered":"2024-07-24T16:37:04.001058+0000","last_clean":"2024-07-24T16:37:04.001058+0000","last_became_active":"2024-07-24T16:37:03.997985+0000","last_became_peered":"2024-07-24T16:37:03.997985+0000","last_unstale":"2024-07-24T16:37:04.001058+0000","last_undegraded":"2024-07-24T16:37:04.001058+0000","last_fullsized":"2024-07-24T16:37:04.001058+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:45:37.666598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.004765+0000","last_change":"2024-07-24T16:37:04.008205+0000","last_active":"2024-07-24T16:37:05.004765+0000","last_peered":"2024-07-24T16:37:05.004765+0000","last_clean":"2024-07-24T16:37:05.004765+0000","last_became_active":"2024-07-24T16:37:04.006298+0000","last_became_peered":"2024-07-24T16:37:04.006298+0000","last_unstale":"2024-07-24T16:37:05.004765+0000","last_undegraded":"2024-07-24T16:37:05.004765+0000","last_fullsized":"2024-07-24T16:37:05.004765+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:51:24.513752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.014418+0000","last_change":"2024-07-24T16:37:04.006667+0000","last_active":"2024-07-24T16:37:04.014418+0000","last_peered":"2024-07-24T16:37:04.014418+0000","last_clean":"2024-07-24T16:37:04.014418+0000","last_became_active":"2024-07-24T16:37:04.005908+0000","last_became_peered":"2024-07-24T16:37:04.005908+0000","last_unstale":"2024-07-24T16:37:04.014418+0000","last_undegraded":"2024-07-24T16:37:04.014418+0000","last_fullsized":"2024-07-24T16:37:04.014418+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:27:17.769808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.009319+0000","last_change":"2024-07-24T16:37:04.002494+0000","last_active":"2024-07-24T16:37:04.009319+0000","last_peered":"2024-07-24T16:37:04.009319+0000","last_clean":"2024-07-24T16:37:04.009319+0000","last_became_active":"2024-07-24T16:37:04.001872+0000","last_became_peered":"2024-07-24T16:37:04.001872+0000","last_unstale":"2024-07-24T16:37:04.009319+0000","last_undegraded":"2024-07-24T16:37:04.009319+0000","last_fullsized":"2024-07-24T16:37:04.009319+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:45.075854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024415+0000","last_change":"2024-07-24T16:37:04.018574+0000","last_active":"2024-07-24T16:37:04.024415+0000","last_peered":"2024-07-24T16:37:04.024415+0000","last_clean":"2024-07-24T16:37:04.024415+0000","last_became_active":"2024-07-24T16:37:04.018314+0000","last_became_peered":"2024-07-24T16:37:04.018314+0000","last_unstale":"2024-07-24T16:37:04.024415+0000","last_undegraded":"2024-07-24T16:37:04.024415+0000","last_fullsized":"2024-07-24T16:37:04.024415+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:57.680599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.015073+0000","last_change":"2024-07-24T16:37:04.009736+0000","last_active":"2024-07-24T16:37:04.015073+0000","last_peered":"2024-07-24T16:37:04.015073+0000","last_clean":"2024-07-24T16:37:04.015073+0000","last_became_active":"2024-07-24T16:37:04.009473+0000","last_became_peered":"2024-07-24T16:37:04.009473+0000","last_unstale":"2024-07-24T16:37:04.015073+0000","last_undegraded":"2024-07-24T16:37:04.015073+0000","last_fullsized":"2024-07-24T16:37:04.015073+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:38:58.077671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.007615+0000","last_change":"2024-07-24T16:37:04.001780+0000","last_active":"2024-07-24T16:37:04.007615+0000","last_peered":"2024-07-24T16:37:04.007615+0000","last_clean":"2024-07-24T16:37:04.007615+0000","last_became_active":"2024-07-24T16:37:04.001535+0000","last_became_peered":"2024-07-24T16:37:04.001535+0000","last_unstale":"2024-07-24T16:37:04.007615+0000","last_undegraded":"2024-07-24T16:37:04.007615+0000","last_fullsized":"2024-07-24T16:37:04.007615+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:20.158902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024469+0000","last_change":"2024-07-24T16:37:04.021471+0000","last_active":"2024-07-24T16:37:04.024469+0000","last_peered":"2024-07-24T16:37:04.024469+0000","last_clean":"2024-07-24T16:37:04.024469+0000","last_became_active":"2024-07-24T16:37:04.019159+0000","last_became_peered":"2024-07-24T16:37:04.019159+0000","last_unstale":"2024-07-24T16:37:04.024469+0000","last_undegraded":"2024-07-24T16:37:04.024469+0000","last_fullsized":"2024-07-24T16:37:04.024469+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:12:33.200486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.015417+0000","last_change":"2024-07-24T16:37:04.011422+0000","last_active":"2024-07-24T16:37:04.015417+0000","last_peered":"2024-07-24T16:37:04.015417+0000","last_clean":"2024-07-24T16:37:04.015417+0000","last_became_active":"2024-07-24T16:37:04.011166+0000","last_became_peered":"2024-07-24T16:37:04.011166+0000","last_unstale":"2024-07-24T16:37:04.015417+0000","last_undegraded":"2024-07-24T16:37:04.015417+0000","last_fullsized":"2024-07-24T16:37:04.015417+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:56.542664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.022945+0000","last_change":"2024-07-24T16:37:04.008292+0000","last_active":"2024-07-24T16:37:04.022945+0000","last_peered":"2024-07-24T16:37:04.022945+0000","last_clean":"2024-07-24T16:37:04.022945+0000","last_became_active":"2024-07-24T16:37:04.008030+0000","last_became_peered":"2024-07-24T16:37:04.008030+0000","last_unstale":"2024-07-24T16:37:04.022945+0000","last_undegraded":"2024-07-24T16:37:04.022945+0000","last_fullsized":"2024-07-24T16:37:04.022945+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:01:38.702060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003311+0000","last_change":"2024-07-24T16:37:04.007961+0000","last_active":"2024-07-24T16:37:05.003311+0000","last_peered":"2024-07-24T16:37:05.003311+0000","last_clean":"2024-07-24T16:37:05.003311+0000","last_became_active":"2024-07-24T16:37:04.007154+0000","last_became_peered":"2024-07-24T16:37:04.007154+0000","last_unstale":"2024-07-24T16:37:05.003311+0000","last_undegraded":"2024-07-24T16:37:05.003311+0000","last_fullsized":"2024-07-24T16:37:05.003311+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:45.075854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003311+0000","last_change":"2024-07-24T16:37:04.007037+0000","last_active":"2024-07-24T16:37:05.003311+0000","last_peered":"2024-07-24T16:37:05.003311+0000","last_clean":"2024-07-24T16:37:05.003311+0000","last_became_active":"2024-07-24T16:37:04.006749+0000","last_became_peered":"2024-07-24T16:37:04.006749+0000","last_unstale":"2024-07-24T16:37:05.003311+0000","last_undegraded":"2024-07-24T16:37:05.003311+0000","last_fullsized":"2024-07-24T16:37:05.003311+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:20.158902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.022115+0000","last_change":"2024-07-24T16:37:04.020205+0000","last_active":"2024-07-24T16:37:04.022115+0000","last_peered":"2024-07-24T16:37:04.022115+0000","last_clean":"2024-07-24T16:37:04.022115+0000","last_became_active":"2024-07-24T16:37:04.019931+0000","last_became_peered":"2024-07-24T16:37:04.019931+0000","last_unstale":"2024-07-24T16:37:04.022115+0000","last_undegraded":"2024-07-24T16:37:04.022115+0000","last_fullsized":"2024-07-24T16:37:04.022115+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:32.563976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.004449+0000","last_change":"2024-07-24T16:37:04.003751+0000","last_active":"2024-07-24T16:37:05.004449+0000","last_peered":"2024-07-24T16:37:05.004449+0000","last_clean":"2024-07-24T16:37:05.004449+0000","last_became_active":"2024-07-24T16:37:04.003501+0000","last_became_peered":"2024-07-24T16:37:04.003501+0000","last_unstale":"2024-07-24T16:37:05.004449+0000","last_undegraded":"2024-07-24T16:37:05.004449+0000","last_fullsized":"2024-07-24T16:37:05.004449+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:47:41.761372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024846+0000","last_change":"2024-07-24T16:37:04.023076+0000","last_active":"2024-07-24T16:37:04.024846+0000","last_peered":"2024-07-24T16:37:04.024846+0000","last_clean":"2024-07-24T16:37:04.024846+0000","last_became_active":"2024-07-24T16:37:04.021397+0000","last_became_peered":"2024-07-24T16:37:04.021397+0000","last_unstale":"2024-07-24T16:37:04.024846+0000","last_undegraded":"2024-07-24T16:37:04.024846+0000","last_fullsized":"2024-07-24T16:37:04.024846+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:02:17.190878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024970+0000","last_change":"2024-07-24T16:37:04.021808+0000","last_active":"2024-07-24T16:37:04.024970+0000","last_peered":"2024-07-24T16:37:04.024970+0000","last_clean":"2024-07-24T16:37:04.024970+0000","last_became_active":"2024-07-24T16:37:04.021195+0000","last_became_peered":"2024-07-24T16:37:04.021195+0000","last_unstale":"2024-07-24T16:37:04.024970+0000","last_undegraded":"2024-07-24T16:37:04.024970+0000","last_fullsized":"2024-07-24T16:37:04.024970+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:20:36.220044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.014439+0000","last_change":"2024-07-24T16:37:04.005510+0000","last_active":"2024-07-24T16:37:04.014439+0000","last_peered":"2024-07-24T16:37:04.014439+0000","last_clean":"2024-07-24T16:37:04.014439+0000","last_became_active":"2024-07-24T16:37:04.004807+0000","last_became_peered":"2024-07-24T16:37:04.004807+0000","last_unstale":"2024-07-24T16:37:04.014439+0000","last_undegraded":"2024-07-24T16:37:04.014439+0000","last_fullsized":"2024-07-24T16:37:04.014439+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:13:56.585430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.017188+0000","last_change":"2024-07-24T16:37:04.016153+0000","last_active":"2024-07-24T16:37:04.017188+0000","last_peered":"2024-07-24T16:37:04.017188+0000","last_clean":"2024-07-24T16:37:04.017188+0000","last_became_active":"2024-07-24T16:37:04.015860+0000","last_became_peered":"2024-07-24T16:37:04.015860+0000","last_unstale":"2024-07-24T16:37:04.017188+0000","last_undegraded":"2024-07-24T16:37:04.017188+0000","last_fullsized":"2024-07-24T16:37:04.017188+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:04:21.439720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003493+0000","last_change":"2024-07-24T16:37:04.006057+0000","last_active":"2024-07-24T16:37:05.003493+0000","last_peered":"2024-07-24T16:37:05.003493+0000","last_clean":"2024-07-24T16:37:05.003493+0000","last_became_active":"2024-07-24T16:37:04.005597+0000","last_became_peered":"2024-07-24T16:37:04.005597+0000","last_unstale":"2024-07-24T16:37:05.003493+0000","last_undegraded":"2024-07-24T16:37:05.003493+0000","last_fullsized":"2024-07-24T16:37:05.003493+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:24.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.023088+0000","last_change":"2024-07-24T16:37:04.015925+0000","last_active":"2024-07-24T16:37:04.023088+0000","last_peered":"2024-07-24T16:37:04.023088+0000","last_clean":"2024-07-24T16:37:04.023088+0000","last_became_active":"2024-07-24T16:37:04.015678+0000","last_became_peered":"2024-07-24T16:37:04.015678+0000","last_unstale":"2024-07-24T16:37:04.023088+0000","last_undegraded":"2024-07-24T16:37:04.023088+0000","last_fullsized":"2024-07-24T16:37:04.023088+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:17:08.333763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.016859+0000","last_change":"2024-07-24T16:37:04.014588+0000","last_active":"2024-07-24T16:37:04.016859+0000","last_peered":"2024-07-24T16:37:04.016859+0000","last_clean":"2024-07-24T16:37:04.016859+0000","last_became_active":"2024-07-24T16:37:04.014310+0000","last_became_peered":"2024-07-24T16:37:04.014310+0000","last_unstale":"2024-07-24T16:37:04.016859+0000","last_undegraded":"2024-07-24T16:37:04.016859+0000","last_fullsized":"2024-07-24T16:37:04.016859+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:31:41.870538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.018879+0000","last_change":"2024-07-24T16:37:04.007655+0000","last_active":"2024-07-24T16:37:04.018879+0000","last_peered":"2024-07-24T16:37:04.018879+0000","last_clean":"2024-07-24T16:37:04.018879+0000","last_became_active":"2024-07-24T16:37:04.007367+0000","last_became_peered":"2024-07-24T16:37:04.007367+0000","last_unstale":"2024-07-24T16:37:04.018879+0000","last_undegraded":"2024-07-24T16:37:04.018879+0000","last_fullsized":"2024-07-24T16:37:04.018879+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:07:10.844077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.012926+0000","last_change":"2024-07-24T16:37:04.011681+0000","last_active":"2024-07-24T16:37:04.012926+0000","last_peered":"2024-07-24T16:37:04.012926+0000","last_clean":"2024-07-24T16:37:04.012926+0000","last_became_active":"2024-07-24T16:37:04.011439+0000","last_became_peered":"2024-07-24T16:37:04.011439+0000","last_unstale":"2024-07-24T16:37:04.012926+0000","last_undegraded":"2024-07-24T16:37:04.012926+0000","last_fullsized":"2024-07-24T16:37:04.012926+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:58:11.471962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.009787+0000","last_change":"2024-07-24T16:37:04.008494+0000","last_active":"2024-07-24T16:37:04.009787+0000","last_peered":"2024-07-24T16:37:04.009787+0000","last_clean":"2024-07-24T16:37:04.009787+0000","last_became_active":"2024-07-24T16:37:04.008128+0000","last_became_peered":"2024-07-24T16:37:04.008128+0000","last_unstale":"2024-07-24T16:37:04.009787+0000","last_undegraded":"2024-07-24T16:37:04.009787+0000","last_fullsized":"2024-07-24T16:37:04.009787+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:51:49.010336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"62'4","reported_seq":19,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003495+0000","last_change":"2024-07-24T16:37:03.003544+0000","last_active":"2024-07-24T16:37:05.003495+0000","last_peered":"2024-07-24T16:37:05.003495+0000","last_clean":"2024-07-24T16:37:05.003495+0000","last_became_active":"2024-07-24T16:37:03.003212+0000","last_became_peered":"2024-07-24T16:37:03.003212+0000","last_unstale":"2024-07-24T16:37:05.003495+0000","last_undegraded":"2024-07-24T16:37:05.003495+0000","last_fullsized":"2024-07-24T16:37:05.003495+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:10.767177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.011282+0000","last_change":"2024-07-24T16:37:04.007097+0000","last_active":"2024-07-24T16:37:04.011282+0000","last_peered":"2024-07-24T16:37:04.011282+0000","last_clean":"2024-07-24T16:37:04.011282+0000","last_became_active":"2024-07-24T16:37:04.006833+0000","last_became_peered":"2024-07-24T16:37:04.006833+0000","last_unstale":"2024-07-24T16:37:04.011282+0000","last_undegraded":"2024-07-24T16:37:04.011282+0000","last_fullsized":"2024-07-24T16:37:04.011282+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:30:30.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.017832+0000","last_change":"2024-07-24T16:37:03.008723+0000","last_active":"2024-07-24T16:37:04.017832+0000","last_peered":"2024-07-24T16:37:04.017832+0000","last_clean":"2024-07-24T16:37:04.017832+0000","last_became_active":"2024-07-24T16:37:03.008450+0000","last_became_peered":"2024-07-24T16:37:03.008450+0000","last_unstale":"2024-07-24T16:37:04.017832+0000","last_undegraded":"2024-07-24T16:37:04.017832+0000","last_fullsized":"2024-07-24T16:37:04.017832+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:00:20.422519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003059+0000","last_change":"2024-07-24T16:37:04.009602+0000","last_active":"2024-07-24T16:37:05.003059+0000","last_peered":"2024-07-24T16:37:05.003059+0000","last_clean":"2024-07-24T16:37:05.003059+0000","last_became_active":"2024-07-24T16:37:04.009341+0000","last_became_peered":"2024-07-24T16:37:04.009341+0000","last_unstale":"2024-07-24T16:37:05.003059+0000","last_undegraded":"2024-07-24T16:37:05.003059+0000","last_fullsized":"2024-07-24T16:37:05.003059+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:40.906131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.016423+0000","last_change":"2024-07-24T16:37:02.999430+0000","last_active":"2024-07-24T16:37:04.016423+0000","last_peered":"2024-07-24T16:37:04.016423+0000","last_clean":"2024-07-24T16:37:04.016423+0000","last_became_active":"2024-07-24T16:37:02.999177+0000","last_became_peered":"2024-07-24T16:37:02.999177+0000","last_unstale":"2024-07-24T16:37:04.016423+0000","last_undegraded":"2024-07-24T16:37:04.016423+0000","last_fullsized":"2024-07-24T16:37:04.016423+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:14:39.765664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.014458+0000","last_change":"2024-07-24T16:37:04.005041+0000","last_active":"2024-07-24T16:37:04.014458+0000","last_peered":"2024-07-24T16:37:04.014458+0000","last_clean":"2024-07-24T16:37:04.014458+0000","last_became_active":"2024-07-24T16:37:04.004752+0000","last_became_peered":"2024-07-24T16:37:04.004752+0000","last_unstale":"2024-07-24T16:37:04.014458+0000","last_undegraded":"2024-07-24T16:37:04.014458+0000","last_fullsized":"2024-07-24T16:37:04.014458+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:40:36.400835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.011940+0000","last_change":"2024-07-24T16:37:03.013833+0000","last_active":"2024-07-24T16:37:04.011940+0000","last_peered":"2024-07-24T16:37:04.011940+0000","last_clean":"2024-07-24T16:37:04.011940+0000","last_became_active":"2024-07-24T16:37:03.013501+0000","last_became_peered":"2024-07-24T16:37:03.013501+0000","last_unstale":"2024-07-24T16:37:04.011940+0000","last_undegraded":"2024-07-24T16:37:04.011940+0000","last_fullsized":"2024-07-24T16:37:04.011940+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:55.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.004042+0000","last_change":"2024-07-24T16:37:04.008541+0000","last_active":"2024-07-24T16:37:05.004042+0000","last_peered":"2024-07-24T16:37:05.004042+0000","last_clean":"2024-07-24T16:37:05.004042+0000","last_became_active":"2024-07-24T16:37:04.008251+0000","last_became_peered":"2024-07-24T16:37:04.008251+0000","last_unstale":"2024-07-24T16:37:05.004042+0000","last_undegraded":"2024-07-24T16:37:05.004042+0000","last_fullsized":"2024-07-24T16:37:05.004042+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:23:03.807268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.021030+0000","last_change":"2024-07-24T16:37:03.000053+0000","last_active":"2024-07-24T16:37:04.021030+0000","last_peered":"2024-07-24T16:37:04.021030+0000","last_clean":"2024-07-24T16:37:04.021030+0000","last_became_active":"2024-07-24T16:37:02.999733+0000","last_became_peered":"2024-07-24T16:37:02.999733+0000","last_unstale":"2024-07-24T16:37:04.021030+0000","last_undegraded":"2024-07-24T16:37:04.021030+0000","last_fullsized":"2024-07-24T16:37:04.021030+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:43:16.732334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.009867+0000","last_change":"2024-07-24T16:37:04.008622+0000","last_active":"2024-07-24T16:37:04.009867+0000","last_peered":"2024-07-24T16:37:04.009867+0000","last_clean":"2024-07-24T16:37:04.009867+0000","last_became_active":"2024-07-24T16:37:04.008293+0000","last_became_peered":"2024-07-24T16:37:04.008293+0000","last_unstale":"2024-07-24T16:37:04.009867+0000","last_undegraded":"2024-07-24T16:37:04.009867+0000","last_fullsized":"2024-07-24T16:37:04.009867+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:11:02.137962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.002979+0000","last_change":"2024-07-24T16:37:03.005837+0000","last_active":"2024-07-24T16:37:05.002979+0000","last_peered":"2024-07-24T16:37:05.002979+0000","last_clean":"2024-07-24T16:37:05.002979+0000","last_became_active":"2024-07-24T16:37:03.005494+0000","last_became_peered":"2024-07-24T16:37:03.005494+0000","last_unstale":"2024-07-24T16:37:05.002979+0000","last_undegraded":"2024-07-24T16:37:05.002979+0000","last_fullsized":"2024-07-24T16:37:05.002979+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:19.152923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.009439+0000","last_change":"2024-07-24T16:37:04.001679+0000","last_active":"2024-07-24T16:37:04.009439+0000","last_peered":"2024-07-24T16:37:04.009439+0000","last_clean":"2024-07-24T16:37:04.009439+0000","last_became_active":"2024-07-24T16:37:04.001396+0000","last_became_peered":"2024-07-24T16:37:04.001396+0000","last_unstale":"2024-07-24T16:37:04.009439+0000","last_undegraded":"2024-07-24T16:37:04.009439+0000","last_fullsized":"2024-07-24T16:37:04.009439+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:30:23.341481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003296+0000","last_change":"2024-07-24T16:37:03.003994+0000","last_active":"2024-07-24T16:37:05.003296+0000","last_peered":"2024-07-24T16:37:05.003296+0000","last_clean":"2024-07-24T16:37:05.003296+0000","last_became_active":"2024-07-24T16:37:03.003689+0000","last_became_peered":"2024-07-24T16:37:03.003689+0000","last_unstale":"2024-07-24T16:37:05.003296+0000","last_undegraded":"2024-07-24T16:37:05.003296+0000","last_fullsized":"2024-07-24T16:37:05.003296+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:17:37.057978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024578+0000","last_change":"2024-07-24T16:37:04.024282+0000","last_active":"2024-07-24T16:37:04.024578+0000","last_peered":"2024-07-24T16:37:04.024578+0000","last_clean":"2024-07-24T16:37:04.024578+0000","last_became_active":"2024-07-24T16:37:04.024040+0000","last_became_peered":"2024-07-24T16:37:04.024040+0000","last_unstale":"2024-07-24T16:37:04.024578+0000","last_undegraded":"2024-07-24T16:37:04.024578+0000","last_fullsized":"2024-07-24T16:37:04.024578+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:51:38.899349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.013985+0000","last_change":"2024-07-24T16:37:02.999879+0000","last_active":"2024-07-24T16:37:04.013985+0000","last_peered":"2024-07-24T16:37:04.013985+0000","last_clean":"2024-07-24T16:37:04.013985+0000","last_became_active":"2024-07-24T16:37:02.999554+0000","last_became_peered":"2024-07-24T16:37:02.999554+0000","last_unstale":"2024-07-24T16:37:04.013985+0000","last_undegraded":"2024-07-24T16:37:04.013985+0000","last_fullsized":"2024-07-24T16:37:04.013985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:10:25.228026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.002940+0000","last_change":"2024-07-24T16:37:04.012481+0000","last_active":"2024-07-24T16:37:05.002940+0000","last_peered":"2024-07-24T16:37:05.002940+0000","last_clean":"2024-07-24T16:37:05.002940+0000","last_became_active":"2024-07-24T16:37:04.012217+0000","last_became_peered":"2024-07-24T16:37:04.012217+0000","last_unstale":"2024-07-24T16:37:05.002940+0000","last_undegraded":"2024-07-24T16:37:05.002940+0000","last_fullsized":"2024-07-24T16:37:05.002940+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:10:47.439606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.002917+0000","last_change":"2024-07-24T16:37:03.005534+0000","last_active":"2024-07-24T16:37:04.002917+0000","last_peered":"2024-07-24T16:37:04.002917+0000","last_clean":"2024-07-24T16:37:04.002917+0000","last_became_active":"2024-07-24T16:37:03.005232+0000","last_became_peered":"2024-07-24T16:37:03.005232+0000","last_unstale":"2024-07-24T16:37:04.002917+0000","last_undegraded":"2024-07-24T16:37:04.002917+0000","last_fullsized":"2024-07-24T16:37:04.002917+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:18:00.748831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:03.997382+0000","last_change":"2024-07-24T16:37:03.995253+0000","last_active":"2024-07-24T16:37:03.997382+0000","last_peered":"2024-07-24T16:37:03.997382+0000","last_clean":"2024-07-24T16:37:03.997382+0000","last_became_active":"2024-07-24T16:37:03.994904+0000","last_became_peered":"2024-07-24T16:37:03.994904+0000","last_unstale":"2024-07-24T16:37:03.997382+0000","last_undegraded":"2024-07-24T16:37:03.997382+0000","last_fullsized":"2024-07-24T16:37:03.997382+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:09:05.945632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.004003+0000","last_change":"2024-07-24T16:37:03.004109+0000","last_active":"2024-07-24T16:37:05.004003+0000","last_peered":"2024-07-24T16:37:05.004003+0000","last_clean":"2024-07-24T16:37:05.004003+0000","last_became_active":"2024-07-24T16:37:03.003813+0000","last_became_peered":"2024-07-24T16:37:03.003813+0000","last_unstale":"2024-07-24T16:37:05.004003+0000","last_undegraded":"2024-07-24T16:37:05.004003+0000","last_fullsized":"2024-07-24T16:37:05.004003+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:44.069876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.023137+0000","last_change":"2024-07-24T16:37:04.015827+0000","last_active":"2024-07-24T16:37:04.023137+0000","last_peered":"2024-07-24T16:37:04.023137+0000","last_clean":"2024-07-24T16:37:04.023137+0000","last_became_active":"2024-07-24T16:37:04.015577+0000","last_became_peered":"2024-07-24T16:37:04.015577+0000","last_unstale":"2024-07-24T16:37:04.023137+0000","last_undegraded":"2024-07-24T16:37:04.023137+0000","last_fullsized":"2024-07-24T16:37:04.023137+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:04:44.330674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"62'3","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.015539+0000","last_change":"2024-07-24T16:37:03.002358+0000","last_active":"2024-07-24T16:37:04.015539+0000","last_peered":"2024-07-24T16:37:04.015539+0000","last_clean":"2024-07-24T16:37:04.015539+0000","last_became_active":"2024-07-24T16:37:03.001970+0000","last_became_peered":"2024-07-24T16:37:03.001970+0000","last_unstale":"2024-07-24T16:37:04.015539+0000","last_undegraded":"2024-07-24T16:37:04.015539+0000","last_fullsized":"2024-07-24T16:37:04.015539+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:18:18.548923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003978+0000","last_change":"2024-07-24T16:37:03.996498+0000","last_active":"2024-07-24T16:37:05.003978+0000","last_peered":"2024-07-24T16:37:05.003978+0000","last_clean":"2024-07-24T16:37:05.003978+0000","last_became_active":"2024-07-24T16:37:03.996235+0000","last_became_peered":"2024-07-24T16:37:03.996235+0000","last_unstale":"2024-07-24T16:37:05.003978+0000","last_undegraded":"2024-07-24T16:37:05.003978+0000","last_fullsized":"2024-07-24T16:37:05.003978+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:50:22.080512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"62'6","reported_seq":19,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.025180+0000","last_change":"2024-07-24T16:37:03.008087+0000","last_active":"2024-07-24T16:37:04.025180+0000","last_peered":"2024-07-24T16:37:04.025180+0000","last_clean":"2024-07-24T16:37:04.025180+0000","last_became_active":"2024-07-24T16:37:03.007813+0000","last_became_peered":"2024-07-24T16:37:03.007813+0000","last_unstale":"2024-07-24T16:37:04.025180+0000","last_undegraded":"2024-07-24T16:37:04.025180+0000","last_fullsized":"2024-07-24T16:37:04.025180+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:45:09.480096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.011996+0000","last_change":"2024-07-24T16:37:04.007864+0000","last_active":"2024-07-24T16:37:04.011996+0000","last_peered":"2024-07-24T16:37:04.011996+0000","last_clean":"2024-07-24T16:37:04.011996+0000","last_became_active":"2024-07-24T16:37:04.007559+0000","last_became_peered":"2024-07-24T16:37:04.007559+0000","last_unstale":"2024-07-24T16:37:04.011996+0000","last_undegraded":"2024-07-24T16:37:04.011996+0000","last_fullsized":"2024-07-24T16:37:04.011996+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:36.298799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.021146+0000","last_change":"2024-07-24T16:37:03.003657+0000","last_active":"2024-07-24T16:37:04.021146+0000","last_peered":"2024-07-24T16:37:04.021146+0000","last_clean":"2024-07-24T16:37:04.021146+0000","last_became_active":"2024-07-24T16:37:03.003386+0000","last_became_peered":"2024-07-24T16:37:03.003386+0000","last_unstale":"2024-07-24T16:37:04.021146+0000","last_undegraded":"2024-07-24T16:37:04.021146+0000","last_fullsized":"2024-07-24T16:37:04.021146+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:08:09.502445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024361+0000","last_change":"2024-07-24T16:37:04.019133+0000","last_active":"2024-07-24T16:37:04.024361+0000","last_peered":"2024-07-24T16:37:04.024361+0000","last_clean":"2024-07-24T16:37:04.024361+0000","last_became_active":"2024-07-24T16:37:04.018826+0000","last_became_peered":"2024-07-24T16:37:04.018826+0000","last_unstale":"2024-07-24T16:37:04.024361+0000","last_undegraded":"2024-07-24T16:37:04.024361+0000","last_fullsized":"2024-07-24T16:37:04.024361+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:44:26.797367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003159+0000","last_change":"2024-07-24T16:37:03.003836+0000","last_active":"2024-07-24T16:37:05.003159+0000","last_peered":"2024-07-24T16:37:05.003159+0000","last_clean":"2024-07-24T16:37:05.003159+0000","last_became_active":"2024-07-24T16:37:03.003542+0000","last_became_peered":"2024-07-24T16:37:03.003542+0000","last_unstale":"2024-07-24T16:37:05.003159+0000","last_undegraded":"2024-07-24T16:37:05.003159+0000","last_fullsized":"2024-07-24T16:37:05.003159+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:40:08.258903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.017692+0000","last_change":"2024-07-24T16:37:04.011095+0000","last_active":"2024-07-24T16:37:04.017692+0000","last_peered":"2024-07-24T16:37:04.017692+0000","last_clean":"2024-07-24T16:37:04.017692+0000","last_became_active":"2024-07-24T16:37:04.010791+0000","last_became_peered":"2024-07-24T16:37:04.010791+0000","last_unstale":"2024-07-24T16:37:04.017692+0000","last_undegraded":"2024-07-24T16:37:04.017692+0000","last_fullsized":"2024-07-24T16:37:04.017692+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:44:23.934817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.002577+0000","last_change":"2024-07-24T16:37:03.010829+0000","last_active":"2024-07-24T16:37:04.002577+0000","last_peered":"2024-07-24T16:37:04.002577+0000","last_clean":"2024-07-24T16:37:04.002577+0000","last_became_active":"2024-07-24T16:37:03.010566+0000","last_became_peered":"2024-07-24T16:37:03.010566+0000","last_unstale":"2024-07-24T16:37:04.002577+0000","last_undegraded":"2024-07-24T16:37:04.002577+0000","last_fullsized":"2024-07-24T16:37:04.002577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:58:26.392478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024991+0000","last_change":"2024-07-24T16:37:04.023416+0000","last_active":"2024-07-24T16:37:04.024991+0000","last_peered":"2024-07-24T16:37:04.024991+0000","last_clean":"2024-07-24T16:37:04.024991+0000","last_became_active":"2024-07-24T16:37:04.020968+0000","last_became_peered":"2024-07-24T16:37:04.020968+0000","last_unstale":"2024-07-24T16:37:04.024991+0000","last_undegraded":"2024-07-24T16:37:04.024991+0000","last_fullsized":"2024-07-24T16:37:04.024991+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:41:16.939071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"62'8","reported_seq":21,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.018506+0000","last_change":"2024-07-24T16:37:03.006180+0000","last_active":"2024-07-24T16:37:04.018506+0000","last_peered":"2024-07-24T16:37:04.018506+0000","last_clean":"2024-07-24T16:37:04.018506+0000","last_became_active":"2024-07-24T16:37:03.005719+0000","last_became_peered":"2024-07-24T16:37:03.005719+0000","last_unstale":"2024-07-24T16:37:04.018506+0000","last_undegraded":"2024-07-24T16:37:04.018506+0000","last_fullsized":"2024-07-24T16:37:04.018506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:05.170486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.016071+0000","last_change":"2024-07-24T16:37:04.005089+0000","last_active":"2024-07-24T16:37:04.016071+0000","last_peered":"2024-07-24T16:37:04.016071+0000","last_clean":"2024-07-24T16:37:04.016071+0000","last_became_active":"2024-07-24T16:37:04.004750+0000","last_became_peered":"2024-07-24T16:37:04.004750+0000","last_unstale":"2024-07-24T16:37:04.016071+0000","last_undegraded":"2024-07-24T16:37:04.016071+0000","last_fullsized":"2024-07-24T16:37:04.016071+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:23:03.806832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"62'1","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.021653+0000","last_change":"2024-07-24T16:37:03.013805+0000","last_active":"2024-07-24T16:37:04.021653+0000","last_peered":"2024-07-24T16:37:04.021653+0000","last_clean":"2024-07-24T16:37:04.021653+0000","last_became_active":"2024-07-24T16:37:03.013485+0000","last_became_peered":"2024-07-24T16:37:03.013485+0000","last_unstale":"2024-07-24T16:37:04.021653+0000","last_undegraded":"2024-07-24T16:37:04.021653+0000","last_fullsized":"2024-07-24T16:37:04.021653+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:45:47.297991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.022251+0000","last_change":"2024-07-24T16:37:04.019820+0000","last_active":"2024-07-24T16:37:04.022251+0000","last_peered":"2024-07-24T16:37:04.022251+0000","last_clean":"2024-07-24T16:37:04.022251+0000","last_became_active":"2024-07-24T16:37:04.019539+0000","last_became_peered":"2024-07-24T16:37:04.019539+0000","last_unstale":"2024-07-24T16:37:04.022251+0000","last_undegraded":"2024-07-24T16:37:04.022251+0000","last_fullsized":"2024-07-24T16:37:04.022251+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:43:11.475416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.004608+0000","last_change":"2024-07-24T16:37:02.998295+0000","last_active":"2024-07-24T16:37:05.004608+0000","last_peered":"2024-07-24T16:37:05.004608+0000","last_clean":"2024-07-24T16:37:05.004608+0000","last_became_active":"2024-07-24T16:37:02.998007+0000","last_became_peered":"2024-07-24T16:37:02.998007+0000","last_unstale":"2024-07-24T16:37:05.004608+0000","last_undegraded":"2024-07-24T16:37:05.004608+0000","last_fullsized":"2024-07-24T16:37:05.004608+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:32:49.184726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.002854+0000","last_change":"2024-07-24T16:37:04.022338+0000","last_active":"2024-07-24T16:37:05.002854+0000","last_peered":"2024-07-24T16:37:05.002854+0000","last_clean":"2024-07-24T16:37:05.002854+0000","last_became_active":"2024-07-24T16:37:04.022113+0000","last_became_peered":"2024-07-24T16:37:04.022113+0000","last_unstale":"2024-07-24T16:37:05.002854+0000","last_undegraded":"2024-07-24T16:37:05.002854+0000","last_fullsized":"2024-07-24T16:37:05.002854+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:26:46.966508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"62'1","reported_seq":16,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003399+0000","last_change":"2024-07-24T16:37:03.001292+0000","last_active":"2024-07-24T16:37:05.003399+0000","last_peered":"2024-07-24T16:37:05.003399+0000","last_clean":"2024-07-24T16:37:05.003399+0000","last_became_active":"2024-07-24T16:37:03.001003+0000","last_became_peered":"2024-07-24T16:37:03.001003+0000","last_unstale":"2024-07-24T16:37:05.003399+0000","last_undegraded":"2024-07-24T16:37:05.003399+0000","last_fullsized":"2024-07-24T16:37:05.003399+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:51:36.249129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.004226+0000","last_change":"2024-07-24T16:37:03.999104+0000","last_active":"2024-07-24T16:37:04.004226+0000","last_peered":"2024-07-24T16:37:04.004226+0000","last_clean":"2024-07-24T16:37:04.004226+0000","last_became_active":"2024-07-24T16:37:03.998825+0000","last_became_peered":"2024-07-24T16:37:03.998825+0000","last_unstale":"2024-07-24T16:37:04.004226+0000","last_undegraded":"2024-07-24T16:37:04.004226+0000","last_fullsized":"2024-07-24T16:37:04.004226+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:28:19.279886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003438+0000","last_change":"2024-07-24T16:37:03.013889+0000","last_active":"2024-07-24T16:37:05.003438+0000","last_peered":"2024-07-24T16:37:05.003438+0000","last_clean":"2024-07-24T16:37:05.003438+0000","last_became_active":"2024-07-24T16:37:03.013550+0000","last_became_peered":"2024-07-24T16:37:03.013550+0000","last_unstale":"2024-07-24T16:37:05.003438+0000","last_undegraded":"2024-07-24T16:37:05.003438+0000","last_fullsized":"2024-07-24T16:37:05.003438+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:32.419679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.003348+0000","last_change":"2024-07-24T16:37:04.000366+0000","last_active":"2024-07-24T16:37:04.003348+0000","last_peered":"2024-07-24T16:37:04.003348+0000","last_clean":"2024-07-24T16:37:04.003348+0000","last_became_active":"2024-07-24T16:37:04.000074+0000","last_became_peered":"2024-07-24T16:37:04.000074+0000","last_unstale":"2024-07-24T16:37:04.003348+0000","last_undegraded":"2024-07-24T16:37:04.003348+0000","last_fullsized":"2024-07-24T16:37:04.003348+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:31:41.870538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"62'2","reported_seq":15,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.013197+0000","last_change":"2024-07-24T16:37:02.995822+0000","last_active":"2024-07-24T16:37:04.013197+0000","last_peered":"2024-07-24T16:37:04.013197+0000","last_clean":"2024-07-24T16:37:04.013197+0000","last_became_active":"2024-07-24T16:37:02.995536+0000","last_became_peered":"2024-07-24T16:37:02.995536+0000","last_unstale":"2024-07-24T16:37:04.013197+0000","last_undegraded":"2024-07-24T16:37:04.013197+0000","last_fullsized":"2024-07-24T16:37:04.013197+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:00:55.075881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003014+0000","last_change":"2024-07-24T16:37:04.004492+0000","last_active":"2024-07-24T16:37:05.003014+0000","last_peered":"2024-07-24T16:37:05.003014+0000","last_clean":"2024-07-24T16:37:05.003014+0000","last_became_active":"2024-07-24T16:37:04.004210+0000","last_became_peered":"2024-07-24T16:37:04.004210+0000","last_unstale":"2024-07-24T16:37:05.003014+0000","last_undegraded":"2024-07-24T16:37:05.003014+0000","last_fullsized":"2024-07-24T16:37:05.003014+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:28:19.279886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:03.994349+0000","last_change":"2024-07-24T16:37:03.007200+0000","last_active":"2024-07-24T16:37:03.994349+0000","last_peered":"2024-07-24T16:37:03.994349+0000","last_clean":"2024-07-24T16:37:03.994349+0000","last_became_active":"2024-07-24T16:37:03.006461+0000","last_became_peered":"2024-07-24T16:37:03.006461+0000","last_unstale":"2024-07-24T16:37:03.994349+0000","last_undegraded":"2024-07-24T16:37:03.994349+0000","last_fullsized":"2024-07-24T16:37:03.994349+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:58:10.465983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.020954+0000","last_change":"2024-07-24T16:37:04.011548+0000","last_active":"2024-07-24T16:37:04.020954+0000","last_peered":"2024-07-24T16:37:04.020954+0000","last_clean":"2024-07-24T16:37:04.020954+0000","last_became_active":"2024-07-24T16:37:04.011301+0000","last_became_peered":"2024-07-24T16:37:04.011301+0000","last_unstale":"2024-07-24T16:37:04.020954+0000","last_undegraded":"2024-07-24T16:37:04.020954+0000","last_fullsized":"2024-07-24T16:37:04.020954+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:58:27.147847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.007168+0000","last_change":"2024-07-24T16:37:03.000155+0000","last_active":"2024-07-24T16:37:04.007168+0000","last_peered":"2024-07-24T16:37:04.007168+0000","last_clean":"2024-07-24T16:37:04.007168+0000","last_became_active":"2024-07-24T16:37:02.999863+0000","last_became_peered":"2024-07-24T16:37:02.999863+0000","last_unstale":"2024-07-24T16:37:04.007168+0000","last_undegraded":"2024-07-24T16:37:04.007168+0000","last_fullsized":"2024-07-24T16:37:04.007168+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:03.005579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.012901+0000","last_change":"2024-07-24T16:37:04.009717+0000","last_active":"2024-07-24T16:37:04.012901+0000","last_peered":"2024-07-24T16:37:04.012901+0000","last_clean":"2024-07-24T16:37:04.012901+0000","last_became_active":"2024-07-24T16:37:04.009453+0000","last_became_peered":"2024-07-24T16:37:04.009453+0000","last_unstale":"2024-07-24T16:37:04.012901+0000","last_undegraded":"2024-07-24T16:37:04.012901+0000","last_fullsized":"2024-07-24T16:37:04.012901+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:16:16.326020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.004394+0000","last_change":"2024-07-24T16:37:03.000905+0000","last_active":"2024-07-24T16:37:05.004394+0000","last_peered":"2024-07-24T16:37:05.004394+0000","last_clean":"2024-07-24T16:37:05.004394+0000","last_became_active":"2024-07-24T16:37:03.000630+0000","last_became_peered":"2024-07-24T16:37:03.000630+0000","last_unstale":"2024-07-24T16:37:05.004394+0000","last_undegraded":"2024-07-24T16:37:05.004394+0000","last_fullsized":"2024-07-24T16:37:05.004394+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:26:24.140079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.003372+0000","last_change":"2024-07-24T16:37:04.001385+0000","last_active":"2024-07-24T16:37:04.003372+0000","last_peered":"2024-07-24T16:37:04.003372+0000","last_clean":"2024-07-24T16:37:04.003372+0000","last_became_active":"2024-07-24T16:37:04.001124+0000","last_became_peered":"2024-07-24T16:37:04.001124+0000","last_unstale":"2024-07-24T16:37:04.003372+0000","last_undegraded":"2024-07-24T16:37:04.003372+0000","last_fullsized":"2024-07-24T16:37:04.003372+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:51:38.899349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"62'2","reported_seq":17,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003525+0000","last_change":"2024-07-24T16:37:03.003668+0000","last_active":"2024-07-24T16:37:05.003525+0000","last_peered":"2024-07-24T16:37:05.003525+0000","last_clean":"2024-07-24T16:37:05.003525+0000","last_became_active":"2024-07-24T16:37:03.003387+0000","last_became_peered":"2024-07-24T16:37:03.003387+0000","last_unstale":"2024-07-24T16:37:05.003525+0000","last_undegraded":"2024-07-24T16:37:05.003525+0000","last_fullsized":"2024-07-24T16:37:05.003525+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:50:35.318606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.004747+0000","last_change":"2024-07-24T16:37:04.000123+0000","last_active":"2024-07-24T16:37:04.004747+0000","last_peered":"2024-07-24T16:37:04.004747+0000","last_clean":"2024-07-24T16:37:04.004747+0000","last_became_active":"2024-07-24T16:37:03.999841+0000","last_became_peered":"2024-07-24T16:37:03.999841+0000","last_unstale":"2024-07-24T16:37:04.004747+0000","last_undegraded":"2024-07-24T16:37:04.004747+0000","last_fullsized":"2024-07-24T16:37:04.004747+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:40.906131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.004127+0000","last_change":"2024-07-24T16:37:03.003110+0000","last_active":"2024-07-24T16:37:04.004127+0000","last_peered":"2024-07-24T16:37:04.004127+0000","last_clean":"2024-07-24T16:37:04.004127+0000","last_became_active":"2024-07-24T16:37:03.002819+0000","last_became_peered":"2024-07-24T16:37:03.002819+0000","last_unstale":"2024-07-24T16:37:04.004127+0000","last_undegraded":"2024-07-24T16:37:04.004127+0000","last_fullsized":"2024-07-24T16:37:04.004127+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:32:42.309475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.017836+0000","last_change":"2024-07-24T16:37:04.007895+0000","last_active":"2024-07-24T16:37:04.017836+0000","last_peered":"2024-07-24T16:37:04.017836+0000","last_clean":"2024-07-24T16:37:04.017836+0000","last_became_active":"2024-07-24T16:37:04.007614+0000","last_became_peered":"2024-07-24T16:37:04.007614+0000","last_unstale":"2024-07-24T16:37:04.017836+0000","last_undegraded":"2024-07-24T16:37:04.017836+0000","last_fullsized":"2024-07-24T16:37:04.017836+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:42:56.839993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.000875+0000","last_change":"2024-07-24T16:37:03.002515+0000","last_active":"2024-07-24T16:37:04.000875+0000","last_peered":"2024-07-24T16:37:04.000875+0000","last_clean":"2024-07-24T16:37:04.000875+0000","last_became_active":"2024-07-24T16:37:03.002219+0000","last_became_peered":"2024-07-24T16:37:03.002219+0000","last_unstale":"2024-07-24T16:37:04.000875+0000","last_undegraded":"2024-07-24T16:37:04.000875+0000","last_fullsized":"2024-07-24T16:37:04.000875+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:29:44.553198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.024464+0000","last_change":"2024-07-24T16:37:04.021367+0000","last_active":"2024-07-24T16:37:04.024464+0000","last_peered":"2024-07-24T16:37:04.024464+0000","last_clean":"2024-07-24T16:37:04.024464+0000","last_became_active":"2024-07-24T16:37:04.021059+0000","last_became_peered":"2024-07-24T16:37:04.021059+0000","last_unstale":"2024-07-24T16:37:04.024464+0000","last_undegraded":"2024-07-24T16:37:04.024464+0000","last_fullsized":"2024-07-24T16:37:04.024464+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:49:30.747107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:03.996813+0000","last_change":"2024-07-24T16:37:03.009702+0000","last_active":"2024-07-24T16:37:03.996813+0000","last_peered":"2024-07-24T16:37:03.996813+0000","last_clean":"2024-07-24T16:37:03.996813+0000","last_became_active":"2024-07-24T16:37:03.009216+0000","last_became_peered":"2024-07-24T16:37:03.009216+0000","last_unstale":"2024-07-24T16:37:03.996813+0000","last_undegraded":"2024-07-24T16:37:03.996813+0000","last_fullsized":"2024-07-24T16:37:03.996813+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:33.301368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.011259+0000","last_change":"2024-07-24T16:37:04.007332+0000","last_active":"2024-07-24T16:37:04.011259+0000","last_peered":"2024-07-24T16:37:04.011259+0000","last_clean":"2024-07-24T16:37:04.011259+0000","last_became_active":"2024-07-24T16:37:04.007096+0000","last_became_peered":"2024-07-24T16:37:04.007096+0000","last_unstale":"2024-07-24T16:37:04.011259+0000","last_undegraded":"2024-07-24T16:37:04.011259+0000","last_fullsized":"2024-07-24T16:37:04.011259+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:05:05.128427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:03.995741+0000","last_change":"2024-07-24T16:37:03.008273+0000","last_active":"2024-07-24T16:37:03.995741+0000","last_peered":"2024-07-24T16:37:03.995741+0000","last_clean":"2024-07-24T16:37:03.995741+0000","last_became_active":"2024-07-24T16:37:03.008025+0000","last_became_peered":"2024-07-24T16:37:03.008025+0000","last_unstale":"2024-07-24T16:37:03.995741+0000","last_undegraded":"2024-07-24T16:37:03.995741+0000","last_fullsized":"2024-07-24T16:37:03.995741+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:54.564511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.022955+0000","last_change":"2024-07-24T16:37:04.018001+0000","last_active":"2024-07-24T16:37:04.022955+0000","last_peered":"2024-07-24T16:37:04.022955+0000","last_clean":"2024-07-24T16:37:04.022955+0000","last_became_active":"2024-07-24T16:37:04.017748+0000","last_became_peered":"2024-07-24T16:37:04.017748+0000","last_unstale":"2024-07-24T16:37:04.022955+0000","last_undegraded":"2024-07-24T16:37:04.022955+0000","last_fullsized":"2024-07-24T16:37:04.022955+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:22.247786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":15,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003639+0000","last_change":"2024-07-24T16:37:03.008246+0000","last_active":"2024-07-24T16:37:05.003639+0000","last_peered":"2024-07-24T16:37:05.003639+0000","last_clean":"2024-07-24T16:37:05.003639+0000","last_became_active":"2024-07-24T16:37:03.008010+0000","last_became_peered":"2024-07-24T16:37:03.008010+0000","last_unstale":"2024-07-24T16:37:05.003639+0000","last_undegraded":"2024-07-24T16:37:05.003639+0000","last_fullsized":"2024-07-24T16:37:05.003639+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:23.842357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.014508+0000","last_change":"2024-07-24T16:37:04.004696+0000","last_active":"2024-07-24T16:37:04.014508+0000","last_peered":"2024-07-24T16:37:04.014508+0000","last_clean":"2024-07-24T16:37:04.014508+0000","last_became_active":"2024-07-24T16:37:04.004446+0000","last_became_peered":"2024-07-24T16:37:04.004446+0000","last_unstale":"2024-07-24T16:37:04.014508+0000","last_undegraded":"2024-07-24T16:37:04.014508+0000","last_fullsized":"2024-07-24T16:37:04.014508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:05:50.615617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:03.990932+0000","last_change":"2024-07-24T16:37:02.997130+0000","last_active":"2024-07-24T16:37:03.990932+0000","last_peered":"2024-07-24T16:37:03.990932+0000","last_clean":"2024-07-24T16:37:03.990932+0000","last_became_active":"2024-07-24T16:37:02.996841+0000","last_became_peered":"2024-07-24T16:37:02.996841+0000","last_unstale":"2024-07-24T16:37:03.990932+0000","last_undegraded":"2024-07-24T16:37:03.990932+0000","last_fullsized":"2024-07-24T16:37:03.990932+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:27:02.167426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":13,"reported_epoch":63,"state":"active+clean","last_fresh":"2024-07-24T16:37:05.003201+0000","last_change":"2024-07-24T16:37:04.005886+0000","last_active":"2024-07-24T16:37:05.003201+0000","last_peered":"2024-07-24T16:37:05.003201+0000","last_clean":"2024-07-24T16:37:05.003201+0000","last_became_active":"2024-07-24T16:37:04.005578+0000","last_became_peered":"2024-07-24T16:37:04.005578+0000","last_unstale":"2024-07-24T16:37:05.003201+0000","last_undegraded":"2024-07-24T16:37:05.003201+0000","last_fullsized":"2024-07-24T16:37:05.003201+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:32:24.649601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:03.999551+0000","last_change":"2024-07-24T16:37:03.002115+0000","last_active":"2024-07-24T16:37:03.999551+0000","last_peered":"2024-07-24T16:37:03.999551+0000","last_clean":"2024-07-24T16:37:03.999551+0000","last_became_active":"2024-07-24T16:37:03.001758+0000","last_became_peered":"2024-07-24T16:37:03.001758+0000","last_unstale":"2024-07-24T16:37:03.999551+0000","last_undegraded":"2024-07-24T16:37:03.999551+0000","last_fullsized":"2024-07-24T16:37:03.999551+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:10:49.225665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'86","reported_seq":242,"reported_epoch":62,"state":"active+clean","last_fresh":"2024-07-24T16:37:04.002695+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:37:04.002695+0000","last_peered":"2024-07-24T16:37:04.002695+0000","last_clean":"2024-07-24T16:37:04.002695+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:37:04.002695+0000","last_undegraded":"2024-07-24T16:37:04.002695+0000","last_fullsized":"2024-07-24T16:37:04.002695+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575007,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54700,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317140,"statfs":{"total":96636764160,"available":96580751360,"internally_reserved":0,"allocated":1343488,"data_stored":957315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575007,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31932,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339908,"statfs":{"total":96636764160,"available":96604065792,"internally_reserved":0,"allocated":761856,"data_stored":374467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575007,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49952,"kb_used_data":724,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321888,"statfs":{"total":96636764160,"available":96585613312,"internally_reserved":0,"allocated":741376,"data_stored":366823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575008,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":757760,"data_stored":374397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575008,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31928,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339912,"statfs":{"total":96636764160,"available":96604069888,"internally_reserved":0,"allocated":757760,"data_stored":368457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575008,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54140,"kb_used_data":748,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317700,"statfs":{"total":96636764160,"available":96581324800,"internally_reserved":0,"allocated":765952,"data_stored":375427,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31912,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339928,"statfs":{"total":96636764160,"available":96604086272,"internally_reserved":0,"allocated":749568,"data_stored":366983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575008,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32500,"kb_used_data":1312,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339340,"statfs":{"total":96636764160,"available":96603484160,"internally_reserved":0,"allocated":1343488,"data_stored":957247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:37:07.353 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-07-24T16:37:07.353 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-07-24T16:37:07.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.498+0000 7f8dd2abe640 1 -- 172.21.15.159:0/3839826228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dcc070610 msgr2=0x7f8dcc070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:07.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.498+0000 7f8dd2abe640 1 --2- 172.21.15.159:0/3839826228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dcc070610 0x7f8dcc070a10 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc073ff0 tx=0x7f8dc402aa30 comp rx=0 tx=0).stop 2024-07-24T16:37:07.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.498+0000 7f8dd2abe640 1 -- 172.21.15.159:0/3839826228 shutdown_connections 2024-07-24T16:37:07.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.498+0000 7f8dd2abe640 1 --2- 172.21.15.159:0/3839826228 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dcc070610 0x7f8dcc070a10 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.498+0000 7f8dd2abe640 1 --2- 172.21.15.159:0/3839826228 >> v2:172.21.15.193:3300/0 conn(0x7f8dcc06c560 0x7f8dcc15fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.498+0000 7f8dd2abe640 1 -- 172.21.15.159:0/3839826228 >> 172.21.15.159:0/3839826228 conn(0x7f8dcc0b2230 msgr2=0x7f8dcc0b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:07.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.498+0000 7f8dd2abe640 1 -- 172.21.15.159:0/3839826228 shutdown_connections 2024-07-24T16:37:07.501 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.498+0000 7f8dd2abe640 1 -- 172.21.15.159:0/3839826228 wait complete. 2024-07-24T16:37:07.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.499+0000 7f8dd2abe640 1 Processor -- start 2024-07-24T16:37:07.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.499+0000 7f8dd2abe640 1 -- start start 2024-07-24T16:37:07.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd2abe640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8dcc06c560 0x7f8dcc0ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:07.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd2abe640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dcc070610 0x7f8dcc1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:07.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd2abe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dcc0ce310 0x7f8dcc0cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:07.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd2abe640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f8dcc070f50 con 0x7f8dcc0ce310 2024-07-24T16:37:07.504 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd2abe640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f8dcc15ee30 con 0x7f8dcc070610 2024-07-24T16:37:07.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd2abe640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8dcc0710d0 con 0x7f8dcc06c560 2024-07-24T16:37:07.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd105b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dcc0ce310 0x7f8dcc0cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:07.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd105b640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dcc0ce310 0x7f8dcc0cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47324/0 (socket says 172.21.15.159:47324) 2024-07-24T16:37:07.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd105b640 1 -- 172.21.15.159:0/517851454 learned_addr learned my addr 172.21.15.159:0/517851454 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:07.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd085a640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8dcc06c560 0x7f8dcc0ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:07.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dcbfff640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dcc070610 0x7f8dcc1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:07.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd105b640 1 -- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8dcc06c560 msgr2=0x7f8dcc0ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:07.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd105b640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8dcc06c560 0x7f8dcc0ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd105b640 1 -- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dcc070610 msgr2=0x7f8dcc1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:07.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd105b640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dcc070610 0x7f8dcc1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.500+0000 7f8dd105b640 1 -- 172.21.15.159:0/517851454 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dcc0af490 con 0x7f8dcc0ce310 2024-07-24T16:37:07.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.501+0000 7f8dd105b640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dcc0ce310 0x7f8dcc0cefe0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8dc402b020 tx=0x7f8dc4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:07.505 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.501+0000 7f8dc97fa640 1 -- 172.21.15.159:0/517851454 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4047070 con 0x7f8dcc0ce310 2024-07-24T16:37:07.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.501+0000 7f8dc97fa640 1 -- 172.21.15.159:0/517851454 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8dc4004250 con 0x7f8dcc0ce310 2024-07-24T16:37:07.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.501+0000 7f8dd2abe640 1 -- 172.21.15.159:0/517851454 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dcc0b48c0 con 0x7f8dcc0ce310 2024-07-24T16:37:07.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.501+0000 7f8dc97fa640 1 -- 172.21.15.159:0/517851454 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8dc4033050 con 0x7f8dcc0ce310 2024-07-24T16:37:07.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.501+0000 7f8dd2abe640 1 -- 172.21.15.159:0/517851454 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dcc0b4e80 con 0x7f8dcc0ce310 2024-07-24T16:37:07.506 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.502+0000 7f8dd2abe640 1 -- 172.21.15.159:0/517851454 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dcc15ad70 con 0x7f8dcc0ce310 2024-07-24T16:37:07.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.502+0000 7f8dc97fa640 1 -- 172.21.15.159:0/517851454 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f8dc404a070 con 0x7f8dcc0ce310 2024-07-24T16:37:07.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.503+0000 7f8dc97fa640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f8db8077010 0x7f8db80794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:07.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.503+0000 7f8dc97fa640 1 -- 172.21.15.159:0/517851454 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6401+0+0 (secure 0 0 0) 0x7f8dc40b9d90 con 0x7f8dcc0ce310 2024-07-24T16:37:07.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.503+0000 7f8dd085a640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f8db8077010 0x7f8db80794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:07.507 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.503+0000 7f8dd085a640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f8db8077010 0x7f8db80794d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0058c0 tx=0x7f8dbc00a250 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:07.509 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.507+0000 7f8dc97fa640 1 -- 172.21.15.159:0/517851454 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f8dcc15ad70 con 0x7f8dcc0ce310 2024-07-24T16:37:07.760 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.758+0000 7f8dd2abe640 1 -- 172.21.15.159:0/517851454 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8dcc0cd090 con 0x7f8dcc0ce310 2024-07-24T16:37:07.762 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.760+0000 7f8dc97fa640 1 -- 172.21.15.159:0/517851454 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f8dcc0af490 con 0x7f8dcc0ce310 2024-07-24T16:37:07.763 INFO:teuthology.orchestra.run.smithi159.stdout:[client.0] 2024-07-24T16:37:07.763 INFO:teuthology.orchestra.run.smithi159.stdout: key = AQBwKqFmSByWLRAAlc1hHDXFceGP9BYk8GpZJA== 2024-07-24T16:37:07.763 INFO:teuthology.orchestra.run.smithi159.stdout: caps mds = "allow" 2024-07-24T16:37:07.763 INFO:teuthology.orchestra.run.smithi159.stdout: caps mon = "allow r" 2024-07-24T16:37:07.763 INFO:teuthology.orchestra.run.smithi159.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-07-24T16:37:07.763 INFO:teuthology.orchestra.run.smithi159.stderr:updated caps for client.0 2024-07-24T16:37:07.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.762+0000 7f8dd2abe640 1 -- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f8db8077010 msgr2=0x7f8db80794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:07.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.762+0000 7f8dd2abe640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f8db8077010 0x7f8db80794d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f8dbc0058c0 tx=0x7f8dbc00a250 comp rx=0 tx=0).stop 2024-07-24T16:37:07.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.762+0000 7f8dd2abe640 1 -- 172.21.15.159:0/517851454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dcc0ce310 msgr2=0x7f8dcc0cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:07.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.762+0000 7f8dd2abe640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dcc0ce310 0x7f8dcc0cefe0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8dc402b020 tx=0x7f8dc4003f10 comp rx=0 tx=0).stop 2024-07-24T16:37:07.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.762+0000 7f8dd2abe640 1 -- 172.21.15.159:0/517851454 shutdown_connections 2024-07-24T16:37:07.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.762+0000 7f8dd2abe640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f8db8077010 0x7f8db80794d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.762+0000 7f8dd2abe640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8dcc0ce310 0x7f8dcc0cefe0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.762+0000 7f8dd2abe640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f8dcc070610 0x7f8dcc1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.762+0000 7f8dd2abe640 1 --2- 172.21.15.159:0/517851454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8dcc06c560 0x7f8dcc0ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.762+0000 7f8dd2abe640 1 -- 172.21.15.159:0/517851454 >> 172.21.15.159:0/517851454 conn(0x7f8dcc0b2230 msgr2=0x7f8dcc0b13a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:07.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.762+0000 7f8dd2abe640 1 -- 172.21.15.159:0/517851454 shutdown_connections 2024-07-24T16:37:07.766 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.762+0000 7f8dd2abe640 1 -- 172.21.15.159:0/517851454 wait complete. 2024-07-24T16:37:07.776 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:37:07.879 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.876+0000 7fbde18d4640 1 -- 172.21.15.159:0/2670835060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc0b0b60 msgr2=0x7fbddc0cf770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:07.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.876+0000 7fbde18d4640 1 --2- 172.21.15.159:0/2670835060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc0b0b60 0x7fbddc0cf770 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbddc08c970 tx=0x7fbdd402a560 comp rx=0 tx=0).stop 2024-07-24T16:37:07.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.876+0000 7fbde18d4640 1 -- 172.21.15.159:0/2670835060 shutdown_connections 2024-07-24T16:37:07.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.876+0000 7fbde18d4640 1 --2- 172.21.15.159:0/2670835060 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc0b0b60 0x7fbddc0cf770 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.876+0000 7fbde18d4640 1 --2- 172.21.15.159:0/2670835060 >> v2:172.21.15.193:3300/0 conn(0x7fbddc0b2ae0 0x7fbddc0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.876+0000 7fbde18d4640 1 --2- 172.21.15.159:0/2670835060 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbddc15d950 0x7fbddc161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.876+0000 7fbde18d4640 1 -- 172.21.15.159:0/2670835060 >> 172.21.15.159:0/2670835060 conn(0x7fbddc09cd30 msgr2=0x7fbddc0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:07.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.876+0000 7fbde18d4640 1 -- 172.21.15.159:0/2670835060 shutdown_connections 2024-07-24T16:37:07.880 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.876+0000 7fbde18d4640 1 -- 172.21.15.159:0/2670835060 wait complete. 2024-07-24T16:37:07.882 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.878+0000 7fbde18d4640 1 Processor -- start 2024-07-24T16:37:07.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.878+0000 7fbde18d4640 1 -- start start 2024-07-24T16:37:07.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.878+0000 7fbde18d4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbddc0b0b60 0x7fbddc1f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:07.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.878+0000 7fbde18d4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc0b2ae0 0x7fbddc1604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:07.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.878+0000 7fbde18d4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbddc15d950 0x7fbddc15f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:07.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbde18d4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc0d0040 con 0x7fbddc0b2ae0 2024-07-24T16:37:07.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbde18d4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbddc0cfec0 con 0x7fbddc15d950 2024-07-24T16:37:07.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbde18d4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbddc0d02e0 con 0x7fbddc0b0b60 2024-07-24T16:37:07.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbdda7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc0b2ae0 0x7fbddc1604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:07.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbdda7fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc0b2ae0 0x7fbddc1604d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47356/0 (socket says 172.21.15.159:47356) 2024-07-24T16:37:07.883 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbdda7fc640 1 -- 172.21.15.159:0/3237243498 learned_addr learned my addr 172.21.15.159:0/3237243498 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbddaffd640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbddc0b0b60 0x7fbddc1f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbddb7fe640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbddc15d950 0x7fbddc15f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbdda7fc640 1 -- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbddc0b0b60 msgr2=0x7fbddc1f4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbdda7fc640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbddc0b0b60 0x7fbddc1f4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbdda7fc640 1 -- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbddc15d950 msgr2=0x7fbddc15f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbdda7fc640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbddc15d950 0x7fbddc15f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbdda7fc640 1 -- 172.21.15.159:0/3237243498 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbddc160a10 con 0x7fbddc0b2ae0 2024-07-24T16:37:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbdda7fc640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc0b2ae0 0x7fbddc1604d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000d750 tx=0x7fbdd000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbdc3fff640 1 -- 172.21.15.159:0/3237243498 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd0017070 con 0x7fbddc0b2ae0 2024-07-24T16:37:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbdc3fff640 1 -- 172.21.15.159:0/3237243498 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdd0004310 con 0x7fbddc0b2ae0 2024-07-24T16:37:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbdc3fff640 1 -- 172.21.15.159:0/3237243498 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdd000de60 con 0x7fbddc0b2ae0 2024-07-24T16:37:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbde18d4640 1 -- 172.21.15.159:0/3237243498 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbddc160ce0 con 0x7fbddc0b2ae0 2024-07-24T16:37:07.884 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.879+0000 7fbde18d4640 1 -- 172.21.15.159:0/3237243498 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbddc0b4b30 con 0x7fbddc0b2ae0 2024-07-24T16:37:07.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.880+0000 7fbde18d4640 1 -- 172.21.15.159:0/3237243498 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbddc0b0620 con 0x7fbddc0b2ae0 2024-07-24T16:37:07.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.881+0000 7fbdc3fff640 1 -- 172.21.15.159:0/3237243498 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fbdd0009c30 con 0x7fbddc0b2ae0 2024-07-24T16:37:07.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.881+0000 7fbdc3fff640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fbdc8077010 0x7fbdc80794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:07.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.881+0000 7fbdc3fff640 1 -- 172.21.15.159:0/3237243498 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6401+0+0 (secure 0 0 0) 0x7fbdd0098ae0 con 0x7fbddc0b2ae0 2024-07-24T16:37:07.885 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.882+0000 7fbddaffd640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fbdc8077010 0x7fbdc80794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:07.886 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.882+0000 7fbddaffd640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fbdc8077010 0x7fbdc80794d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbddc160fc0 tx=0x7fbdcc00a540 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:07.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:07.885+0000 7fbdc3fff640 1 -- 172.21.15.159:0/3237243498 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fbdd0061460 con 0x7fbddc0b2ae0 2024-07-24T16:37:08.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.109+0000 7fbde18d4640 1 -- 172.21.15.159:0/3237243498 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbddc06d8a0 con 0x7fbddc0b2ae0 2024-07-24T16:37:08.112 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.110+0000 7fbdc3fff640 1 -- 172.21.15.159:0/3237243498 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5229 (secure 0 0 0) 0x7fbdd00659b0 con 0x7fbddc0b2ae0 2024-07-24T16:37:08.113 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:37:08.113 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-07-24T16:37:06:000526+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2788613741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":2788613741},{"type":"v1","addr":"172.21.15.193:6837","nonce":2788613741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/804895322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":804895322},{"type":"v1","addr":"172.21.15.193:6835","nonce":804895322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/4181924724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4181924724},{"type":"v1","addr":"172.21.15.159:6834","nonce":4181924724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:37:03.352837+0000","modified":"2024-07-24T16:37:05.351191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5796":{"gid":5796,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6835/433186879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":433186879},{"type":"v1","addr":"172.21.15.159:6835","nonce":433186879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5796,"qdb_cluster":[5796]},"id":3}]} 2024-07-24T16:37:08.113 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-07-24T16:37:08.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.112+0000 7fbde18d4640 1 -- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fbdc8077010 msgr2=0x7fbdc80794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.112+0000 7fbde18d4640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fbdc8077010 0x7fbdc80794d0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbddc160fc0 tx=0x7fbdcc00a540 comp rx=0 tx=0).stop 2024-07-24T16:37:08.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.112+0000 7fbde18d4640 1 -- 172.21.15.159:0/3237243498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc0b2ae0 msgr2=0x7fbddc1604d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.112+0000 7fbde18d4640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc0b2ae0 0x7fbddc1604d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fbdd000d750 tx=0x7fbdd000dc10 comp rx=0 tx=0).stop 2024-07-24T16:37:08.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.112+0000 7fbde18d4640 1 -- 172.21.15.159:0/3237243498 shutdown_connections 2024-07-24T16:37:08.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.112+0000 7fbde18d4640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbddc15d950 0x7fbddc15f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.112+0000 7fbde18d4640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fbdc8077010 0x7fbdc80794d0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.112+0000 7fbde18d4640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbddc0b2ae0 0x7fbddc1604d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.112+0000 7fbde18d4640 1 --2- 172.21.15.159:0/3237243498 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbddc0b0b60 0x7fbddc1f4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.112+0000 7fbde18d4640 1 -- 172.21.15.159:0/3237243498 >> 172.21.15.159:0/3237243498 conn(0x7fbddc09cd30 msgr2=0x7fbddc0ca1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:08.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.112+0000 7fbde18d4640 1 -- 172.21.15.159:0/3237243498 shutdown_connections 2024-07-24T16:37:08.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.112+0000 7fbde18d4640 1 -- 172.21.15.159:0/3237243498 wait complete. 2024-07-24T16:37:08.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-07-24T16:37:03.352837+0000', 'modified': '2024-07-24T16:37:05.351191+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5796}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5796': {'gid': 5796, 'name': 'a', 'rank': 0, 'incarnation': 22, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.159:6835/433186879', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.159:6833', 'nonce': 433186879}, {'type': 'v1', 'addr': '172.21.15.159:6835', 'nonce': 433186879}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5796, 'qdb_cluster': [5796]} 2024-07-24T16:37:08.529 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-07-24T16:37:08.529 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-07-24T16:37:08.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.634+0000 7fee51b8a640 1 -- 172.21.15.159:0/1776262866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee4c0cf770 msgr2=0x7fee4c15b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.634+0000 7fee51b8a640 1 --2- 172.21.15.159:0/1776262866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee4c0cf770 0x7fee4c15b4b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fee4c06fb90 tx=0x7fee3c02aa30 comp rx=0 tx=0).stop 2024-07-24T16:37:08.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.634+0000 7fee51b8a640 1 -- 172.21.15.159:0/1776262866 shutdown_connections 2024-07-24T16:37:08.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.634+0000 7fee51b8a640 1 --2- 172.21.15.159:0/1776262866 >> v2:172.21.15.193:3300/0 conn(0x7fee4c0cfb50 0x7fee4c0cbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.634+0000 7fee51b8a640 1 --2- 172.21.15.159:0/1776262866 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee4c0cf770 0x7fee4c15b4b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.634+0000 7fee51b8a640 1 -- 172.21.15.159:0/1776262866 >> 172.21.15.159:0/1776262866 conn(0x7fee4c06c560 msgr2=0x7fee4c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:08.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.634+0000 7fee51b8a640 1 -- 172.21.15.159:0/1776262866 shutdown_connections 2024-07-24T16:37:08.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.634+0000 7fee51b8a640 1 -- 172.21.15.159:0/1776262866 wait complete. 2024-07-24T16:37:08.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.635+0000 7fee51b8a640 1 Processor -- start 2024-07-24T16:37:08.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.635+0000 7fee51b8a640 1 -- start start 2024-07-24T16:37:08.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee51b8a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee4c06dba0 0x7fee4c0b1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee51b8a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee4c0cf770 0x7fee4c0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee51b8a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee4c0cfb50 0x7fee4c150bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee51b8a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c0aea50 con 0x7fee4c0cfb50 2024-07-24T16:37:08.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee51b8a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c0ae8d0 con 0x7fee4c0cf770 2024-07-24T16:37:08.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee51b8a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fee4c0aebd0 con 0x7fee4c06dba0 2024-07-24T16:37:08.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee4bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee4c0cfb50 0x7fee4c150bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee4bfff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee4c0cfb50 0x7fee4c150bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47376/0 (socket says 172.21.15.159:47376) 2024-07-24T16:37:08.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee4bfff640 1 -- 172.21.15.159:0/3388516179 learned_addr learned my addr 172.21.15.159:0/3388516179 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:08.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee4b7fe640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee4c06dba0 0x7fee4c0b1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee4affd640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee4c0cf770 0x7fee4c0adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee4bfff640 1 -- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee4c06dba0 msgr2=0x7fee4c0b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee4bfff640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee4c06dba0 0x7fee4c0b1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.636+0000 7fee4bfff640 1 -- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee4c0cf770 msgr2=0x7fee4c0adb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.637+0000 7fee4bfff640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee4c0cf770 0x7fee4c0adb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.637+0000 7fee4bfff640 1 -- 172.21.15.159:0/3388516179 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee4c1f83e0 con 0x7fee4c0cfb50 2024-07-24T16:37:08.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.637+0000 7fee4b7fe640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee4c06dba0 0x7fee4c0b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:37:08.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.637+0000 7fee4bfff640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee4c0cfb50 0x7fee4c150bc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fee44005d00 tx=0x7fee4400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:08.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.637+0000 7fee33fff640 1 -- 172.21.15.159:0/3388516179 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee44017070 con 0x7fee4c0cfb50 2024-07-24T16:37:08.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.637+0000 7fee33fff640 1 -- 172.21.15.159:0/3388516179 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee44005330 con 0x7fee4c0cfb50 2024-07-24T16:37:08.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.637+0000 7fee51b8a640 1 -- 172.21.15.159:0/3388516179 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee4c1f4510 con 0x7fee4c0cfb50 2024-07-24T16:37:08.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.637+0000 7fee33fff640 1 -- 172.21.15.159:0/3388516179 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee440047a0 con 0x7fee4c0cfb50 2024-07-24T16:37:08.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.637+0000 7fee51b8a640 1 -- 172.21.15.159:0/3388516179 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee4c1f4ad0 con 0x7fee4c0cfb50 2024-07-24T16:37:08.645 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.639+0000 7fee33fff640 1 -- 172.21.15.159:0/3388516179 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fee44004940 con 0x7fee4c0cfb50 2024-07-24T16:37:08.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.639+0000 7fee33fff640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fee38077010 0x7fee380794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.639+0000 7fee33fff640 1 -- 172.21.15.159:0/3388516179 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6401+0+0 (secure 0 0 0) 0x7fee44098a00 con 0x7fee4c0cfb50 2024-07-24T16:37:08.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.639+0000 7fee4b7fe640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fee38077010 0x7fee380794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.640+0000 7fee4b7fe640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fee38077010 0x7fee380794d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee3c035000 tx=0x7fee3c03a040 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:08.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.640+0000 7fee549bb740 1 Processor -- start 2024-07-24T16:37:08.646 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.640+0000 7fee549bb740 1 -- start start 2024-07-24T16:37:08.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee549bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38b0dcb0 0x55bd38b0e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee549bb740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac8e20 0x55bd38b0c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee549bb740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38ac93a0 0x55bd38b0ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee549bb740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55bd38a3a270 con 0x55bd38ac8e20 2024-07-24T16:37:08.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee549bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bd38a29770 con 0x55bd38b0dcb0 2024-07-24T16:37:08.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee549bb740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55bd38a2d7b0 con 0x55bd38ac93a0 2024-07-24T16:37:08.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee4affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac8e20 0x55bd38b0c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee4affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac8e20 0x55bd38b0c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47392/0 (socket says 172.21.15.159:47392) 2024-07-24T16:37:08.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee4affd640 1 -- 172.21.15.159:0/2044144844 learned_addr learned my addr 172.21.15.159:0/2044144844 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:08.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee4b7fe640 1 --2- 172.21.15.159:0/2044144844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38b0dcb0 0x55bd38b0e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.647 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee4bfff640 1 --2- 172.21.15.159:0/2044144844 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38ac93a0 0x55bd38b0ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee4affd640 1 -- 172.21.15.159:0/2044144844 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38ac93a0 msgr2=0x55bd38b0ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:37:08.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee4affd640 1 --2- 172.21.15.159:0/2044144844 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38ac93a0 0x55bd38b0ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee4affd640 1 -- 172.21.15.159:0/2044144844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38b0dcb0 msgr2=0x55bd38b0e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:37:08.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee4affd640 1 --2- 172.21.15.159:0/2044144844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38b0dcb0 0x55bd38b0e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee4affd640 1 -- 172.21.15.159:0/2044144844 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd389d6e20 con 0x55bd38ac8e20 2024-07-24T16:37:08.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee4affd640 1 --2- 172.21.15.159:0/2044144844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac8e20 0x55bd38b0c790 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fee40004fd0 tx=0x7fee40005490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3a1dd89c12b73ef server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:08.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee317fa640 1 -- 172.21.15.159:0/2044144844 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40017020 con 0x55bd38ac8e20 2024-07-24T16:37:08.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee317fa640 1 -- 172.21.15.159:0/2044144844 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee40003c40 con 0x55bd38ac8e20 2024-07-24T16:37:08.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.641+0000 7fee317fa640 1 -- 172.21.15.159:0/2044144844 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee4000fad0 con 0x55bd38ac8e20 2024-07-24T16:37:08.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.642+0000 7fee549bb740 1 -- 172.21.15.159:0/2044144844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac8e20 msgr2=0x55bd38b0c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.648 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.642+0000 7fee549bb740 1 --2- 172.21.15.159:0/2044144844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac8e20 0x55bd38b0c790 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fee40004fd0 tx=0x7fee40005490 comp rx=0 tx=0).stop 2024-07-24T16:37:08.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.642+0000 7fee549bb740 1 -- 172.21.15.159:0/2044144844 shutdown_connections 2024-07-24T16:37:08.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.642+0000 7fee549bb740 1 --2- 172.21.15.159:0/2044144844 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38ac93a0 0x55bd38b0ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.642+0000 7fee549bb740 1 --2- 172.21.15.159:0/2044144844 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac8e20 0x55bd38b0c790 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.642+0000 7fee549bb740 1 --2- 172.21.15.159:0/2044144844 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38b0dcb0 0x55bd38b0e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.642+0000 7fee549bb740 1 -- 172.21.15.159:0/2044144844 >> 172.21.15.159:0/2044144844 conn(0x55bd38ac43f0 msgr2=0x55bd38ac7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:08.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.642+0000 7fee549bb740 1 -- 172.21.15.159:0/2044144844 shutdown_connections 2024-07-24T16:37:08.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.642+0000 7fee549bb740 1 -- 172.21.15.159:0/2044144844 wait complete. 2024-07-24T16:37:08.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.643+0000 7fee549bb740 1 -- start start 2024-07-24T16:37:08.649 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.643+0000 7fee549bb740 1 Processor -- start 2024-07-24T16:37:08.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee549bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38ac93a0 0x55bd38b065a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee549bb740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38b0dcb0 0x55bd38b0d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee549bb740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38add350 0x55bd38add7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee549bb740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55bd3879c620 con 0x55bd38b0dcb0 2024-07-24T16:37:08.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee549bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bd389b1840 con 0x55bd38ac93a0 2024-07-24T16:37:08.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee549bb740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55bd38ac2e10 con 0x55bd38add350 2024-07-24T16:37:08.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee549bb740 10 client.0 _ll_register_callbacks cb 0x55bd38a227a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T16:37:08.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee4affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38b0dcb0 0x55bd38b0d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee4affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38b0dcb0 0x55bd38b0d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47402/0 (socket says 172.21.15.159:47402) 2024-07-24T16:37:08.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee4affd640 1 -- 172.21.15.159:0/375162568 learned_addr learned my addr 172.21.15.159:0/375162568 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:08.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee4bfff640 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38add350 0x55bd38add7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee4b7fe640 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38ac93a0 0x55bd38b065a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee4affd640 1 -- 172.21.15.159:0/375162568 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38add350 msgr2=0x55bd38add7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee4affd640 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38add350 0x55bd38add7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee4affd640 1 -- 172.21.15.159:0/375162568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38ac93a0 msgr2=0x55bd38b065a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee4affd640 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38ac93a0 0x55bd38b065a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee4affd640 1 -- 172.21.15.159:0/375162568 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd3878d850 con 0x55bd38b0dcb0 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee4b7fe640 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38ac93a0 0x55bd38b065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee4affd640 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38b0dcb0 0x55bd38b0d080 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fee40015000 tx=0x7fee40010fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772613566ce89cf7 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee2a7fc640 1 -- 172.21.15.159:0/375162568 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40017030 con 0x55bd38b0dcb0 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee2a7fc640 1 -- 172.21.15.159:0/375162568 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6401+0+0 (secure 0 0 0) 0x7fee40007250 con 0x55bd38b0dcb0 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee549bb740 1 -- 172.21.15.159:0/375162568 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee40003c40 con 0x55bd38b0dcb0 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee2a7fc640 1 -- 172.21.15.159:0/375162568 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fee4002a050 con 0x55bd38b0dcb0 2024-07-24T16:37:08.657 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee549bb740 10 client.5931 fetch_fsmap learned FSMap version 24 2024-07-24T16:37:08.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.644+0000 7fee549bb740 1 -- 172.21.15.159:0/375162568 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55bd388046b0 con 0x55bd38b0dcb0 2024-07-24T16:37:08.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.645+0000 7fee2a7fc640 1 -- 172.21.15.159:0/375162568 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee40003c40 con 0x55bd38b0dcb0 2024-07-24T16:37:08.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.645+0000 7fee2a7fc640 1 -- 172.21.15.159:0/375162568 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7fee4002d020 con 0x55bd38b0dcb0 2024-07-24T16:37:08.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.645+0000 7fee549bb740 10 client.5931 fetch_fsmap finished waiting for FSMap version 24 2024-07-24T16:37:08.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.645+0000 7fee549bb740 10 client.5931 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-24T16:37:08.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.645+0000 7fee549bb740 20 client.5931 populate_metadata read hostname 'smithi159' 2024-07-24T16:37:08.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.645+0000 7fee549bb740 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.159:6833/433186879,v1:172.21.15.159:6835/433186879] conn(0x55bd38b0a4b0 0x55bd38b0a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.645+0000 7fee549bb740 4 client.5931 mds_command: new command op to 5796 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-07-24T16:37:08.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.645+0000 7fee549bb740 1 -- 172.21.15.159:0/375162568 --> [v2:172.21.15.159:6833/433186879,v1:172.21.15.159:6835/433186879] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd38a3c1c0 con 0x55bd38b0a4b0 2024-07-24T16:37:08.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.645+0000 7fee4b7fe640 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.159:6833/433186879,v1:172.21.15.159:6835/433186879] conn(0x55bd38b0a4b0 0x55bd38b0a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.645+0000 7fee4b7fe640 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.159:6833/433186879,v1:172.21.15.159:6835/433186879] conn(0x55bd38b0a4b0 0x55bd38b0a890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=355838aa10801928 server_cookie=b35c8e0835722d21 in_seq=0 out_seq=0 2024-07-24T16:37:08.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.645+0000 7fee2a7fc640 10 client.5931 ms_handle_connect on v2:172.21.15.159:6833/433186879 2024-07-24T16:37:08.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee2a7fc640 1 -- 172.21.15.159:0/375162568 <== mds.0 v2:172.21.15.159:6833/433186879 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bd38a3c1c0 con 0x55bd38b0a4b0 2024-07-24T16:37:08.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee2a7fc640 10 client.5931 handle_command_reply: tid=0 2024-07-24T16:37:08.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee549bb740 1 client.5931 shutdown 2024-07-24T16:37:08.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee549bb740 1 -- 172.21.15.159:0/375162568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38b0dcb0 msgr2=0x55bd38b0d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee549bb740 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38b0dcb0 0x55bd38b0d080 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fee40015000 tx=0x7fee40010fd0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee549bb740 1 -- 172.21.15.159:0/375162568 shutdown_connections 2024-07-24T16:37:08.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee549bb740 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38add350 0x55bd38add7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee549bb740 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.159:6833/433186879,v1:172.21.15.159:6835/433186879] conn(0x55bd38b0a4b0 0x55bd38b0a890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee549bb740 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38b0dcb0 0x55bd38b0d080 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee549bb740 1 --2- 172.21.15.159:0/375162568 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38ac93a0 0x55bd38b065a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee2a7fc640 0 client.5931 ms_handle_reset on v2:172.21.15.159:6833/433186879 2024-07-24T16:37:08.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee549bb740 1 -- 172.21.15.159:0/375162568 >> 172.21.15.159:0/375162568 conn(0x55bd38ac8e20 msgr2=0x55bd38ac2fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:08.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee549bb740 1 -- 172.21.15.159:0/375162568 shutdown_connections 2024-07-24T16:37:08.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee549bb740 1 -- 172.21.15.159:0/375162568 wait complete. 2024-07-24T16:37:08.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.646+0000 7fee549bb740 20 client.5931 trim_cache size 0 max 16384 2024-07-24T16:37:08.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.665+0000 7fee549bb740 1 Processor -- start 2024-07-24T16:37:08.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.665+0000 7fee549bb740 1 -- start start 2024-07-24T16:37:08.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee549bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38ac8e20 0x55bd38b1c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee549bb740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 0x55bd38adca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee549bb740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38add350 0x55bd38adba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee549bb740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c200500 con 0x55bd38ac93a0 2024-07-24T16:37:08.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee549bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fee4c1ff950 con 0x55bd38ac8e20 2024-07-24T16:37:08.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee549bb740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fee4c1ffee0 con 0x55bd38add350 2024-07-24T16:37:08.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee4affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 0x55bd38adca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee4affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 0x55bd38adca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47410/0 (socket says 172.21.15.159:47410) 2024-07-24T16:37:08.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee4affd640 1 -- 172.21.15.159:0/528897047 learned_addr learned my addr 172.21.15.159:0/528897047 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:08.669 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee4affd640 1 -- 172.21.15.159:0/528897047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38add350 msgr2=0x55bd38adba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:37:08.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee4affd640 1 --2- 172.21.15.159:0/528897047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38add350 0x55bd38adba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee4affd640 1 -- 172.21.15.159:0/528897047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38ac8e20 msgr2=0x55bd38b1c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:37:08.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee4affd640 1 --2- 172.21.15.159:0/528897047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38ac8e20 0x55bd38b1c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee4affd640 1 -- 172.21.15.159:0/528897047 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd38b05540 con 0x55bd38ac93a0 2024-07-24T16:37:08.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee4affd640 1 --2- 172.21.15.159:0/528897047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 0x55bd38adca30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fee40003cc0 tx=0x7fee40005490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c659d3114d0d820 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:08.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee30ff9640 1 -- 172.21.15.159:0/528897047 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40033070 con 0x55bd38ac93a0 2024-07-24T16:37:08.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee30ff9640 1 -- 172.21.15.159:0/528897047 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee40020020 con 0x55bd38ac93a0 2024-07-24T16:37:08.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.666+0000 7fee30ff9640 1 -- 172.21.15.159:0/528897047 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40017070 con 0x55bd38ac93a0 2024-07-24T16:37:08.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.667+0000 7fee549bb740 1 -- 172.21.15.159:0/528897047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 msgr2=0x55bd38adca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.667+0000 7fee549bb740 1 --2- 172.21.15.159:0/528897047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 0x55bd38adca30 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fee40003cc0 tx=0x7fee40005490 comp rx=0 tx=0).stop 2024-07-24T16:37:08.675 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.667+0000 7fee549bb740 1 -- 172.21.15.159:0/528897047 shutdown_connections 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.667+0000 7fee549bb740 1 --2- 172.21.15.159:0/528897047 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38add350 0x55bd38adba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.667+0000 7fee549bb740 1 --2- 172.21.15.159:0/528897047 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 0x55bd38adca30 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.667+0000 7fee549bb740 1 --2- 172.21.15.159:0/528897047 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38ac8e20 0x55bd38b1c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.667+0000 7fee549bb740 1 -- 172.21.15.159:0/528897047 >> 172.21.15.159:0/528897047 conn(0x55bd38b0f280 msgr2=0x55bd38ac1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.667+0000 7fee549bb740 1 -- 172.21.15.159:0/528897047 shutdown_connections 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.667+0000 7fee549bb740 1 -- 172.21.15.159:0/528897047 wait complete. 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.667+0000 7fee549bb740 1 -- start start 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.668+0000 7fee549bb740 1 Processor -- start 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.668+0000 7fee549bb740 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38ac8e20 0x55bd38ac7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.668+0000 7fee549bb740 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 0x55bd38b8b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.668+0000 7fee549bb740 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38add350 0x55bd38b09a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.668+0000 7fee549bb740 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x55bd38b05b60 con 0x55bd38ac93a0 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.668+0000 7fee549bb740 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x55bd38add0d0 con 0x55bd38add350 2024-07-24T16:37:08.676 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.668+0000 7fee549bb740 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x55bd38adddb0 con 0x55bd38ac8e20 2024-07-24T16:37:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.668+0000 7fee549bb740 10 client.0 _ll_register_callbacks cb 0x7fee40004e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-07-24T16:37:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.668+0000 7fee4affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 0x55bd38b8b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.668+0000 7fee4affd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 0x55bd38b8b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47426/0 (socket says 172.21.15.159:47426) 2024-07-24T16:37:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.668+0000 7fee4affd640 1 -- 172.21.15.159:0/3830181930 learned_addr learned my addr 172.21.15.159:0/3830181930 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.668+0000 7fee4b7fe640 1 --2- 172.21.15.159:0/3830181930 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38ac8e20 0x55bd38ac7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee4bfff640 1 --2- 172.21.15.159:0/3830181930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38add350 0x55bd38b09a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee4affd640 1 -- 172.21.15.159:0/3830181930 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38ac8e20 msgr2=0x55bd38ac7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:37:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee4affd640 1 --2- 172.21.15.159:0/3830181930 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38ac8e20 0x55bd38ac7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee4affd640 1 -- 172.21.15.159:0/3830181930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38add350 msgr2=0x55bd38b09a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-07-24T16:37:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee4affd640 1 --2- 172.21.15.159:0/3830181930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38add350 0x55bd38b09a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee4affd640 1 -- 172.21.15.159:0/3830181930 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd38b03d10 con 0x55bd38ac93a0 2024-07-24T16:37:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee4affd640 1 --2- 172.21.15.159:0/3830181930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 0x55bd38b8b530 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fee40008fd0 tx=0x7fee400068a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d4bcf61832e44a server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:08.677 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee2a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.159:3300/0 2024-07-24T16:37:08.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee2a7fc640 1 -- 172.21.15.159:0/3830181930 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee40033050 con 0x55bd38ac93a0 2024-07-24T16:37:08.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee2a7fc640 1 -- 172.21.15.159:0/3830181930 <== mon.0 v2:172.21.15.159:3300/0 2 ==== osd_map(63..63 src has 1..63) ==== 6401+0+0 (secure 0 0 0) 0x7fee40038da0 con 0x55bd38ac93a0 2024-07-24T16:37:08.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee549bb740 1 -- 172.21.15.159:0/3830181930 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee40020020 con 0x55bd38ac93a0 2024-07-24T16:37:08.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee2a7fc640 1 -- 172.21.15.159:0/3830181930 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fee4003f050 con 0x55bd38ac93a0 2024-07-24T16:37:08.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee549bb740 10 client.5937 fetch_fsmap learned FSMap version 24 2024-07-24T16:37:08.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee549bb740 1 -- 172.21.15.159:0/3830181930 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x55bd38b09220 con 0x55bd38ac93a0 2024-07-24T16:37:08.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee2a7fc640 1 -- 172.21.15.159:0/3830181930 <== mon.0 v2:172.21.15.159:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee40020020 con 0x55bd38ac93a0 2024-07-24T16:37:08.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee2a7fc640 1 -- 172.21.15.159:0/3830181930 <== mon.0 v2:172.21.15.159:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7fee40042020 con 0x55bd38ac93a0 2024-07-24T16:37:08.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee549bb740 10 client.5937 fetch_fsmap finished waiting for FSMap version 24 2024-07-24T16:37:08.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee549bb740 10 client.5937 resolve_mds: resolved name 'a' to daemon mds.a 2024-07-24T16:37:08.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee549bb740 20 client.5937 populate_metadata read hostname 'smithi159' 2024-07-24T16:37:08.678 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee549bb740 1 --2- 172.21.15.159:0/3830181930 >> [v2:172.21.15.159:6833/433186879,v1:172.21.15.159:6835/433186879] conn(0x55bd38b0dcb0 0x55bd38b1ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee549bb740 4 client.5937 mds_command: new command op to 5796 tid=0 multi_id=0 [{"prefix": "status"}] 2024-07-24T16:37:08.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.669+0000 7fee549bb740 1 -- 172.21.15.159:0/3830181930 --> [v2:172.21.15.159:6833/433186879,v1:172.21.15.159:6835/433186879] -- command(tid 0: {"prefix": "status"}) -- 0x55bd38a37c60 con 0x55bd38b0dcb0 2024-07-24T16:37:08.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee4b7fe640 1 --2- 172.21.15.159:0/3830181930 >> [v2:172.21.15.159:6833/433186879,v1:172.21.15.159:6835/433186879] conn(0x55bd38b0dcb0 0x55bd38b1ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee4b7fe640 1 --2- 172.21.15.159:0/3830181930 >> [v2:172.21.15.159:6833/433186879,v1:172.21.15.159:6835/433186879] conn(0x55bd38b0dcb0 0x55bd38b1ede0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=866a39cf364eca7 server_cookie=fb5b19a2c677a615 in_seq=0 out_seq=0 2024-07-24T16:37:08.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee2a7fc640 10 client.5937 ms_handle_connect on v2:172.21.15.159:6833/433186879 2024-07-24T16:37:08.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee2a7fc640 1 -- 172.21.15.159:0/3830181930 <== mds.0 v2:172.21.15.159:6833/433186879 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55bd38a37c60 con 0x55bd38b0dcb0 2024-07-24T16:37:08.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee2a7fc640 10 client.5937 handle_command_reply: tid=0 2024-07-24T16:37:08.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee549bb740 1 client.5937 shutdown 2024-07-24T16:37:08.679 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee549bb740 1 -- 172.21.15.159:0/3830181930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 msgr2=0x55bd38b8b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee549bb740 1 --2- 172.21.15.159:0/3830181930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 0x55bd38b8b530 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fee40008fd0 tx=0x7fee400068a0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee549bb740 1 -- 172.21.15.159:0/3830181930 shutdown_connections 2024-07-24T16:37:08.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee549bb740 1 --2- 172.21.15.159:0/3830181930 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x55bd38add350 0x55bd38b09a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee549bb740 1 --2- 172.21.15.159:0/3830181930 >> [v2:172.21.15.159:6833/433186879,v1:172.21.15.159:6835/433186879] conn(0x55bd38b0dcb0 0x55bd38b1ede0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee549bb740 1 --2- 172.21.15.159:0/3830181930 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x55bd38ac93a0 0x55bd38b8b530 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee2a7fc640 0 client.5937 ms_handle_reset on v2:172.21.15.159:6833/433186879 2024-07-24T16:37:08.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee549bb740 1 --2- 172.21.15.159:0/3830181930 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x55bd38ac8e20 0x55bd38ac7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee549bb740 1 -- 172.21.15.159:0/3830181930 >> 172.21.15.159:0/3830181930 conn(0x55bd38b0f280 msgr2=0x55bd38b0fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:08.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee549bb740 1 -- 172.21.15.159:0/3830181930 shutdown_connections 2024-07-24T16:37:08.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee549bb740 1 -- 172.21.15.159:0/3830181930 wait complete. 2024-07-24T16:37:08.680 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.670+0000 7fee549bb740 20 client.5937 trim_cache size 0 max 16384 2024-07-24T16:37:08.681 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:37:08.681 INFO:teuthology.orchestra.run.smithi159.stdout: "cluster_fsid": "15e9c2b9-79b9-45cf-833e-5ce98c29c7f6", 2024-07-24T16:37:08.681 INFO:teuthology.orchestra.run.smithi159.stdout: "whoami": 0, 2024-07-24T16:37:08.681 INFO:teuthology.orchestra.run.smithi159.stdout: "id": 5796, 2024-07-24T16:37:08.681 INFO:teuthology.orchestra.run.smithi159.stdout: "want_state": "up:active", 2024-07-24T16:37:08.681 INFO:teuthology.orchestra.run.smithi159.stdout: "state": "up:active", 2024-07-24T16:37:08.681 INFO:teuthology.orchestra.run.smithi159.stdout: "fs_name": "cephfs", 2024-07-24T16:37:08.681 INFO:teuthology.orchestra.run.smithi159.stdout: "rank_uptime": 4.6850372499999997, 2024-07-24T16:37:08.681 INFO:teuthology.orchestra.run.smithi159.stdout: "mdsmap_epoch": 24, 2024-07-24T16:37:08.681 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch": 63, 2024-07-24T16:37:08.681 INFO:teuthology.orchestra.run.smithi159.stdout: "osdmap_epoch_barrier": 63, 2024-07-24T16:37:08.681 INFO:teuthology.orchestra.run.smithi159.stdout: "uptime": 16.425645086999999 2024-07-24T16:37:08.682 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:37:08.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.671+0000 7fee51b8a640 1 -- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fee38077010 msgr2=0x7fee380794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.682 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.671+0000 7fee51b8a640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fee38077010 0x7fee380794d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fee3c035000 tx=0x7fee3c03a040 comp rx=0 tx=0).stop 2024-07-24T16:37:08.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.671+0000 7fee51b8a640 1 -- 172.21.15.159:0/3388516179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee4c0cfb50 msgr2=0x7fee4c150bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.671+0000 7fee51b8a640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee4c0cfb50 0x7fee4c150bc0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fee44005d00 tx=0x7fee4400dae0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.671+0000 7fee51b8a640 1 -- 172.21.15.159:0/3388516179 shutdown_connections 2024-07-24T16:37:08.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.671+0000 7fee51b8a640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fee38077010 0x7fee380794d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.671+0000 7fee51b8a640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fee4c0cfb50 0x7fee4c150bc0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.671+0000 7fee51b8a640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fee4c0cf770 0x7fee4c0adb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.671+0000 7fee51b8a640 1 --2- 172.21.15.159:0/3388516179 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fee4c06dba0 0x7fee4c0b1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.671+0000 7fee51b8a640 1 -- 172.21.15.159:0/3388516179 >> 172.21.15.159:0/3388516179 conn(0x7fee4c06c560 msgr2=0x7fee4c0ceb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:08.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.671+0000 7fee51b8a640 1 -- 172.21.15.159:0/3388516179 shutdown_connections 2024-07-24T16:37:08.683 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.671+0000 7fee51b8a640 1 -- 172.21.15.159:0/3388516179 wait complete. 2024-07-24T16:37:08.684 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-07-24T16:37:08.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.785+0000 7fdb6e841640 1 -- 172.21.15.159:0/1726086283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb680cf770 msgr2=0x7fdb680cfc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.785+0000 7fdb6e841640 1 --2- 172.21.15.159:0/1726086283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb680cf770 0x7fdb680cfc20 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fdb60005fd0 tx=0x7fdb6002ab20 comp rx=0 tx=0).stop 2024-07-24T16:37:08.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.785+0000 7fdb6e841640 1 -- 172.21.15.159:0/1726086283 shutdown_connections 2024-07-24T16:37:08.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.785+0000 7fdb6e841640 1 --2- 172.21.15.159:0/1726086283 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb680cf770 0x7fdb680cfc20 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.785+0000 7fdb6e841640 1 --2- 172.21.15.159:0/1726086283 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb6815d950 0x7fdb68161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.785+0000 7fdb6e841640 1 -- 172.21.15.159:0/1726086283 >> 172.21.15.159:0/1726086283 conn(0x7fdb6809cd30 msgr2=0x7fdb680d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:08.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.785+0000 7fdb6e841640 1 -- 172.21.15.159:0/1726086283 shutdown_connections 2024-07-24T16:37:08.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.785+0000 7fdb6e841640 1 -- 172.21.15.159:0/1726086283 wait complete. 2024-07-24T16:37:08.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.787+0000 7fdb6e841640 1 Processor -- start 2024-07-24T16:37:08.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.787+0000 7fdb6e841640 1 -- start start 2024-07-24T16:37:08.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.787+0000 7fdb6e841640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb680b2ae0 0x7fdb680cd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6e841640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb680cf770 0x7fdb6815fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6e841640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6815d950 0x7fdb681f15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6e841640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdb680d0460 con 0x7fdb6815d950 2024-07-24T16:37:08.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6e841640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdb680d02e0 con 0x7fdb680cf770 2024-07-24T16:37:08.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6e841640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdb680d05e0 con 0x7fdb680b2ae0 2024-07-24T16:37:08.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6cdde640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6815d950 0x7fdb681f15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6cdde640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6815d950 0x7fdb681f15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47434/0 (socket says 172.21.15.159:47434) 2024-07-24T16:37:08.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6cdde640 1 -- 172.21.15.159:0/3679509330 learned_addr learned my addr 172.21.15.159:0/3679509330 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:08.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb67fff640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb680b2ae0 0x7fdb680cd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb677fe640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb680cf770 0x7fdb6815fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6cdde640 1 -- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb680b2ae0 msgr2=0x7fdb680cd510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6cdde640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb680b2ae0 0x7fdb680cd510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6cdde640 1 -- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb680cf770 msgr2=0x7fdb6815fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:08.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6cdde640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb680cf770 0x7fdb6815fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:08.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6cdde640 1 -- 172.21.15.159:0/3679509330 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6815e120 con 0x7fdb6815d950 2024-07-24T16:37:08.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6cdde640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6815d950 0x7fdb681f15c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009bf0 tx=0x7fdb60003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:08.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb64ff9640 1 -- 172.21.15.159:0/3679509330 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60044070 con 0x7fdb6815d950 2024-07-24T16:37:08.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb64ff9640 1 -- 172.21.15.159:0/3679509330 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdb60004250 con 0x7fdb6815d950 2024-07-24T16:37:08.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6e841640 1 -- 172.21.15.159:0/3679509330 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb6815e400 con 0x7fdb6815d950 2024-07-24T16:37:08.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb64ff9640 1 -- 172.21.15.159:0/3679509330 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb60004660 con 0x7fdb6815d950 2024-07-24T16:37:08.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.788+0000 7fdb6e841640 1 -- 172.21.15.159:0/3679509330 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb6815eee0 con 0x7fdb6815d950 2024-07-24T16:37:08.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.789+0000 7fdb6e841640 1 -- 172.21.15.159:0/3679509330 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb6815ea10 con 0x7fdb6815d950 2024-07-24T16:37:08.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.790+0000 7fdb64ff9640 1 -- 172.21.15.159:0/3679509330 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fdb6002c980 con 0x7fdb6815d950 2024-07-24T16:37:08.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.790+0000 7fdb64ff9640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fdb54077010 0x7fdb540794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:08.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.790+0000 7fdb64ff9640 1 -- 172.21.15.159:0/3679509330 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6401+0+0 (secure 0 0 0) 0x7fdb600b91b0 con 0x7fdb6815d950 2024-07-24T16:37:08.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.791+0000 7fdb67fff640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fdb54077010 0x7fdb540794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:08.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.791+0000 7fdb67fff640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fdb54077010 0x7fdb540794d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb58005fd0 tx=0x7fdb5800b2e0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:08.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:08.795+0000 7fdb64ff9640 1 -- 172.21.15.159:0/3679509330 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fdb60032030 con 0x7fdb6815d950 2024-07-24T16:37:08.949 INFO:tasks.ceph.mds.a.smithi159.stderr:2024-07-24T16:37:08.947+0000 7f0ec153b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-07-24T16:37:09.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.019+0000 7fdb6e841640 1 -- 172.21.15.159:0/3679509330 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdb6815dea0 con 0x7fdb6815d950 2024-07-24T16:37:09.021 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.019+0000 7fdb64ff9640 1 -- 172.21.15.159:0/3679509330 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v24) ==== 53+0+73 (secure 0 0 0) 0x7fdb6815dea0 con 0x7fdb6815d950 2024-07-24T16:37:09.022 INFO:teuthology.orchestra.run.smithi159.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-07-24T16:37:09.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.021+0000 7fdb6e841640 1 -- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fdb54077010 msgr2=0x7fdb540794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:09.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.021+0000 7fdb6e841640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fdb54077010 0x7fdb540794d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdb58005fd0 tx=0x7fdb5800b2e0 comp rx=0 tx=0).stop 2024-07-24T16:37:09.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.021+0000 7fdb6e841640 1 -- 172.21.15.159:0/3679509330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6815d950 msgr2=0x7fdb681f15c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:09.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.021+0000 7fdb6e841640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6815d950 0x7fdb681f15c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fdb60009bf0 tx=0x7fdb60003ce0 comp rx=0 tx=0).stop 2024-07-24T16:37:09.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.021+0000 7fdb6e841640 1 -- 172.21.15.159:0/3679509330 shutdown_connections 2024-07-24T16:37:09.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.021+0000 7fdb6e841640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fdb54077010 0x7fdb540794d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:09.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.021+0000 7fdb6e841640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdb6815d950 0x7fdb681f15c0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:09.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.021+0000 7fdb6e841640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdb680cf770 0x7fdb6815fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:09.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.021+0000 7fdb6e841640 1 --2- 172.21.15.159:0/3679509330 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdb680b2ae0 0x7fdb680cd510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:09.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.021+0000 7fdb6e841640 1 -- 172.21.15.159:0/3679509330 >> 172.21.15.159:0/3679509330 conn(0x7fdb6809cd30 msgr2=0x7fdb680b6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:09.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.021+0000 7fdb6e841640 1 -- 172.21.15.159:0/3679509330 shutdown_connections 2024-07-24T16:37:09.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.021+0000 7fdb6e841640 1 -- 172.21.15.159:0/3679509330 wait complete. 2024-07-24T16:37:09.035 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-07-24T16:37:09.035 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-07-24T16:37:09.035 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi159.front.sepia.ceph.com 2024-07-24T16:37:09.035 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-07-24T16:37:09.035 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-07-24T16:37:09.036 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-07-24T16:37:09.036 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-07-24T16:37:09.036 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-07-24T16:37:09.036 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-24T16:37:09.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:37:09.036 DEBUG:teuthology.orchestra.run.smithi159:> ip addr 2024-07-24T16:37:09.052 INFO:teuthology.orchestra.run.smithi159.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-07-24T16:37:09.053 INFO:teuthology.orchestra.run.smithi159.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-07-24T16:37:09.053 INFO:teuthology.orchestra.run.smithi159.stdout: inet 127.0.0.1/8 scope host lo 2024-07-24T16:37:09.053 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:37:09.053 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 ::1/128 scope host 2024-07-24T16:37:09.053 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:37:09.053 INFO:teuthology.orchestra.run.smithi159.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:37:09.053 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c6 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:37:09.053 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f0 2024-07-24T16:37:09.053 INFO:teuthology.orchestra.run.smithi159.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:37:09.053 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:d9:d8:c7 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:37:09.053 INFO:teuthology.orchestra.run.smithi159.stdout: altname enp7s0f1 2024-07-24T16:37:09.054 INFO:teuthology.orchestra.run.smithi159.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-07-24T16:37:09.054 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4e brd ff:ff:ff:ff:ff:ff 2024-07-24T16:37:09.054 INFO:teuthology.orchestra.run.smithi159.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-07-24T16:37:09.054 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 0c:c4:7a:88:72:4f brd ff:ff:ff:ff:ff:ff 2024-07-24T16:37:09.054 INFO:teuthology.orchestra.run.smithi159.stdout: inet 172.21.15.159/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-07-24T16:37:09.054 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft 41991sec preferred_lft 41991sec 2024-07-24T16:37:09.054 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::ec4:7aff:fe88:724f/64 scope link 2024-07-24T16:37:09.054 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:37:09.054 INFO:teuthology.orchestra.run.smithi159.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-07-24T16:37:09.054 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 96:98:2f:87:9c:54 brd ff:ff:ff:ff:ff:ff 2024-07-24T16:37:09.055 INFO:teuthology.orchestra.run.smithi159.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-07-24T16:37:09.055 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:37:09.055 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::d8bc:3bff:fe37:4033/64 scope link 2024-07-24T16:37:09.055 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:37:09.055 INFO:teuthology.orchestra.run.smithi159.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-24T16:37:09.055 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether ba:13:bc:12:98:84 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-24T16:37:09.055 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::b813:bcff:fe12:9884/64 scope link 2024-07-24T16:37:09.055 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:37:09.055 INFO:teuthology.orchestra.run.smithi159.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-07-24T16:37:09.055 INFO:teuthology.orchestra.run.smithi159.stdout: link/ether 96:98:2f:87:9c:54 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-07-24T16:37:09.055 INFO:teuthology.orchestra.run.smithi159.stdout: inet6 fe80::9498:2fff:fe87:9c54/64 scope link 2024-07-24T16:37:09.055 INFO:teuthology.orchestra.run.smithi159.stdout: valid_lft forever preferred_lft forever 2024-07-24T16:37:09.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:37:09.056 DEBUG:teuthology.orchestra.run.smithi159:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-07-24T16:37:09.115 INFO:teuthology.orchestra.run.smithi159.stdout:1 2024-07-24T16:37:09.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:37:09.117 DEBUG:teuthology.orchestra.run.smithi159:> route 2024-07-24T16:37:09.173 INFO:teuthology.orchestra.run.smithi159.stdout:Kernel IP routing table 2024-07-24T16:37:09.173 INFO:teuthology.orchestra.run.smithi159.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-07-24T16:37:09.173 INFO:teuthology.orchestra.run.smithi159.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-07-24T16:37:09.174 INFO:teuthology.orchestra.run.smithi159.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-07-24T16:37:09.174 INFO:teuthology.orchestra.run.smithi159.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-07-24T16:37:09.174 DEBUG:teuthology.orchestra.run.smithi159:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-07-24T16:37:09.174 DEBUG:teuthology.orchestra.run.smithi159:> set -e 2024-07-24T16:37:09.174 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-07-24T16:37:09.174 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-07-24T16:37:09.174 DEBUG:teuthology.orchestra.run.smithi159:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-07-24T16:37:09.174 DEBUG:teuthology.orchestra.run.smithi159:> ') 2024-07-24T16:37:09.262 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-07-24T16:37:09.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:37:09.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:37:09.300 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-07-24T16:37:09.315 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-07-24T16:37:09.315 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-07-24T16:37:09.315 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-07-24T16:37:09.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:37:09.315 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link set brx.0 up 2024-07-24T16:37:09.380 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:37:09.380 DEBUG:teuthology.orchestra.run.smithi159:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-07-24T16:37:09.435 INFO:teuthology.orchestra.run.smithi159.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-07-24T16:37:09.436 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-07-24T16:37:09.436 DEBUG:teuthology.orchestra.run.smithi159:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-07-24T16:37:09.490 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-07-24T16:37:09.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:37:09.491 DEBUG:teuthology.orchestra.run.smithi159:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-07-24T16:37:09.574 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-07-24T16:37:09.574 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-07-24T16:37:09.574 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-07-24T16:37:09.583 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-07-24T16:37:09.583 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-07-24T16:37:09.583 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-07-24T16:37:09.583 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.159:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-07-24T16:37:09.583 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2024-07-24T16:37:09.587 INFO:teuthology.orchestra.run.smithi159.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-07-24T16:37:09.587 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-07-24T16:37:09.587 INFO:teuthology.orchestra.run.smithi159.stdout:invalid new device string format 2024-07-24T16:37:09.587 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.159:3300,172.21.15.193:3300,172.21.15.193:3301" 2024-07-24T16:37:09.587 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: switching to using v1 address with old syntax 2024-07-24T16:37:09.588 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: resolved to: "172.21.15.159:6789,172.21.15.193:6789,172.21.15.193:6790" 2024-07-24T16:37:09.588 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.159:6789,172.21.15.193:6789,172.21.15.193:6790:/ 2024-07-24T16:37:09.588 INFO:teuthology.orchestra.run.smithi159.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=15e9c2b9-79b9-45cf-833e-5ce98c29c7f6" will pass to kernel 2024-07-24T16:37:09.588 INFO:teuthology.orchestra.run.smithi159.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-07-24T16:37:09.588 INFO:teuthology.orchestra.run.smithi159.stdout: You just mounted a file system that supports labels which does not 2024-07-24T16:37:09.588 INFO:teuthology.orchestra.run.smithi159.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-07-24T16:37:09.588 INFO:teuthology.orchestra.run.smithi159.stdout: applications will generate AVC messages and not be allowed access to 2024-07-24T16:37:09.588 INFO:teuthology.orchestra.run.smithi159.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-07-24T16:37:09.590 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-07-24T16:37:09.590 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:37:09.590 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-07-24T16:37:09.656 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-07-24T16:37:09.747 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-07-24T16:37:09.751 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-07-24T16:37:09.757 INFO:teuthology.orchestra.run.smithi159.stdout:client5946 2024-07-24T16:37:09.758 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:37:09.758 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:37:09.774 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-07-24T16:37:09.918 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.916+0000 7f40041aa640 1 -- 172.21.15.159:0/560738570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ffc157130 msgr2=0x7f3ffc0cf500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:09.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.916+0000 7f40041aa640 1 --2- 172.21.15.159:0/560738570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ffc157130 0x7f3ffc0cf500 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009830 tx=0x7f3ff802a530 comp rx=0 tx=0).stop 2024-07-24T16:37:09.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.916+0000 7f40041aa640 1 -- 172.21.15.159:0/560738570 shutdown_connections 2024-07-24T16:37:09.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.916+0000 7f40041aa640 1 --2- 172.21.15.159:0/560738570 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ffc157130 0x7f3ffc0cf500 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:09.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.916+0000 7f40041aa640 1 -- 172.21.15.159:0/560738570 >> 172.21.15.159:0/560738570 conn(0x7f3ffc06c560 msgr2=0x7f3ffc06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:37:09.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.916+0000 7f40041aa640 1 -- 172.21.15.159:0/560738570 shutdown_connections 2024-07-24T16:37:09.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.916+0000 7f40041aa640 1 -- 172.21.15.159:0/560738570 wait complete. 2024-07-24T16:37:09.919 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.917+0000 7f40041aa640 1 Processor -- start 2024-07-24T16:37:09.920 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.917+0000 7f40041aa640 1 -- start start 2024-07-24T16:37:09.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f40041aa640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ffc06e360 0x7f3ffc1f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:09.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f40041aa640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ffc157130 0x7f3ffc13c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:09.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f40041aa640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ffc157510 0x7f3ffc0ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:09.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f40041aa640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc0cfbc0 con 0x7f3ffc06e360 2024-07-24T16:37:09.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f40041aa640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3ffc0cfa40 con 0x7f3ffc157510 2024-07-24T16:37:09.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f40041aa640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3ffc0cfd40 con 0x7f3ffc157130 2024-07-24T16:37:09.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f4001f46640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ffc06e360 0x7f3ffc1f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:09.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f4001f46640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ffc06e360 0x7f3ffc1f4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:47454/0 (socket says 172.21.15.159:47454) 2024-07-24T16:37:09.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f4001f46640 1 -- 172.21.15.159:0/587460663 learned_addr learned my addr 172.21.15.159:0/587460663 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:37:09.922 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f4001745640 1 --2- 172.21.15.159:0/587460663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ffc157130 0x7f3ffc13c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f4002747640 1 --2- 172.21.15.159:0/587460663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ffc157510 0x7f3ffc0ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f4001f46640 1 -- 172.21.15.159:0/587460663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ffc157130 msgr2=0x7f3ffc13c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f4001f46640 1 --2- 172.21.15.159:0/587460663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ffc157130 0x7f3ffc13c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f4001f46640 1 -- 172.21.15.159:0/587460663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ffc157510 msgr2=0x7f3ffc0ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:37:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f4001f46640 1 --2- 172.21.15.159:0/587460663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ffc157510 0x7f3ffc0ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:37:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f4001f46640 1 -- 172.21.15.159:0/587460663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ffc0cf100 con 0x7f3ffc06e360 2024-07-24T16:37:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f4002747640 1 --2- 172.21.15.159:0/587460663 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3ffc157510 0x7f3ffc0ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:37:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f4001745640 1 --2- 172.21.15.159:0/587460663 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3ffc157130 0x7f3ffc13c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:37:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f4001f46640 1 --2- 172.21.15.159:0/587460663 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3ffc06e360 0x7f3ffc1f4600 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f3ff802ab20 tx=0x7f3ff8032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f3ff27fc640 1 -- 172.21.15.159:0/587460663 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8040070 con 0x7f3ffc06e360 2024-07-24T16:37:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f3ff27fc640 1 -- 172.21.15.159:0/587460663 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ff8003af0 con 0x7f3ffc06e360 2024-07-24T16:37:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f40041aa640 1 -- 172.21.15.159:0/587460663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ffc0b0300 con 0x7f3ffc06e360 2024-07-24T16:37:09.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f3ff27fc640 1 -- 172.21.15.159:0/587460663 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8045460 con 0x7f3ffc06e360 2024-07-24T16:37:09.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.918+0000 7f40041aa640 1 -- 172.21.15.159:0/587460663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ffc0b08c0 con 0x7f3ffc06e360 2024-07-24T16:37:09.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.919+0000 7f40041aa640 1 -- 172.21.15.159:0/587460663 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ffc156920 con 0x7f3ffc06e360 2024-07-24T16:37:09.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.920+0000 7f3ff27fc640 1 -- 172.21.15.159:0/587460663 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f3ff8039040 con 0x7f3ffc06e360 2024-07-24T16:37:09.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.921+0000 7f3ff27fc640 1 --2- 172.21.15.159:0/587460663 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3fe0077010 0x7f3fe00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:37:09.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.921+0000 7f3ff27fc640 1 -- 172.21.15.159:0/587460663 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6401+0+0 (secure 0 0 0) 0x7f3ff80ba1c0 con 0x7f3ffc06e360 2024-07-24T16:37:09.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.921+0000 7f4001745640 1 --2- 172.21.15.159:0/587460663 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3fe0077010 0x7f3fe00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:37:09.925 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.921+0000 7f4001745640 1 --2- 172.21.15.159:0/587460663 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3fe0077010 0x7f3fe00794d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3ffc0cc0c0 tx=0x7f3fec009040 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:37:09.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:09.925+0000 7f3ff27fc640 1 -- 172.21.15.159:0/587460663 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f3ffc156920 con 0x7f3ffc06e360 2024-07-24T16:37:10.135 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:37:10.132+0000 7f40041aa640 1 -- 172.21.15.159:0/587460663 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f3ffc0b2730 con 0x7f3fe0077010 2024-07-24T16:37:13.437 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:37:13.440 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:37:43.572 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:37:43.576 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:38:13.682 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:38:13.685 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:38:43.850 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:38:43.853 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:39:09.845 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-07-24T16:39:09.848 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots ... ERROR 2024-07-24T16:39:09.849 INFO:tasks.cephfs_test_runner: 2024-07-24T16:39:09.849 INFO:tasks.cephfs_test_runner:====================================================================== 2024-07-24T16:39:09.849 INFO:tasks.cephfs_test_runner:ERROR: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-07-24T16:39:09.849 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots 2024-07-24T16:39:09.849 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-07-24T16:39:09.849 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-07-24T16:39:09.849 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/cephfs/test_snap_schedules.py", line 103, in setUp 2024-07-24T16:39:09.849 INFO:tasks.cephfs_test_runner: self._create_or_reuse_test_volume() 2024-07-24T16:39:09.849 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/cephfs/test_snap_schedules.py", line 79, in _create_or_reuse_test_volume 2024-07-24T16:39:09.849 INFO:tasks.cephfs_test_runner: result = json.loads(self._fs_cmd("volume", "ls")) 2024-07-24T16:39:09.849 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/cephfs/test_snap_schedules.py", line 63, in _fs_cmd 2024-07-24T16:39:09.849 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/ceph_manager.py", line 1652, in run_cluster_cmd 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_a8aed60fc62d4ff39d2216b360f018eba7518cfe/teuthology/orchestra/remote.py", line 523, in run 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_a8aed60fc62d4ff39d2216b360f018eba7518cfe/teuthology/orchestra/run.py", line 455, in run 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: r.wait() 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_a8aed60fc62d4ff39d2216b360f018eba7518cfe/teuthology/orchestra/run.py", line 161, in wait 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_a8aed60fc62d4ff39d2216b360f018eba7518cfe/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi159 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls' 2024-07-24T16:39:09.850 INFO:tasks.cephfs_test_runner: 2024-07-24T16:39:09.851 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-07-24T16:39:09.851 INFO:tasks.cephfs_test_runner:Ran 2 tests in 871.206s 2024-07-24T16:39:09.851 INFO:tasks.cephfs_test_runner: 2024-07-24T16:39:09.851 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2024-07-24T16:39:09.851 INFO:tasks.cephfs_test_runner: 2024-07-24T16:39:09.851 INFO:tasks.cephfs_test_runner:====================================================================== 2024-07-24T16:39:09.851 INFO:tasks.cephfs_test_runner:ERROR: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-07-24T16:39:09.851 INFO:tasks.cephfs_test_runner:Test exisitence of multiple scheduled snapshots 2024-07-24T16:39:09.851 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-07-24T16:39:09.851 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-07-24T16:39:09.851 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/cephfs/test_snap_schedules.py", line 103, in setUp 2024-07-24T16:39:09.851 INFO:tasks.cephfs_test_runner: self._create_or_reuse_test_volume() 2024-07-24T16:39:09.851 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/cephfs/test_snap_schedules.py", line 79, in _create_or_reuse_test_volume 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: result = json.loads(self._fs_cmd("volume", "ls")) 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/cephfs/test_snap_schedules.py", line 63, in _fs_cmd 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: return self.get_ceph_cmd_stdout("fs", *args) 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/ceph_test_case.py", line 55, in get_ceph_cmd_stdout 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: return self.run_ceph_cmd(**kwargs).stdout.getvalue() 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/ceph_test_case.py", line 30, in run_ceph_cmd 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: return self.mon_manager.run_cluster_cmd(**kwargs) 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/ceph_manager.py", line 1652, in run_cluster_cmd 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_a8aed60fc62d4ff39d2216b360f018eba7518cfe/teuthology/orchestra/remote.py", line 523, in run 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_a8aed60fc62d4ff39d2216b360f018eba7518cfe/teuthology/orchestra/run.py", line 455, in run 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: r.wait() 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_a8aed60fc62d4ff39d2216b360f018eba7518cfe/teuthology/orchestra/run.py", line 161, in wait 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_a8aed60fc62d4ff39d2216b360f018eba7518cfe/teuthology/orchestra/run.py", line 181, in _raise_for_status 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi159 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls' 2024-07-24T16:39:09.852 INFO:tasks.cephfs_test_runner: 2024-07-24T16:39:09.853 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a8aed60fc62d4ff39d2216b360f018eba7518cfe/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-07-24T16:39:10.060 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=27afbc85fe54497999c51cae5f9efdfc Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_a8aed60fc62d4ff39d2216b360f018eba7518cfe/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.10/contextlib.py", line 135, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_0325fd3c11a225c0fd9eb38fab88aad1370ad779/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules) 2024-07-24T16:39:10.062 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-07-24T16:39:10.070 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-07-24T16:39:10.178 INFO:tasks.kclient:Unmounting kernel clients... 2024-07-24T16:39:10.178 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:39:10.178 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:39:10.200 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:39:10.200 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:39:10.259 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-07-24T16:39:10.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.409+0000 7fc20c126640 1 -- 172.21.15.159:0/2959426988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2040b0c40 msgr2=0x7fc20415fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:10.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.409+0000 7fc20c126640 1 --2- 172.21.15.159:0/2959426988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2040b0c40 0x7fc20415fa20 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7fc2040d06d0 tx=0x7fc1f402aa30 comp rx=0 tx=0).stop 2024-07-24T16:39:10.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.409+0000 7fc20c126640 1 -- 172.21.15.159:0/2959426988 shutdown_connections 2024-07-24T16:39:10.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.409+0000 7fc20c126640 1 --2- 172.21.15.159:0/2959426988 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc204073c10 0x7fc204074080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:10.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.409+0000 7fc20c126640 1 --2- 172.21.15.159:0/2959426988 >> v2:172.21.15.193:3300/0 conn(0x7fc20415ba20 0x7fc2040cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:10.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.409+0000 7fc20c126640 1 --2- 172.21.15.159:0/2959426988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc2040b0c40 0x7fc20415fa20 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:10.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.409+0000 7fc20c126640 1 -- 172.21.15.159:0/2959426988 >> 172.21.15.159:0/2959426988 conn(0x7fc20406fd50 msgr2=0x7fc204070130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:10.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.409+0000 7fc20c126640 1 -- 172.21.15.159:0/2959426988 shutdown_connections 2024-07-24T16:39:10.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.409+0000 7fc20c126640 1 -- 172.21.15.159:0/2959426988 wait complete. 2024-07-24T16:39:10.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.411+0000 7fc20c126640 1 Processor -- start 2024-07-24T16:39:10.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.411+0000 7fc20c126640 1 -- start start 2024-07-24T16:39:10.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.411+0000 7fc20c126640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc204073c10 0x7fc2041f1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:10.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.411+0000 7fc20c126640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2040b0c40 0x7fc2041f5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:10.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.411+0000 7fc20c126640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc20415ba20 0x7fc2040b1ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:10.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.411+0000 7fc20c126640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc2040d15d0 con 0x7fc204073c10 2024-07-24T16:39:10.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.411+0000 7fc20c126640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc2040cf880 con 0x7fc2040b0c40 2024-07-24T16:39:10.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.411+0000 7fc20c126640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc2040d1750 con 0x7fc20415ba20 2024-07-24T16:39:10.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc209ec2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc204073c10 0x7fc2041f1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:10.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc209ec2640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc204073c10 0x7fc2041f1ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:52954/0 (socket says 172.21.15.159:52954) 2024-07-24T16:39:10.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc209ec2640 1 -- 172.21.15.159:0/1054799896 learned_addr learned my addr 172.21.15.159:0/1054799896 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:10.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc2096c1640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2040b0c40 0x7fc2041f5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:10.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc20a6c3640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc20415ba20 0x7fc2040b1ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:10.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc209ec2640 1 -- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc20415ba20 msgr2=0x7fc2040b1ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:10.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc209ec2640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc20415ba20 0x7fc2040b1ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:10.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc209ec2640 1 -- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2040b0c40 msgr2=0x7fc2041f5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:10.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc209ec2640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2040b0c40 0x7fc2041f5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:10.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc209ec2640 1 -- 172.21.15.159:0/1054799896 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2041f24f0 con 0x7fc204073c10 2024-07-24T16:39:10.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc2096c1640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2040b0c40 0x7fc2041f5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:39:10.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc209ec2640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc204073c10 0x7fc2041f1ec0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4009bf0 tx=0x7fc1f4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:10.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc2027fc640 1 -- 172.21.15.159:0/1054799896 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4047070 con 0x7fc204073c10 2024-07-24T16:39:10.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc2027fc640 1 -- 172.21.15.159:0/1054799896 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1f4004250 con 0x7fc204073c10 2024-07-24T16:39:10.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc20c126640 1 -- 172.21.15.159:0/1054799896 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2041f27d0 con 0x7fc204073c10 2024-07-24T16:39:10.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc2027fc640 1 -- 172.21.15.159:0/1054799896 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1f4033050 con 0x7fc204073c10 2024-07-24T16:39:10.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.412+0000 7fc20c126640 1 -- 172.21.15.159:0/1054799896 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc204157140 con 0x7fc204073c10 2024-07-24T16:39:10.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.413+0000 7fc20c126640 1 -- 172.21.15.159:0/1054799896 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc20415fa20 con 0x7fc204073c10 2024-07-24T16:39:10.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.414+0000 7fc2027fc640 1 -- 172.21.15.159:0/1054799896 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fc1f404a070 con 0x7fc204073c10 2024-07-24T16:39:10.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.414+0000 7fc2027fc640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fc1f0077010 0x7fc1f00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:10.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.414+0000 7fc2027fc640 1 -- 172.21.15.159:0/1054799896 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7fc1f40b9f20 con 0x7fc204073c10 2024-07-24T16:39:10.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.414+0000 7fc2096c1640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fc1f0077010 0x7fc1f00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:10.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.415+0000 7fc2096c1640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fc1f0077010 0x7fc1f00794d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8005fd0 tx=0x7fc1f8005e20 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:10.421 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.419+0000 7fc2027fc640 1 -- 172.21.15.159:0/1054799896 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fc1f4082ec0 con 0x7fc204073c10 2024-07-24T16:39:10.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.613+0000 7fc20c126640 1 -- 172.21.15.159:0/1054799896 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc2040d0380 con 0x7fc204073c10 2024-07-24T16:39:10.616 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.614+0000 7fc2027fc640 1 -- 172.21.15.159:0/1054799896 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v65) ==== 80+0+0 (secure 0 0 0) 0x7fc1f40827c0 con 0x7fc204073c10 2024-07-24T16:39:10.616 INFO:teuthology.orchestra.run.smithi159.stderr:listed 0 entries 2024-07-24T16:39:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.616+0000 7fc20c126640 1 -- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fc1f0077010 msgr2=0x7fc1f00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.616+0000 7fc20c126640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fc1f0077010 0x7fc1f00794d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc1f8005fd0 tx=0x7fc1f8005e20 comp rx=0 tx=0).stop 2024-07-24T16:39:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.616+0000 7fc20c126640 1 -- 172.21.15.159:0/1054799896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc204073c10 msgr2=0x7fc2041f1ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.616+0000 7fc20c126640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc204073c10 0x7fc2041f1ec0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc1f4009bf0 tx=0x7fc1f4003f10 comp rx=0 tx=0).stop 2024-07-24T16:39:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.616+0000 7fc20c126640 1 -- 172.21.15.159:0/1054799896 shutdown_connections 2024-07-24T16:39:10.619 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.616+0000 7fc20c126640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc20415ba20 0x7fc2040b1ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:10.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.616+0000 7fc20c126640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc2040b0c40 0x7fc2041f5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:10.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.616+0000 7fc20c126640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fc1f0077010 0x7fc1f00794d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:10.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.616+0000 7fc20c126640 1 --2- 172.21.15.159:0/1054799896 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc204073c10 0x7fc2041f1ec0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:10.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.616+0000 7fc20c126640 1 -- 172.21.15.159:0/1054799896 >> 172.21.15.159:0/1054799896 conn(0x7fc20406fd50 msgr2=0x7fc2040cfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:10.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.616+0000 7fc20c126640 1 -- 172.21.15.159:0/1054799896 shutdown_connections 2024-07-24T16:39:10.620 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:10.616+0000 7fc20c126640 1 -- 172.21.15.159:0/1054799896 wait complete. 2024-07-24T16:39:10.629 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-07-24T16:39:10.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:10.630 DEBUG:teuthology.orchestra.run.smithi159:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-07-24T16:39:10.658 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:39:10.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:10.658 DEBUG:teuthology.orchestra.run.smithi159:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-07-24T16:39:10.714 DEBUG:teuthology.orchestra.run.smithi159:> set -ex 2024-07-24T16:39:10.714 DEBUG:teuthology.orchestra.run.smithi159:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:39:10.770 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056071,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20922 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248736k,nr_inodes=812184,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-07-24T16:39:10.771 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:39:10.771 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:39:10.789 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056073,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497484k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=448 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248740k,nr_inodes=812185,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497484k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-24T16:39:10.789 DEBUG:teuthology.orchestra.run.smithi193:> set -ex 2024-07-24T16:39:10.790 DEBUG:teuthology.orchestra.run.smithi193:> dd if=/proc/self/mounts of=/dev/stdout 2024-07-24T16:39:10.847 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056073,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497484k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=448 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248740k,nr_inodes=812185,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497484k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-07-24T16:39:10.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:10.847 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-07-24T16:39:10.863 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-07-24T16:39:10.863 INFO:teuthology.orchestra.run.smithi159.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-07-24T16:39:10.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:10.864 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-07-24T16:39:10.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:10.929 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-07-24T16:39:10.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:10.995 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2024-07-24T16:39:11.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:11.087 DEBUG:teuthology.orchestra.run.smithi159:> ip netns list 2024-07-24T16:39:11.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:11.103 DEBUG:teuthology.orchestra.run.smithi159:> sudo ip link delete ceph-brx 2024-07-24T16:39:11.171 INFO:teuthology.orchestra.run.smithi159.stderr:Cannot find device "ceph-brx" 2024-07-24T16:39:11.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T16:39:11.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:11.172 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-07-24T16:39:11.192 INFO:teuthology.orchestra.run.smithi193.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-07-24T16:39:11.192 INFO:teuthology.orchestra.run.smithi193.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-07-24T16:39:11.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:11.193 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-07-24T16:39:11.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:11.262 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-07-24T16:39:11.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:11.330 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link delete ceph-brx 2024-07-24T16:39:11.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:11.430 DEBUG:teuthology.orchestra.run.smithi193:> ip netns list 2024-07-24T16:39:11.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-07-24T16:39:11.446 DEBUG:teuthology.orchestra.run.smithi193:> sudo ip link delete ceph-brx 2024-07-24T16:39:11.515 INFO:teuthology.orchestra.run.smithi193.stderr:Cannot find device "ceph-brx" 2024-07-24T16:39:11.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T16:39:11.517 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-07-24T16:39:11.527 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-07-24T16:39:11.527 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:39:11.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.631+0000 7f4c585ed640 1 -- 172.21.15.159:0/3381025502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c3c0053a0 msgr2=0x7f4c3c00b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:11.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.631+0000 7f4c585ed640 1 --2- 172.21.15.159:0/3381025502 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c3c0053a0 0x7f4c3c00b9e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4c4800a8d0 tx=0x7f4c3c005830 comp rx=0 tx=0).stop 2024-07-24T16:39:11.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.631+0000 7f4c56b8a640 1 -- 172.21.15.159:0/3381025502 reap_dead start 2024-07-24T16:39:11.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.631+0000 7f4c585ed640 1 -- 172.21.15.159:0/3381025502 shutdown_connections 2024-07-24T16:39:11.634 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.631+0000 7f4c585ed640 1 -- 172.21.15.159:0/3381025502 >> 172.21.15.159:0/3381025502 conn(0x7f4c5006c560 msgr2=0x7f4c5006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:11.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.631+0000 7f4c585ed640 1 -- 172.21.15.159:0/3381025502 shutdown_connections 2024-07-24T16:39:11.635 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.631+0000 7f4c585ed640 1 -- 172.21.15.159:0/3381025502 wait complete. 2024-07-24T16:39:11.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.632+0000 7f4c585ed640 1 Processor -- start 2024-07-24T16:39:11.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.632+0000 7f4c585ed640 1 -- start start 2024-07-24T16:39:11.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c585ed640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c3c0053a0 0x7f4c500ae260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:11.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c585ed640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c50140620 0x7f4c500ac4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:11.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c585ed640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c5013e5d0 0x7f4c5013ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:11.637 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c585ed640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4c500cf4b0 con 0x7f4c50140620 2024-07-24T16:39:11.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c585ed640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4c500b4620 con 0x7f4c3c0053a0 2024-07-24T16:39:11.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c585ed640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4c500cf630 con 0x7f4c5013e5d0 2024-07-24T16:39:11.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c55b88640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c50140620 0x7f4c500ac4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:11.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c55b88640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c50140620 0x7f4c500ac4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49736/0 (socket says 172.21.15.159:49736) 2024-07-24T16:39:11.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c55b88640 1 -- 172.21.15.159:0/3695969883 learned_addr learned my addr 172.21.15.159:0/3695969883 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:11.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c55b88640 1 -- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c5013e5d0 msgr2=0x7f4c5013ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:11.638 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c56b8a640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c5013e5d0 0x7f4c5013ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:11.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c56389640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c3c0053a0 0x7f4c500ae260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:11.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c55b88640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c5013e5d0 0x7f4c5013ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:11.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c55b88640 1 -- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c3c0053a0 msgr2=0x7f4c500ae260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:11.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c55b88640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c3c0053a0 0x7f4c500ae260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:11.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c55b88640 1 -- 172.21.15.159:0/3695969883 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c50142530 con 0x7f4c50140620 2024-07-24T16:39:11.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c55b88640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c50140620 0x7f4c500ac4e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4c40006680 tx=0x7f4c400066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:11.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.633+0000 7f4c46ffd640 1 -- 172.21.15.159:0/3695969883 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40015070 con 0x7f4c50140620 2024-07-24T16:39:11.639 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.634+0000 7f4c46ffd640 1 -- 172.21.15.159:0/3695969883 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c40011900 con 0x7f4c50140620 2024-07-24T16:39:11.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.634+0000 7f4c585ed640 1 -- 172.21.15.159:0/3695969883 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c50142810 con 0x7f4c50140620 2024-07-24T16:39:11.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.634+0000 7f4c46ffd640 1 -- 172.21.15.159:0/3695969883 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c40011d10 con 0x7f4c50140620 2024-07-24T16:39:11.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.634+0000 7f4c585ed640 1 -- 172.21.15.159:0/3695969883 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c5013f930 con 0x7f4c50140620 2024-07-24T16:39:11.640 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.634+0000 7f4c585ed640 1 -- 172.21.15.159:0/3695969883 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c500b3850 con 0x7f4c50140620 2024-07-24T16:39:11.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.635+0000 7f4c46ffd640 1 -- 172.21.15.159:0/3695969883 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f4c40018070 con 0x7f4c50140620 2024-07-24T16:39:11.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.635+0000 7f4c46ffd640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4c34077010 0x7f4c340794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:11.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.636+0000 7f4c46ffd640 1 -- 172.21.15.159:0/3695969883 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f4c400998a0 con 0x7f4c50140620 2024-07-24T16:39:11.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.636+0000 7f4c56389640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4c34077010 0x7f4c340794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:11.641 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.636+0000 7f4c56389640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4c34077010 0x7f4c340794d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4c5014ab10 tx=0x7f4c4c006ef0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:11.642 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.640+0000 7f4c46ffd640 1 -- 172.21.15.159:0/3695969883 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f4c400628d0 con 0x7f4c50140620 2024-07-24T16:39:11.823 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.820+0000 7f4c585ed640 1 -- 172.21.15.159:0/3695969883 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4c500cebc0 con 0x7f4c34077010 2024-07-24T16:39:11.827 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.825+0000 7f4c46ffd640 1 -- 172.21.15.159:0/3695969883 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251831 (secure 0 0 0) 0x7f4c500cebc0 con 0x7f4c34077010 2024-07-24T16:39:11.830 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:39:11.831 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:39:11.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.828+0000 7f4c585ed640 1 -- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4c34077010 msgr2=0x7f4c340794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:11.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.828+0000 7f4c585ed640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4c34077010 0x7f4c340794d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4c5014ab10 tx=0x7f4c4c006ef0 comp rx=0 tx=0).stop 2024-07-24T16:39:11.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.828+0000 7f4c585ed640 1 -- 172.21.15.159:0/3695969883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c50140620 msgr2=0x7f4c500ac4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:11.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.828+0000 7f4c585ed640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c50140620 0x7f4c500ac4e0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f4c40006680 tx=0x7f4c400066b0 comp rx=0 tx=0).stop 2024-07-24T16:39:11.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.828+0000 7f4c585ed640 1 -- 172.21.15.159:0/3695969883 shutdown_connections 2024-07-24T16:39:11.833 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.828+0000 7f4c585ed640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4c5013e5d0 0x7f4c5013ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:11.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.828+0000 7f4c585ed640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4c34077010 0x7f4c340794d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:11.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.828+0000 7f4c585ed640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4c50140620 0x7f4c500ac4e0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:11.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.828+0000 7f4c585ed640 1 --2- 172.21.15.159:0/3695969883 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4c3c0053a0 0x7f4c500ae260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:11.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.828+0000 7f4c585ed640 1 -- 172.21.15.159:0/3695969883 >> 172.21.15.159:0/3695969883 conn(0x7f4c5006c560 msgr2=0x7f4c500b1380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:11.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.828+0000 7f4c585ed640 1 -- 172.21.15.159:0/3695969883 shutdown_connections 2024-07-24T16:39:11.834 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.828+0000 7f4c585ed640 1 -- 172.21.15.159:0/3695969883 wait complete. 2024-07-24T16:39:11.841 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-07-24T16:39:10.574496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594021,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":174,"num_write_kb":1645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319224,"kb_used_data":7304,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754655496,"statfs":{"total":773094113280,"available":772767227904,"internally_reserved":0,"allocated":7479296,"data_stored":4285698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002297"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668281+0000","last_change":"2024-07-24T16:37:04.000283+0000","last_active":"2024-07-24T16:37:45.668281+0000","last_peered":"2024-07-24T16:37:45.668281+0000","last_clean":"2024-07-24T16:37:45.668281+0000","last_became_active":"2024-07-24T16:37:04.000007+0000","last_became_peered":"2024-07-24T16:37:04.000007+0000","last_unstale":"2024-07-24T16:37:45.668281+0000","last_undegraded":"2024-07-24T16:37:45.668281+0000","last_fullsized":"2024-07-24T16:37:45.668281+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:22:29.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075097+0000","last_change":"2024-07-24T16:37:04.011891+0000","last_active":"2024-07-24T16:37:46.075097+0000","last_peered":"2024-07-24T16:37:46.075097+0000","last_clean":"2024-07-24T16:37:46.075097+0000","last_became_active":"2024-07-24T16:37:04.011627+0000","last_became_peered":"2024-07-24T16:37:04.011627+0000","last_unstale":"2024-07-24T16:37:46.075097+0000","last_undegraded":"2024-07-24T16:37:46.075097+0000","last_fullsized":"2024-07-24T16:37:46.075097+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:06.176465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667446+0000","last_change":"2024-07-24T16:37:04.014901+0000","last_active":"2024-07-24T16:37:45.667446+0000","last_peered":"2024-07-24T16:37:45.667446+0000","last_clean":"2024-07-24T16:37:45.667446+0000","last_became_active":"2024-07-24T16:37:04.014649+0000","last_became_peered":"2024-07-24T16:37:04.014649+0000","last_unstale":"2024-07-24T16:37:45.667446+0000","last_undegraded":"2024-07-24T16:37:45.667446+0000","last_fullsized":"2024-07-24T16:37:45.667446+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:31:41.870538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075295+0000","last_change":"2024-07-24T16:37:04.011677+0000","last_active":"2024-07-24T16:37:46.075295+0000","last_peered":"2024-07-24T16:37:46.075295+0000","last_clean":"2024-07-24T16:37:46.075295+0000","last_became_active":"2024-07-24T16:37:04.011002+0000","last_became_peered":"2024-07-24T16:37:04.011002+0000","last_unstale":"2024-07-24T16:37:46.075295+0000","last_undegraded":"2024-07-24T16:37:46.075295+0000","last_fullsized":"2024-07-24T16:37:46.075295+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:36.298799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075070+0000","last_change":"2024-07-24T16:37:04.005188+0000","last_active":"2024-07-24T16:37:46.075070+0000","last_peered":"2024-07-24T16:37:46.075070+0000","last_clean":"2024-07-24T16:37:46.075070+0000","last_became_active":"2024-07-24T16:37:04.004895+0000","last_became_peered":"2024-07-24T16:37:04.004895+0000","last_unstale":"2024-07-24T16:37:46.075070+0000","last_undegraded":"2024-07-24T16:37:46.075070+0000","last_fullsized":"2024-07-24T16:37:46.075070+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:22:29.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668314+0000","last_change":"2024-07-24T16:37:04.009148+0000","last_active":"2024-07-24T16:37:45.668314+0000","last_peered":"2024-07-24T16:37:45.668314+0000","last_clean":"2024-07-24T16:37:45.668314+0000","last_became_active":"2024-07-24T16:37:04.008866+0000","last_became_peered":"2024-07-24T16:37:04.008866+0000","last_unstale":"2024-07-24T16:37:45.668314+0000","last_undegraded":"2024-07-24T16:37:45.668314+0000","last_fullsized":"2024-07-24T16:37:45.668314+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:08:08.449053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666777+0000","last_change":"2024-07-24T16:37:04.020944+0000","last_active":"2024-07-24T16:37:45.666777+0000","last_peered":"2024-07-24T16:37:45.666777+0000","last_clean":"2024-07-24T16:37:45.666777+0000","last_became_active":"2024-07-24T16:37:04.019103+0000","last_became_peered":"2024-07-24T16:37:04.019103+0000","last_unstale":"2024-07-24T16:37:45.666777+0000","last_undegraded":"2024-07-24T16:37:45.666777+0000","last_fullsized":"2024-07-24T16:37:45.666777+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:27:17.770264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":23,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.671500+0000","last_change":"2024-07-24T16:37:45.671415+0000","last_active":"2024-07-24T16:37:45.671500+0000","last_peered":"2024-07-24T16:37:45.671500+0000","last_clean":"2024-07-24T16:37:45.671500+0000","last_became_active":"2024-07-24T16:37:45.671060+0000","last_became_peered":"2024-07-24T16:37:45.671060+0000","last_unstale":"2024-07-24T16:37:45.671500+0000","last_undegraded":"2024-07-24T16:37:45.671500+0000","last_fullsized":"2024-07-24T16:37:45.671500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:54:47.659029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669317+0000","last_change":"2024-07-24T16:37:04.024211+0000","last_active":"2024-07-24T16:37:45.669317+0000","last_peered":"2024-07-24T16:37:45.669317+0000","last_clean":"2024-07-24T16:37:45.669317+0000","last_became_active":"2024-07-24T16:37:04.023933+0000","last_became_peered":"2024-07-24T16:37:04.023933+0000","last_unstale":"2024-07-24T16:37:45.669317+0000","last_undegraded":"2024-07-24T16:37:45.669317+0000","last_fullsized":"2024-07-24T16:37:45.669317+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:08:35.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668130+0000","last_change":"2024-07-24T16:37:03.998622+0000","last_active":"2024-07-24T16:37:45.668130+0000","last_peered":"2024-07-24T16:37:45.668130+0000","last_clean":"2024-07-24T16:37:45.668130+0000","last_became_active":"2024-07-24T16:37:03.997985+0000","last_became_peered":"2024-07-24T16:37:03.997985+0000","last_unstale":"2024-07-24T16:37:45.668130+0000","last_undegraded":"2024-07-24T16:37:45.668130+0000","last_fullsized":"2024-07-24T16:37:45.668130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:08:12.604308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074662+0000","last_change":"2024-07-24T16:37:04.008205+0000","last_active":"2024-07-24T16:37:46.074662+0000","last_peered":"2024-07-24T16:37:46.074662+0000","last_clean":"2024-07-24T16:37:46.074662+0000","last_became_active":"2024-07-24T16:37:04.006298+0000","last_became_peered":"2024-07-24T16:37:04.006298+0000","last_unstale":"2024-07-24T16:37:46.074662+0000","last_undegraded":"2024-07-24T16:37:46.074662+0000","last_fullsized":"2024-07-24T16:37:46.074662+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:51:24.513752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669526+0000","last_change":"2024-07-24T16:37:04.006667+0000","last_active":"2024-07-24T16:37:45.669526+0000","last_peered":"2024-07-24T16:37:45.669526+0000","last_clean":"2024-07-24T16:37:45.669526+0000","last_became_active":"2024-07-24T16:37:04.005908+0000","last_became_peered":"2024-07-24T16:37:04.005908+0000","last_unstale":"2024-07-24T16:37:45.669526+0000","last_undegraded":"2024-07-24T16:37:45.669526+0000","last_fullsized":"2024-07-24T16:37:45.669526+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:17.192204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668121+0000","last_change":"2024-07-24T16:37:04.002494+0000","last_active":"2024-07-24T16:37:45.668121+0000","last_peered":"2024-07-24T16:37:45.668121+0000","last_clean":"2024-07-24T16:37:45.668121+0000","last_became_active":"2024-07-24T16:37:04.001872+0000","last_became_peered":"2024-07-24T16:37:04.001872+0000","last_unstale":"2024-07-24T16:37:45.668121+0000","last_undegraded":"2024-07-24T16:37:45.668121+0000","last_fullsized":"2024-07-24T16:37:45.668121+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:44.694240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667052+0000","last_change":"2024-07-24T16:37:04.018574+0000","last_active":"2024-07-24T16:37:45.667052+0000","last_peered":"2024-07-24T16:37:45.667052+0000","last_clean":"2024-07-24T16:37:45.667052+0000","last_became_active":"2024-07-24T16:37:04.018314+0000","last_became_peered":"2024-07-24T16:37:04.018314+0000","last_unstale":"2024-07-24T16:37:45.667052+0000","last_undegraded":"2024-07-24T16:37:45.667052+0000","last_fullsized":"2024-07-24T16:37:45.667052+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:11:02.137962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074761+0000","last_change":"2024-07-24T16:37:04.009736+0000","last_active":"2024-07-24T16:37:46.074761+0000","last_peered":"2024-07-24T16:37:46.074761+0000","last_clean":"2024-07-24T16:37:46.074761+0000","last_became_active":"2024-07-24T16:37:04.009473+0000","last_became_peered":"2024-07-24T16:37:04.009473+0000","last_unstale":"2024-07-24T16:37:46.074761+0000","last_undegraded":"2024-07-24T16:37:46.074761+0000","last_fullsized":"2024-07-24T16:37:46.074761+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:05:05.128427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668018+0000","last_change":"2024-07-24T16:37:04.001780+0000","last_active":"2024-07-24T16:37:45.668018+0000","last_peered":"2024-07-24T16:37:45.668018+0000","last_clean":"2024-07-24T16:37:45.668018+0000","last_became_active":"2024-07-24T16:37:04.001535+0000","last_became_peered":"2024-07-24T16:37:04.001535+0000","last_unstale":"2024-07-24T16:37:45.668018+0000","last_undegraded":"2024-07-24T16:37:45.668018+0000","last_fullsized":"2024-07-24T16:37:45.668018+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:00:08.654329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668814+0000","last_change":"2024-07-24T16:37:45.668749+0000","last_active":"2024-07-24T16:37:45.668814+0000","last_peered":"2024-07-24T16:37:45.668814+0000","last_clean":"2024-07-24T16:37:45.668814+0000","last_became_active":"2024-07-24T16:37:45.668460+0000","last_became_peered":"2024-07-24T16:37:45.668460+0000","last_unstale":"2024-07-24T16:37:45.668814+0000","last_undegraded":"2024-07-24T16:37:45.668814+0000","last_fullsized":"2024-07-24T16:37:45.668814+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:08:12.604308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075161+0000","last_change":"2024-07-24T16:37:04.011422+0000","last_active":"2024-07-24T16:37:46.075161+0000","last_peered":"2024-07-24T16:37:46.075161+0000","last_clean":"2024-07-24T16:37:46.075161+0000","last_became_active":"2024-07-24T16:37:04.011166+0000","last_became_peered":"2024-07-24T16:37:04.011166+0000","last_unstale":"2024-07-24T16:37:46.075161+0000","last_undegraded":"2024-07-24T16:37:46.075161+0000","last_fullsized":"2024-07-24T16:37:46.075161+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:34.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667421+0000","last_change":"2024-07-24T16:37:04.008292+0000","last_active":"2024-07-24T16:37:45.667421+0000","last_peered":"2024-07-24T16:37:45.667421+0000","last_clean":"2024-07-24T16:37:45.667421+0000","last_became_active":"2024-07-24T16:37:04.008030+0000","last_became_peered":"2024-07-24T16:37:04.008030+0000","last_unstale":"2024-07-24T16:37:45.667421+0000","last_undegraded":"2024-07-24T16:37:45.667421+0000","last_fullsized":"2024-07-24T16:37:45.667421+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:32:43.315454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667556+0000","last_change":"2024-07-24T16:37:04.007961+0000","last_active":"2024-07-24T16:37:45.667556+0000","last_peered":"2024-07-24T16:37:45.667556+0000","last_clean":"2024-07-24T16:37:45.667556+0000","last_became_active":"2024-07-24T16:37:04.007154+0000","last_became_peered":"2024-07-24T16:37:04.007154+0000","last_unstale":"2024-07-24T16:37:45.667556+0000","last_undegraded":"2024-07-24T16:37:45.667556+0000","last_fullsized":"2024-07-24T16:37:45.667556+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:45.075854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667469+0000","last_change":"2024-07-24T16:37:04.007037+0000","last_active":"2024-07-24T16:37:45.667469+0000","last_peered":"2024-07-24T16:37:45.667469+0000","last_clean":"2024-07-24T16:37:45.667469+0000","last_became_active":"2024-07-24T16:37:04.006749+0000","last_became_peered":"2024-07-24T16:37:04.006749+0000","last_unstale":"2024-07-24T16:37:45.667469+0000","last_undegraded":"2024-07-24T16:37:45.667469+0000","last_fullsized":"2024-07-24T16:37:45.667469+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:20.158902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668852+0000","last_change":"2024-07-24T16:37:04.020205+0000","last_active":"2024-07-24T16:37:45.668852+0000","last_peered":"2024-07-24T16:37:45.668852+0000","last_clean":"2024-07-24T16:37:45.668852+0000","last_became_active":"2024-07-24T16:37:04.019931+0000","last_became_peered":"2024-07-24T16:37:04.019931+0000","last_unstale":"2024-07-24T16:37:45.668852+0000","last_undegraded":"2024-07-24T16:37:45.668852+0000","last_fullsized":"2024-07-24T16:37:45.668852+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:38:56.986337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074402+0000","last_change":"2024-07-24T16:37:04.003751+0000","last_active":"2024-07-24T16:37:46.074402+0000","last_peered":"2024-07-24T16:37:46.074402+0000","last_clean":"2024-07-24T16:37:46.074402+0000","last_became_active":"2024-07-24T16:37:04.003501+0000","last_became_peered":"2024-07-24T16:37:04.003501+0000","last_unstale":"2024-07-24T16:37:46.074402+0000","last_undegraded":"2024-07-24T16:37:46.074402+0000","last_fullsized":"2024-07-24T16:37:46.074402+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:47:41.761372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666694+0000","last_change":"2024-07-24T16:37:04.023076+0000","last_active":"2024-07-24T16:37:45.666694+0000","last_peered":"2024-07-24T16:37:45.666694+0000","last_clean":"2024-07-24T16:37:45.666694+0000","last_became_active":"2024-07-24T16:37:04.021397+0000","last_became_peered":"2024-07-24T16:37:04.021397+0000","last_unstale":"2024-07-24T16:37:45.666694+0000","last_undegraded":"2024-07-24T16:37:45.666694+0000","last_fullsized":"2024-07-24T16:37:45.666694+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:15:36.295295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667842+0000","last_change":"2024-07-24T16:37:04.021808+0000","last_active":"2024-07-24T16:37:45.667842+0000","last_peered":"2024-07-24T16:37:45.667842+0000","last_clean":"2024-07-24T16:37:45.667842+0000","last_became_active":"2024-07-24T16:37:04.021195+0000","last_became_peered":"2024-07-24T16:37:04.021195+0000","last_unstale":"2024-07-24T16:37:45.667842+0000","last_undegraded":"2024-07-24T16:37:45.667842+0000","last_fullsized":"2024-07-24T16:37:45.667842+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:09:05.945632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669107+0000","last_change":"2024-07-24T16:37:04.005510+0000","last_active":"2024-07-24T16:37:45.669107+0000","last_peered":"2024-07-24T16:37:45.669107+0000","last_clean":"2024-07-24T16:37:45.669107+0000","last_became_active":"2024-07-24T16:37:04.004807+0000","last_became_peered":"2024-07-24T16:37:04.004807+0000","last_unstale":"2024-07-24T16:37:45.669107+0000","last_undegraded":"2024-07-24T16:37:45.669107+0000","last_fullsized":"2024-07-24T16:37:45.669107+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:02:47.950208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668424+0000","last_change":"2024-07-24T16:37:04.016153+0000","last_active":"2024-07-24T16:37:45.668424+0000","last_peered":"2024-07-24T16:37:45.668424+0000","last_clean":"2024-07-24T16:37:45.668424+0000","last_became_active":"2024-07-24T16:37:04.015860+0000","last_became_peered":"2024-07-24T16:37:04.015860+0000","last_unstale":"2024-07-24T16:37:45.668424+0000","last_undegraded":"2024-07-24T16:37:45.668424+0000","last_fullsized":"2024-07-24T16:37:45.668424+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:37.931655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667580+0000","last_change":"2024-07-24T16:37:04.006057+0000","last_active":"2024-07-24T16:37:45.667580+0000","last_peered":"2024-07-24T16:37:45.667580+0000","last_clean":"2024-07-24T16:37:45.667580+0000","last_became_active":"2024-07-24T16:37:04.005597+0000","last_became_peered":"2024-07-24T16:37:04.005597+0000","last_unstale":"2024-07-24T16:37:45.667580+0000","last_undegraded":"2024-07-24T16:37:45.667580+0000","last_fullsized":"2024-07-24T16:37:45.667580+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:24.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667174+0000","last_change":"2024-07-24T16:37:04.015925+0000","last_active":"2024-07-24T16:37:45.667174+0000","last_peered":"2024-07-24T16:37:45.667174+0000","last_clean":"2024-07-24T16:37:45.667174+0000","last_became_active":"2024-07-24T16:37:04.015678+0000","last_became_peered":"2024-07-24T16:37:04.015678+0000","last_unstale":"2024-07-24T16:37:45.667174+0000","last_undegraded":"2024-07-24T16:37:45.667174+0000","last_fullsized":"2024-07-24T16:37:45.667174+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:40:11.250834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075009+0000","last_change":"2024-07-24T16:37:04.014588+0000","last_active":"2024-07-24T16:37:46.075009+0000","last_peered":"2024-07-24T16:37:46.075009+0000","last_clean":"2024-07-24T16:37:46.075009+0000","last_became_active":"2024-07-24T16:37:04.014310+0000","last_became_peered":"2024-07-24T16:37:04.014310+0000","last_unstale":"2024-07-24T16:37:46.075009+0000","last_undegraded":"2024-07-24T16:37:46.075009+0000","last_fullsized":"2024-07-24T16:37:46.075009+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:58:11.471962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666927+0000","last_change":"2024-07-24T16:37:04.007655+0000","last_active":"2024-07-24T16:37:45.666927+0000","last_peered":"2024-07-24T16:37:45.666927+0000","last_clean":"2024-07-24T16:37:45.666927+0000","last_became_active":"2024-07-24T16:37:04.007367+0000","last_became_peered":"2024-07-24T16:37:04.007367+0000","last_unstale":"2024-07-24T16:37:45.666927+0000","last_undegraded":"2024-07-24T16:37:45.666927+0000","last_fullsized":"2024-07-24T16:37:45.666927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:51:44.948803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665643+0000","last_change":"2024-07-24T16:37:04.011681+0000","last_active":"2024-07-24T16:37:45.665643+0000","last_peered":"2024-07-24T16:37:45.665643+0000","last_clean":"2024-07-24T16:37:45.665643+0000","last_became_active":"2024-07-24T16:37:04.011439+0000","last_became_peered":"2024-07-24T16:37:04.011439+0000","last_unstale":"2024-07-24T16:37:45.665643+0000","last_undegraded":"2024-07-24T16:37:45.665643+0000","last_fullsized":"2024-07-24T16:37:45.665643+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:06.176465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074554+0000","last_change":"2024-07-24T16:37:04.008494+0000","last_active":"2024-07-24T16:37:46.074554+0000","last_peered":"2024-07-24T16:37:46.074554+0000","last_clean":"2024-07-24T16:37:46.074554+0000","last_became_active":"2024-07-24T16:37:04.008128+0000","last_became_peered":"2024-07-24T16:37:04.008128+0000","last_unstale":"2024-07-24T16:37:46.074554+0000","last_undegraded":"2024-07-24T16:37:46.074554+0000","last_fullsized":"2024-07-24T16:37:46.074554+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:30:30.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"62'4","reported_seq":24,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667797+0000","last_change":"2024-07-24T16:37:03.003544+0000","last_active":"2024-07-24T16:37:45.667797+0000","last_peered":"2024-07-24T16:37:45.667797+0000","last_clean":"2024-07-24T16:37:45.667797+0000","last_became_active":"2024-07-24T16:37:03.003212+0000","last_became_peered":"2024-07-24T16:37:03.003212+0000","last_unstale":"2024-07-24T16:37:45.667797+0000","last_undegraded":"2024-07-24T16:37:45.667797+0000","last_fullsized":"2024-07-24T16:37:45.667797+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:10.767177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665478+0000","last_change":"2024-07-24T16:37:04.007097+0000","last_active":"2024-07-24T16:37:45.665478+0000","last_peered":"2024-07-24T16:37:45.665478+0000","last_clean":"2024-07-24T16:37:45.665478+0000","last_became_active":"2024-07-24T16:37:04.006833+0000","last_became_peered":"2024-07-24T16:37:04.006833+0000","last_unstale":"2024-07-24T16:37:45.665478+0000","last_undegraded":"2024-07-24T16:37:45.665478+0000","last_fullsized":"2024-07-24T16:37:45.665478+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:30:23.341481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"62'1","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668538+0000","last_change":"2024-07-24T16:37:03.008723+0000","last_active":"2024-07-24T16:37:45.668538+0000","last_peered":"2024-07-24T16:37:45.668538+0000","last_clean":"2024-07-24T16:37:45.668538+0000","last_became_active":"2024-07-24T16:37:03.008450+0000","last_became_peered":"2024-07-24T16:37:03.008450+0000","last_unstale":"2024-07-24T16:37:45.668538+0000","last_undegraded":"2024-07-24T16:37:45.668538+0000","last_fullsized":"2024-07-24T16:37:45.668538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:00:20.422519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667472+0000","last_change":"2024-07-24T16:37:04.009602+0000","last_active":"2024-07-24T16:37:45.667472+0000","last_peered":"2024-07-24T16:37:45.667472+0000","last_clean":"2024-07-24T16:37:45.667472+0000","last_became_active":"2024-07-24T16:37:04.009341+0000","last_became_peered":"2024-07-24T16:37:04.009341+0000","last_unstale":"2024-07-24T16:37:45.667472+0000","last_undegraded":"2024-07-24T16:37:45.667472+0000","last_fullsized":"2024-07-24T16:37:45.667472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:40.906131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668459+0000","last_change":"2024-07-24T16:37:02.999430+0000","last_active":"2024-07-24T16:37:45.668459+0000","last_peered":"2024-07-24T16:37:45.668459+0000","last_clean":"2024-07-24T16:37:45.668459+0000","last_became_active":"2024-07-24T16:37:02.999177+0000","last_became_peered":"2024-07-24T16:37:02.999177+0000","last_unstale":"2024-07-24T16:37:45.668459+0000","last_undegraded":"2024-07-24T16:37:45.668459+0000","last_fullsized":"2024-07-24T16:37:45.668459+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:14:39.765664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668584+0000","last_change":"2024-07-24T16:37:04.005041+0000","last_active":"2024-07-24T16:37:45.668584+0000","last_peered":"2024-07-24T16:37:45.668584+0000","last_clean":"2024-07-24T16:37:45.668584+0000","last_became_active":"2024-07-24T16:37:04.004752+0000","last_became_peered":"2024-07-24T16:37:04.004752+0000","last_unstale":"2024-07-24T16:37:45.668584+0000","last_undegraded":"2024-07-24T16:37:45.668584+0000","last_fullsized":"2024-07-24T16:37:45.668584+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:28:48.788361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665668+0000","last_change":"2024-07-24T16:37:03.013833+0000","last_active":"2024-07-24T16:37:45.665668+0000","last_peered":"2024-07-24T16:37:45.665668+0000","last_clean":"2024-07-24T16:37:45.665668+0000","last_became_active":"2024-07-24T16:37:03.013501+0000","last_became_peered":"2024-07-24T16:37:03.013501+0000","last_unstale":"2024-07-24T16:37:45.665668+0000","last_undegraded":"2024-07-24T16:37:45.665668+0000","last_fullsized":"2024-07-24T16:37:45.665668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:55.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075387+0000","last_change":"2024-07-24T16:37:04.008541+0000","last_active":"2024-07-24T16:37:46.075387+0000","last_peered":"2024-07-24T16:37:46.075387+0000","last_clean":"2024-07-24T16:37:46.075387+0000","last_became_active":"2024-07-24T16:37:04.008251+0000","last_became_peered":"2024-07-24T16:37:04.008251+0000","last_unstale":"2024-07-24T16:37:46.075387+0000","last_undegraded":"2024-07-24T16:37:46.075387+0000","last_fullsized":"2024-07-24T16:37:46.075387+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:23:03.807268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667230+0000","last_change":"2024-07-24T16:37:03.000053+0000","last_active":"2024-07-24T16:37:45.667230+0000","last_peered":"2024-07-24T16:37:45.667230+0000","last_clean":"2024-07-24T16:37:45.667230+0000","last_became_active":"2024-07-24T16:37:02.999733+0000","last_became_peered":"2024-07-24T16:37:02.999733+0000","last_unstale":"2024-07-24T16:37:45.667230+0000","last_undegraded":"2024-07-24T16:37:45.667230+0000","last_fullsized":"2024-07-24T16:37:45.667230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:43:16.732334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075007+0000","last_change":"2024-07-24T16:37:04.008622+0000","last_active":"2024-07-24T16:37:46.075007+0000","last_peered":"2024-07-24T16:37:46.075007+0000","last_clean":"2024-07-24T16:37:46.075007+0000","last_became_active":"2024-07-24T16:37:04.008293+0000","last_became_peered":"2024-07-24T16:37:04.008293+0000","last_unstale":"2024-07-24T16:37:46.075007+0000","last_undegraded":"2024-07-24T16:37:46.075007+0000","last_fullsized":"2024-07-24T16:37:46.075007+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:45:10.486075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074858+0000","last_change":"2024-07-24T16:37:03.005837+0000","last_active":"2024-07-24T16:37:46.074858+0000","last_peered":"2024-07-24T16:37:46.074858+0000","last_clean":"2024-07-24T16:37:46.074858+0000","last_became_active":"2024-07-24T16:37:03.005494+0000","last_became_peered":"2024-07-24T16:37:03.005494+0000","last_unstale":"2024-07-24T16:37:46.074858+0000","last_undegraded":"2024-07-24T16:37:46.074858+0000","last_fullsized":"2024-07-24T16:37:46.074858+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:19.152923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669257+0000","last_change":"2024-07-24T16:37:04.001679+0000","last_active":"2024-07-24T16:37:45.669257+0000","last_peered":"2024-07-24T16:37:45.669257+0000","last_clean":"2024-07-24T16:37:45.669257+0000","last_became_active":"2024-07-24T16:37:04.001396+0000","last_became_peered":"2024-07-24T16:37:04.001396+0000","last_unstale":"2024-07-24T16:37:45.669257+0000","last_undegraded":"2024-07-24T16:37:45.669257+0000","last_fullsized":"2024-07-24T16:37:45.669257+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:48.147517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667397+0000","last_change":"2024-07-24T16:37:03.003994+0000","last_active":"2024-07-24T16:37:45.667397+0000","last_peered":"2024-07-24T16:37:45.667397+0000","last_clean":"2024-07-24T16:37:45.667397+0000","last_became_active":"2024-07-24T16:37:03.003689+0000","last_became_peered":"2024-07-24T16:37:03.003689+0000","last_unstale":"2024-07-24T16:37:45.667397+0000","last_undegraded":"2024-07-24T16:37:45.667397+0000","last_fullsized":"2024-07-24T16:37:45.667397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:17:37.057978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074994+0000","last_change":"2024-07-24T16:37:04.024282+0000","last_active":"2024-07-24T16:37:46.074994+0000","last_peered":"2024-07-24T16:37:46.074994+0000","last_clean":"2024-07-24T16:37:46.074994+0000","last_became_active":"2024-07-24T16:37:04.024040+0000","last_became_peered":"2024-07-24T16:37:04.024040+0000","last_unstale":"2024-07-24T16:37:46.074994+0000","last_undegraded":"2024-07-24T16:37:46.074994+0000","last_fullsized":"2024-07-24T16:37:46.074994+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:55.570490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666848+0000","last_change":"2024-07-24T16:37:02.999879+0000","last_active":"2024-07-24T16:37:45.666848+0000","last_peered":"2024-07-24T16:37:45.666848+0000","last_clean":"2024-07-24T16:37:45.666848+0000","last_became_active":"2024-07-24T16:37:02.999554+0000","last_became_peered":"2024-07-24T16:37:02.999554+0000","last_unstale":"2024-07-24T16:37:45.666848+0000","last_undegraded":"2024-07-24T16:37:45.666848+0000","last_fullsized":"2024-07-24T16:37:45.666848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:10:25.228026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074597+0000","last_change":"2024-07-24T16:37:04.012481+0000","last_active":"2024-07-24T16:37:46.074597+0000","last_peered":"2024-07-24T16:37:46.074597+0000","last_clean":"2024-07-24T16:37:46.074597+0000","last_became_active":"2024-07-24T16:37:04.012217+0000","last_became_peered":"2024-07-24T16:37:04.012217+0000","last_unstale":"2024-07-24T16:37:46.074597+0000","last_undegraded":"2024-07-24T16:37:46.074597+0000","last_fullsized":"2024-07-24T16:37:46.074597+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:10:47.439606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075111+0000","last_change":"2024-07-24T16:37:03.005534+0000","last_active":"2024-07-24T16:37:46.075111+0000","last_peered":"2024-07-24T16:37:46.075111+0000","last_clean":"2024-07-24T16:37:46.075111+0000","last_became_active":"2024-07-24T16:37:03.005232+0000","last_became_peered":"2024-07-24T16:37:03.005232+0000","last_unstale":"2024-07-24T16:37:46.075111+0000","last_undegraded":"2024-07-24T16:37:46.075111+0000","last_fullsized":"2024-07-24T16:37:46.075111+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:18:00.748831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665427+0000","last_change":"2024-07-24T16:37:03.995253+0000","last_active":"2024-07-24T16:37:45.665427+0000","last_peered":"2024-07-24T16:37:45.665427+0000","last_clean":"2024-07-24T16:37:45.665427+0000","last_became_active":"2024-07-24T16:37:03.994904+0000","last_became_peered":"2024-07-24T16:37:03.994904+0000","last_unstale":"2024-07-24T16:37:45.665427+0000","last_undegraded":"2024-07-24T16:37:45.665427+0000","last_fullsized":"2024-07-24T16:37:45.665427+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:55.570490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075316+0000","last_change":"2024-07-24T16:37:03.004109+0000","last_active":"2024-07-24T16:37:46.075316+0000","last_peered":"2024-07-24T16:37:46.075316+0000","last_clean":"2024-07-24T16:37:46.075316+0000","last_became_active":"2024-07-24T16:37:03.003813+0000","last_became_peered":"2024-07-24T16:37:03.003813+0000","last_unstale":"2024-07-24T16:37:46.075316+0000","last_undegraded":"2024-07-24T16:37:46.075316+0000","last_fullsized":"2024-07-24T16:37:46.075316+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:44.069876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667153+0000","last_change":"2024-07-24T16:37:04.015827+0000","last_active":"2024-07-24T16:37:45.667153+0000","last_peered":"2024-07-24T16:37:45.667153+0000","last_clean":"2024-07-24T16:37:45.667153+0000","last_became_active":"2024-07-24T16:37:04.015577+0000","last_became_peered":"2024-07-24T16:37:04.015577+0000","last_unstale":"2024-07-24T16:37:45.667153+0000","last_undegraded":"2024-07-24T16:37:45.667153+0000","last_fullsized":"2024-07-24T16:37:45.667153+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:38:58.077671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"62'3","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075330+0000","last_change":"2024-07-24T16:37:03.002358+0000","last_active":"2024-07-24T16:37:46.075330+0000","last_peered":"2024-07-24T16:37:46.075330+0000","last_clean":"2024-07-24T16:37:46.075330+0000","last_became_active":"2024-07-24T16:37:03.001970+0000","last_became_peered":"2024-07-24T16:37:03.001970+0000","last_unstale":"2024-07-24T16:37:46.075330+0000","last_undegraded":"2024-07-24T16:37:46.075330+0000","last_fullsized":"2024-07-24T16:37:46.075330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:18:18.548923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075114+0000","last_change":"2024-07-24T16:37:03.996498+0000","last_active":"2024-07-24T16:37:46.075114+0000","last_peered":"2024-07-24T16:37:46.075114+0000","last_clean":"2024-07-24T16:37:46.075114+0000","last_became_active":"2024-07-24T16:37:03.996235+0000","last_became_peered":"2024-07-24T16:37:03.996235+0000","last_unstale":"2024-07-24T16:37:46.075114+0000","last_undegraded":"2024-07-24T16:37:46.075114+0000","last_fullsized":"2024-07-24T16:37:46.075114+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:50:22.080512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"63'8","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669496+0000","last_change":"2024-07-24T16:37:03.008087+0000","last_active":"2024-07-24T16:37:45.669496+0000","last_peered":"2024-07-24T16:37:45.669496+0000","last_clean":"2024-07-24T16:37:45.669496+0000","last_became_active":"2024-07-24T16:37:03.007813+0000","last_became_peered":"2024-07-24T16:37:03.007813+0000","last_unstale":"2024-07-24T16:37:45.669496+0000","last_undegraded":"2024-07-24T16:37:45.669496+0000","last_fullsized":"2024-07-24T16:37:45.669496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:45:09.480096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2855,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665800+0000","last_change":"2024-07-24T16:37:04.007864+0000","last_active":"2024-07-24T16:37:45.665800+0000","last_peered":"2024-07-24T16:37:45.665800+0000","last_clean":"2024-07-24T16:37:45.665800+0000","last_became_active":"2024-07-24T16:37:04.007559+0000","last_became_peered":"2024-07-24T16:37:04.007559+0000","last_unstale":"2024-07-24T16:37:45.665800+0000","last_undegraded":"2024-07-24T16:37:45.665800+0000","last_fullsized":"2024-07-24T16:37:45.665800+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:40:36.400835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667273+0000","last_change":"2024-07-24T16:37:03.003657+0000","last_active":"2024-07-24T16:37:45.667273+0000","last_peered":"2024-07-24T16:37:45.667273+0000","last_clean":"2024-07-24T16:37:45.667273+0000","last_became_active":"2024-07-24T16:37:03.003386+0000","last_became_peered":"2024-07-24T16:37:03.003386+0000","last_unstale":"2024-07-24T16:37:45.667273+0000","last_undegraded":"2024-07-24T16:37:45.667273+0000","last_fullsized":"2024-07-24T16:37:45.667273+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:08:09.502445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667518+0000","last_change":"2024-07-24T16:37:04.019133+0000","last_active":"2024-07-24T16:37:45.667518+0000","last_peered":"2024-07-24T16:37:45.667518+0000","last_clean":"2024-07-24T16:37:45.667518+0000","last_became_active":"2024-07-24T16:37:04.018826+0000","last_became_peered":"2024-07-24T16:37:04.018826+0000","last_unstale":"2024-07-24T16:37:45.667518+0000","last_undegraded":"2024-07-24T16:37:45.667518+0000","last_fullsized":"2024-07-24T16:37:45.667518+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:56.542664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667503+0000","last_change":"2024-07-24T16:37:03.003836+0000","last_active":"2024-07-24T16:37:45.667503+0000","last_peered":"2024-07-24T16:37:45.667503+0000","last_clean":"2024-07-24T16:37:45.667503+0000","last_became_active":"2024-07-24T16:37:03.003542+0000","last_became_peered":"2024-07-24T16:37:03.003542+0000","last_unstale":"2024-07-24T16:37:45.667503+0000","last_undegraded":"2024-07-24T16:37:45.667503+0000","last_fullsized":"2024-07-24T16:37:45.667503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:40:08.258903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669476+0000","last_change":"2024-07-24T16:37:04.011095+0000","last_active":"2024-07-24T16:37:45.669476+0000","last_peered":"2024-07-24T16:37:45.669476+0000","last_clean":"2024-07-24T16:37:45.669476+0000","last_became_active":"2024-07-24T16:37:04.010791+0000","last_became_peered":"2024-07-24T16:37:04.010791+0000","last_unstale":"2024-07-24T16:37:45.669476+0000","last_undegraded":"2024-07-24T16:37:45.669476+0000","last_fullsized":"2024-07-24T16:37:45.669476+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:53:23.625615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074790+0000","last_change":"2024-07-24T16:37:03.010829+0000","last_active":"2024-07-24T16:37:46.074790+0000","last_peered":"2024-07-24T16:37:46.074790+0000","last_clean":"2024-07-24T16:37:46.074790+0000","last_became_active":"2024-07-24T16:37:03.010566+0000","last_became_peered":"2024-07-24T16:37:03.010566+0000","last_unstale":"2024-07-24T16:37:46.074790+0000","last_undegraded":"2024-07-24T16:37:46.074790+0000","last_fullsized":"2024-07-24T16:37:46.074790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:58:26.392478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667702+0000","last_change":"2024-07-24T16:37:04.023416+0000","last_active":"2024-07-24T16:37:45.667702+0000","last_peered":"2024-07-24T16:37:45.667702+0000","last_clean":"2024-07-24T16:37:45.667702+0000","last_became_active":"2024-07-24T16:37:04.020968+0000","last_became_peered":"2024-07-24T16:37:04.020968+0000","last_unstale":"2024-07-24T16:37:45.667702+0000","last_undegraded":"2024-07-24T16:37:45.667702+0000","last_fullsized":"2024-07-24T16:37:45.667702+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:51:49.010336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"62'8","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668973+0000","last_change":"2024-07-24T16:37:03.006180+0000","last_active":"2024-07-24T16:37:45.668973+0000","last_peered":"2024-07-24T16:37:45.668973+0000","last_clean":"2024-07-24T16:37:45.668973+0000","last_became_active":"2024-07-24T16:37:03.005719+0000","last_became_peered":"2024-07-24T16:37:03.005719+0000","last_unstale":"2024-07-24T16:37:45.668973+0000","last_undegraded":"2024-07-24T16:37:45.668973+0000","last_fullsized":"2024-07-24T16:37:45.668973+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:05.170486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669046+0000","last_change":"2024-07-24T16:37:04.005089+0000","last_active":"2024-07-24T16:37:45.669046+0000","last_peered":"2024-07-24T16:37:45.669046+0000","last_clean":"2024-07-24T16:37:45.669046+0000","last_became_active":"2024-07-24T16:37:04.004750+0000","last_became_peered":"2024-07-24T16:37:04.004750+0000","last_unstale":"2024-07-24T16:37:45.669046+0000","last_undegraded":"2024-07-24T16:37:45.669046+0000","last_fullsized":"2024-07-24T16:37:45.669046+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:34:37.325695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667924+0000","last_change":"2024-07-24T16:37:03.013805+0000","last_active":"2024-07-24T16:37:45.667924+0000","last_peered":"2024-07-24T16:37:45.667924+0000","last_clean":"2024-07-24T16:37:45.667924+0000","last_became_active":"2024-07-24T16:37:03.013485+0000","last_became_peered":"2024-07-24T16:37:03.013485+0000","last_unstale":"2024-07-24T16:37:45.667924+0000","last_undegraded":"2024-07-24T16:37:45.667924+0000","last_fullsized":"2024-07-24T16:37:45.667924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:45:47.297991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668160+0000","last_change":"2024-07-24T16:37:04.019820+0000","last_active":"2024-07-24T16:37:45.668160+0000","last_peered":"2024-07-24T16:37:45.668160+0000","last_clean":"2024-07-24T16:37:45.668160+0000","last_became_active":"2024-07-24T16:37:04.019539+0000","last_became_peered":"2024-07-24T16:37:04.019539+0000","last_unstale":"2024-07-24T16:37:45.668160+0000","last_undegraded":"2024-07-24T16:37:45.668160+0000","last_fullsized":"2024-07-24T16:37:45.668160+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:50:22.080512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074705+0000","last_change":"2024-07-24T16:37:02.998295+0000","last_active":"2024-07-24T16:37:46.074705+0000","last_peered":"2024-07-24T16:37:46.074705+0000","last_clean":"2024-07-24T16:37:46.074705+0000","last_became_active":"2024-07-24T16:37:02.998007+0000","last_became_peered":"2024-07-24T16:37:02.998007+0000","last_unstale":"2024-07-24T16:37:46.074705+0000","last_undegraded":"2024-07-24T16:37:46.074705+0000","last_fullsized":"2024-07-24T16:37:46.074705+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:32:49.184726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074828+0000","last_change":"2024-07-24T16:37:04.022338+0000","last_active":"2024-07-24T16:37:46.074828+0000","last_peered":"2024-07-24T16:37:46.074828+0000","last_clean":"2024-07-24T16:37:46.074828+0000","last_became_active":"2024-07-24T16:37:04.022113+0000","last_became_peered":"2024-07-24T16:37:04.022113+0000","last_unstale":"2024-07-24T16:37:46.074828+0000","last_undegraded":"2024-07-24T16:37:46.074828+0000","last_fullsized":"2024-07-24T16:37:46.074828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:26:46.966508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667700+0000","last_change":"2024-07-24T16:37:03.001292+0000","last_active":"2024-07-24T16:37:45.667700+0000","last_peered":"2024-07-24T16:37:45.667700+0000","last_clean":"2024-07-24T16:37:45.667700+0000","last_became_active":"2024-07-24T16:37:03.001003+0000","last_became_peered":"2024-07-24T16:37:03.001003+0000","last_unstale":"2024-07-24T16:37:45.667700+0000","last_undegraded":"2024-07-24T16:37:45.667700+0000","last_fullsized":"2024-07-24T16:37:45.667700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:51:36.249129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668277+0000","last_change":"2024-07-24T16:37:03.999104+0000","last_active":"2024-07-24T16:37:45.668277+0000","last_peered":"2024-07-24T16:37:45.668277+0000","last_clean":"2024-07-24T16:37:45.668277+0000","last_became_active":"2024-07-24T16:37:03.998825+0000","last_became_peered":"2024-07-24T16:37:03.998825+0000","last_unstale":"2024-07-24T16:37:45.668277+0000","last_undegraded":"2024-07-24T16:37:45.668277+0000","last_fullsized":"2024-07-24T16:37:45.668277+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:10:47.439606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667674+0000","last_change":"2024-07-24T16:37:03.013889+0000","last_active":"2024-07-24T16:37:45.667674+0000","last_peered":"2024-07-24T16:37:45.667674+0000","last_clean":"2024-07-24T16:37:45.667674+0000","last_became_active":"2024-07-24T16:37:03.013550+0000","last_became_peered":"2024-07-24T16:37:03.013550+0000","last_unstale":"2024-07-24T16:37:45.667674+0000","last_undegraded":"2024-07-24T16:37:45.667674+0000","last_fullsized":"2024-07-24T16:37:45.667674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:32.419679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665609+0000","last_change":"2024-07-24T16:37:04.000366+0000","last_active":"2024-07-24T16:37:45.665609+0000","last_peered":"2024-07-24T16:37:45.665609+0000","last_clean":"2024-07-24T16:37:45.665609+0000","last_became_active":"2024-07-24T16:37:04.000074+0000","last_became_peered":"2024-07-24T16:37:04.000074+0000","last_unstale":"2024-07-24T16:37:45.665609+0000","last_undegraded":"2024-07-24T16:37:45.665609+0000","last_fullsized":"2024-07-24T16:37:45.665609+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:13:56.585430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668328+0000","last_change":"2024-07-24T16:37:02.995822+0000","last_active":"2024-07-24T16:37:45.668328+0000","last_peered":"2024-07-24T16:37:45.668328+0000","last_clean":"2024-07-24T16:37:45.668328+0000","last_became_active":"2024-07-24T16:37:02.995536+0000","last_became_peered":"2024-07-24T16:37:02.995536+0000","last_unstale":"2024-07-24T16:37:45.668328+0000","last_undegraded":"2024-07-24T16:37:45.668328+0000","last_fullsized":"2024-07-24T16:37:45.668328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:00:55.075881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667752+0000","last_change":"2024-07-24T16:37:04.004492+0000","last_active":"2024-07-24T16:37:45.667752+0000","last_peered":"2024-07-24T16:37:45.667752+0000","last_clean":"2024-07-24T16:37:45.667752+0000","last_became_active":"2024-07-24T16:37:04.004210+0000","last_became_peered":"2024-07-24T16:37:04.004210+0000","last_unstale":"2024-07-24T16:37:45.667752+0000","last_undegraded":"2024-07-24T16:37:45.667752+0000","last_fullsized":"2024-07-24T16:37:45.667752+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:28:19.279886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668948+0000","last_change":"2024-07-24T16:37:03.007200+0000","last_active":"2024-07-24T16:37:45.668948+0000","last_peered":"2024-07-24T16:37:45.668948+0000","last_clean":"2024-07-24T16:37:45.668948+0000","last_became_active":"2024-07-24T16:37:03.006461+0000","last_became_peered":"2024-07-24T16:37:03.006461+0000","last_unstale":"2024-07-24T16:37:45.668948+0000","last_undegraded":"2024-07-24T16:37:45.668948+0000","last_fullsized":"2024-07-24T16:37:45.668948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:58:10.465983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667633+0000","last_change":"2024-07-24T16:37:04.011548+0000","last_active":"2024-07-24T16:37:45.667633+0000","last_peered":"2024-07-24T16:37:45.667633+0000","last_clean":"2024-07-24T16:37:45.667633+0000","last_became_active":"2024-07-24T16:37:04.011301+0000","last_became_peered":"2024-07-24T16:37:04.011301+0000","last_unstale":"2024-07-24T16:37:45.667633+0000","last_undegraded":"2024-07-24T16:37:45.667633+0000","last_fullsized":"2024-07-24T16:37:45.667633+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:18:19.554902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666987+0000","last_change":"2024-07-24T16:37:03.000155+0000","last_active":"2024-07-24T16:37:45.666987+0000","last_peered":"2024-07-24T16:37:45.666987+0000","last_clean":"2024-07-24T16:37:45.666987+0000","last_became_active":"2024-07-24T16:37:02.999863+0000","last_became_peered":"2024-07-24T16:37:02.999863+0000","last_unstale":"2024-07-24T16:37:45.666987+0000","last_undegraded":"2024-07-24T16:37:45.666987+0000","last_fullsized":"2024-07-24T16:37:45.666987+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:03.005579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668338+0000","last_change":"2024-07-24T16:37:04.009717+0000","last_active":"2024-07-24T16:37:45.668338+0000","last_peered":"2024-07-24T16:37:45.668338+0000","last_clean":"2024-07-24T16:37:45.668338+0000","last_became_active":"2024-07-24T16:37:04.009453+0000","last_became_peered":"2024-07-24T16:37:04.009453+0000","last_unstale":"2024-07-24T16:37:45.668338+0000","last_undegraded":"2024-07-24T16:37:45.668338+0000","last_fullsized":"2024-07-24T16:37:45.668338+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:23:03.807268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074402+0000","last_change":"2024-07-24T16:37:03.000905+0000","last_active":"2024-07-24T16:37:46.074402+0000","last_peered":"2024-07-24T16:37:46.074402+0000","last_clean":"2024-07-24T16:37:46.074402+0000","last_became_active":"2024-07-24T16:37:03.000630+0000","last_became_peered":"2024-07-24T16:37:03.000630+0000","last_unstale":"2024-07-24T16:37:46.074402+0000","last_undegraded":"2024-07-24T16:37:46.074402+0000","last_fullsized":"2024-07-24T16:37:46.074402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:26:24.140079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665444+0000","last_change":"2024-07-24T16:37:04.001385+0000","last_active":"2024-07-24T16:37:45.665444+0000","last_peered":"2024-07-24T16:37:45.665444+0000","last_clean":"2024-07-24T16:37:45.665444+0000","last_became_active":"2024-07-24T16:37:04.001124+0000","last_became_peered":"2024-07-24T16:37:04.001124+0000","last_unstale":"2024-07-24T16:37:45.665444+0000","last_undegraded":"2024-07-24T16:37:45.665444+0000","last_fullsized":"2024-07-24T16:37:45.665444+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:34.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667832+0000","last_change":"2024-07-24T16:37:03.003668+0000","last_active":"2024-07-24T16:37:45.667832+0000","last_peered":"2024-07-24T16:37:45.667832+0000","last_clean":"2024-07-24T16:37:45.667832+0000","last_became_active":"2024-07-24T16:37:03.003387+0000","last_became_peered":"2024-07-24T16:37:03.003387+0000","last_unstale":"2024-07-24T16:37:45.667832+0000","last_undegraded":"2024-07-24T16:37:45.667832+0000","last_fullsized":"2024-07-24T16:37:45.667832+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:50:35.318606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668412+0000","last_change":"2024-07-24T16:37:04.000123+0000","last_active":"2024-07-24T16:37:45.668412+0000","last_peered":"2024-07-24T16:37:45.668412+0000","last_clean":"2024-07-24T16:37:45.668412+0000","last_became_active":"2024-07-24T16:37:03.999841+0000","last_became_peered":"2024-07-24T16:37:03.999841+0000","last_unstale":"2024-07-24T16:37:45.668412+0000","last_undegraded":"2024-07-24T16:37:45.668412+0000","last_fullsized":"2024-07-24T16:37:45.668412+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:26:46.966508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075276+0000","last_change":"2024-07-24T16:37:03.003110+0000","last_active":"2024-07-24T16:37:46.075276+0000","last_peered":"2024-07-24T16:37:46.075276+0000","last_clean":"2024-07-24T16:37:46.075276+0000","last_became_active":"2024-07-24T16:37:03.002819+0000","last_became_peered":"2024-07-24T16:37:03.002819+0000","last_unstale":"2024-07-24T16:37:46.075276+0000","last_undegraded":"2024-07-24T16:37:46.075276+0000","last_fullsized":"2024-07-24T16:37:46.075276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:32:42.309475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669126+0000","last_change":"2024-07-24T16:37:04.007895+0000","last_active":"2024-07-24T16:37:45.669126+0000","last_peered":"2024-07-24T16:37:45.669126+0000","last_clean":"2024-07-24T16:37:45.669126+0000","last_became_active":"2024-07-24T16:37:04.007614+0000","last_became_peered":"2024-07-24T16:37:04.007614+0000","last_unstale":"2024-07-24T16:37:45.669126+0000","last_undegraded":"2024-07-24T16:37:45.669126+0000","last_fullsized":"2024-07-24T16:37:45.669126+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:36:32.427250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667342+0000","last_change":"2024-07-24T16:37:03.002515+0000","last_active":"2024-07-24T16:37:45.667342+0000","last_peered":"2024-07-24T16:37:45.667342+0000","last_clean":"2024-07-24T16:37:45.667342+0000","last_became_active":"2024-07-24T16:37:03.002219+0000","last_became_peered":"2024-07-24T16:37:03.002219+0000","last_unstale":"2024-07-24T16:37:45.667342+0000","last_undegraded":"2024-07-24T16:37:45.667342+0000","last_fullsized":"2024-07-24T16:37:45.667342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:29:44.553198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667412+0000","last_change":"2024-07-24T16:37:04.021367+0000","last_active":"2024-07-24T16:37:45.667412+0000","last_peered":"2024-07-24T16:37:45.667412+0000","last_clean":"2024-07-24T16:37:45.667412+0000","last_became_active":"2024-07-24T16:37:04.021059+0000","last_became_peered":"2024-07-24T16:37:04.021059+0000","last_unstale":"2024-07-24T16:37:45.667412+0000","last_undegraded":"2024-07-24T16:37:45.667412+0000","last_fullsized":"2024-07-24T16:37:45.667412+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:18:01.754809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669294+0000","last_change":"2024-07-24T16:37:03.009702+0000","last_active":"2024-07-24T16:37:45.669294+0000","last_peered":"2024-07-24T16:37:45.669294+0000","last_clean":"2024-07-24T16:37:45.669294+0000","last_became_active":"2024-07-24T16:37:03.009216+0000","last_became_peered":"2024-07-24T16:37:03.009216+0000","last_unstale":"2024-07-24T16:37:45.669294+0000","last_undegraded":"2024-07-24T16:37:45.669294+0000","last_fullsized":"2024-07-24T16:37:45.669294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:33.301368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665544+0000","last_change":"2024-07-24T16:37:04.007332+0000","last_active":"2024-07-24T16:37:45.665544+0000","last_peered":"2024-07-24T16:37:45.665544+0000","last_clean":"2024-07-24T16:37:45.665544+0000","last_became_active":"2024-07-24T16:37:04.007096+0000","last_became_peered":"2024-07-24T16:37:04.007096+0000","last_unstale":"2024-07-24T16:37:45.665544+0000","last_undegraded":"2024-07-24T16:37:45.665544+0000","last_fullsized":"2024-07-24T16:37:45.665544+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:23:03.806832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669021+0000","last_change":"2024-07-24T16:37:03.008273+0000","last_active":"2024-07-24T16:37:45.669021+0000","last_peered":"2024-07-24T16:37:45.669021+0000","last_clean":"2024-07-24T16:37:45.669021+0000","last_became_active":"2024-07-24T16:37:03.008025+0000","last_became_peered":"2024-07-24T16:37:03.008025+0000","last_unstale":"2024-07-24T16:37:45.669021+0000","last_undegraded":"2024-07-24T16:37:45.669021+0000","last_fullsized":"2024-07-24T16:37:45.669021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:54.564511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667613+0000","last_change":"2024-07-24T16:37:04.018001+0000","last_active":"2024-07-24T16:37:45.667613+0000","last_peered":"2024-07-24T16:37:45.667613+0000","last_clean":"2024-07-24T16:37:45.667613+0000","last_became_active":"2024-07-24T16:37:04.017748+0000","last_became_peered":"2024-07-24T16:37:04.017748+0000","last_unstale":"2024-07-24T16:37:45.667613+0000","last_undegraded":"2024-07-24T16:37:45.667613+0000","last_fullsized":"2024-07-24T16:37:45.667613+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:58:27.398456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075393+0000","last_change":"2024-07-24T16:37:03.008246+0000","last_active":"2024-07-24T16:37:46.075393+0000","last_peered":"2024-07-24T16:37:46.075393+0000","last_clean":"2024-07-24T16:37:46.075393+0000","last_became_active":"2024-07-24T16:37:03.008010+0000","last_became_peered":"2024-07-24T16:37:03.008010+0000","last_unstale":"2024-07-24T16:37:46.075393+0000","last_undegraded":"2024-07-24T16:37:46.075393+0000","last_fullsized":"2024-07-24T16:37:46.075393+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:23.842357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669435+0000","last_change":"2024-07-24T16:37:04.004696+0000","last_active":"2024-07-24T16:37:45.669435+0000","last_peered":"2024-07-24T16:37:45.669435+0000","last_clean":"2024-07-24T16:37:45.669435+0000","last_became_active":"2024-07-24T16:37:04.004446+0000","last_became_peered":"2024-07-24T16:37:04.004446+0000","last_unstale":"2024-07-24T16:37:45.669435+0000","last_undegraded":"2024-07-24T16:37:45.669435+0000","last_fullsized":"2024-07-24T16:37:45.669435+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:33:56.086626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665618+0000","last_change":"2024-07-24T16:37:02.997130+0000","last_active":"2024-07-24T16:37:45.665618+0000","last_peered":"2024-07-24T16:37:45.665618+0000","last_clean":"2024-07-24T16:37:45.665618+0000","last_became_active":"2024-07-24T16:37:02.996841+0000","last_became_peered":"2024-07-24T16:37:02.996841+0000","last_unstale":"2024-07-24T16:37:45.665618+0000","last_undegraded":"2024-07-24T16:37:45.665618+0000","last_fullsized":"2024-07-24T16:37:45.665618+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:27:02.167426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667380+0000","last_change":"2024-07-24T16:37:04.005886+0000","last_active":"2024-07-24T16:37:45.667380+0000","last_peered":"2024-07-24T16:37:45.667380+0000","last_clean":"2024-07-24T16:37:45.667380+0000","last_became_active":"2024-07-24T16:37:04.005578+0000","last_became_peered":"2024-07-24T16:37:04.005578+0000","last_unstale":"2024-07-24T16:37:45.667380+0000","last_undegraded":"2024-07-24T16:37:45.667380+0000","last_fullsized":"2024-07-24T16:37:45.667380+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:32:24.649601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"65'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667754+0000","last_change":"2024-07-24T16:37:03.002115+0000","last_active":"2024-07-24T16:37:45.667754+0000","last_peered":"2024-07-24T16:37:45.667754+0000","last_clean":"2024-07-24T16:37:45.667754+0000","last_became_active":"2024-07-24T16:37:03.001758+0000","last_became_peered":"2024-07-24T16:37:03.001758+0000","last_unstale":"2024-07-24T16:37:45.667754+0000","last_undegraded":"2024-07-24T16:37:45.667754+0000","last_fullsized":"2024-07-24T16:37:45.667754+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:10:49.225665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'86","reported_seq":249,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074704+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:37:46.074704+0000","last_peered":"2024-07-24T16:37:46.074704+0000","last_clean":"2024-07-24T16:37:46.074704+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:37:46.074704+0000","last_undegraded":"2024-07-24T16:37:46.074704+0000","last_fullsized":"2024-07-24T16:37:46.074704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":3653,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575032,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54736,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317104,"statfs":{"total":96636764160,"available":96580714496,"internally_reserved":0,"allocated":1380352,"data_stored":977699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":387859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575032,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49988,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321852,"statfs":{"total":96636764160,"available":96585576448,"internally_reserved":0,"allocated":778240,"data_stored":387207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575033,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":387789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575033,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":794624,"data_stored":390084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54160,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317680,"statfs":{"total":96636764160,"available":96581304320,"internally_reserved":0,"allocated":790528,"data_stored":390062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575032,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":387367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575033,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1380352,"data_stored":977631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:39:11.846 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:39:11.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.982+0000 7f8675b79640 1 -- 172.21.15.159:0/1128735045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8670158fe0 msgr2=0x7f867006f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:11.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.982+0000 7f8675b79640 1 --2- 172.21.15.159:0/1128735045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8670158fe0 0x7f867006f890 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8670073510 tx=0x7f866002a560 comp rx=0 tx=0).stop 2024-07-24T16:39:11.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.982+0000 7f8675b79640 1 -- 172.21.15.159:0/1128735045 shutdown_connections 2024-07-24T16:39:11.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.982+0000 7f8675b79640 1 --2- 172.21.15.159:0/1128735045 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f86700cf860 0x7f867015bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.982+0000 7f8675b79640 1 --2- 172.21.15.159:0/1128735045 >> v2:172.21.15.193:3300/0 conn(0x7f867006d670 0x7f86700cf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.982+0000 7f8675b79640 1 --2- 172.21.15.159:0/1128735045 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8670158fe0 0x7f867006f890 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.982+0000 7f8675b79640 1 -- 172.21.15.159:0/1128735045 >> 172.21.15.159:0/1128735045 conn(0x7f867006c560 msgr2=0x7f867006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.982+0000 7f8675b79640 1 -- 172.21.15.159:0/1128735045 shutdown_connections 2024-07-24T16:39:11.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.982+0000 7f8675b79640 1 -- 172.21.15.159:0/1128735045 wait complete. 2024-07-24T16:39:11.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.983+0000 7f8675b79640 1 Processor -- start 2024-07-24T16:39:11.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.983+0000 7f8675b79640 1 -- start start 2024-07-24T16:39:11.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f8675b79640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f867006d670 0x7f86701f8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f8675b79640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86700cf860 0x7f86700c4490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f8675b79640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8670158fe0 0x7f86700cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f8675b79640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f86701593c0 con 0x7f86700cf860 2024-07-24T16:39:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f8675b79640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f867006dbf0 con 0x7f867006d670 2024-07-24T16:39:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f8675b79640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f8670159540 con 0x7f8670158fe0 2024-07-24T16:39:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f866effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86700cf860 0x7f86700c4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:11.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f866effd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86700cf860 0x7f86700c4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49756/0 (socket says 172.21.15.159:49756) 2024-07-24T16:39:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f866effd640 1 -- 172.21.15.159:0/3804430106 learned_addr learned my addr 172.21.15.159:0/3804430106 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f866f7fe640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f867006d670 0x7f86701f8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f866ffff640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8670158fe0 0x7f86700cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f866effd640 1 -- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8670158fe0 msgr2=0x7f86700cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f866effd640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8670158fe0 0x7f86700cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f866effd640 1 -- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f867006d670 msgr2=0x7f86701f8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:11.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.984+0000 7f866effd640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f867006d670 0x7f86701f8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:11.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.985+0000 7f866effd640 1 -- 172.21.15.159:0/3804430106 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86701f4640 con 0x7f86700cf860 2024-07-24T16:39:11.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.985+0000 7f866f7fe640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f867006d670 0x7f86701f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:39:11.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.985+0000 7f866ffff640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8670158fe0 0x7f86700cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:39:11.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.985+0000 7f866effd640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86700cf860 0x7f86700c4490 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f866400d770 tx=0x7f866400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:11.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.985+0000 7f8657fff640 1 -- 172.21.15.159:0/3804430106 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8664017070 con 0x7f86700cf860 2024-07-24T16:39:11.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.985+0000 7f8657fff640 1 -- 172.21.15.159:0/3804430106 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8664009d20 con 0x7f86700cf860 2024-07-24T16:39:11.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.985+0000 7f8675b79640 1 -- 172.21.15.159:0/3804430106 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86701f4920 con 0x7f86700cf860 2024-07-24T16:39:11.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.985+0000 7f8657fff640 1 -- 172.21.15.159:0/3804430106 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86640106c0 con 0x7f86700cf860 2024-07-24T16:39:11.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.985+0000 7f8675b79640 1 -- 172.21.15.159:0/3804430106 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86701f4ee0 con 0x7f86700cf860 2024-07-24T16:39:11.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.986+0000 7f8675b79640 1 -- 172.21.15.159:0/3804430106 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86700cec40 con 0x7f86700cf860 2024-07-24T16:39:11.992 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.987+0000 7f8657fff640 1 -- 172.21.15.159:0/3804430106 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f866401a070 con 0x7f86700cf860 2024-07-24T16:39:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.987+0000 7f8657fff640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f865c077010 0x7f865c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.987+0000 7f8657fff640 1 -- 172.21.15.159:0/3804430106 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f8664098cd0 con 0x7f86700cf860 2024-07-24T16:39:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.987+0000 7f866f7fe640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f865c077010 0x7f865c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.988+0000 7f866f7fe640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f865c077010 0x7f865c0794d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8660033000 tx=0x7f8660004730 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:11.993 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:11.991+0000 7f8657fff640 1 -- 172.21.15.159:0/3804430106 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f8664061c80 con 0x7f86700cf860 2024-07-24T16:39:12.178 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.175+0000 7f8675b79640 1 -- 172.21.15.159:0/3804430106 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f867015bf70 con 0x7f865c077010 2024-07-24T16:39:12.182 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.179+0000 7f8657fff640 1 -- 172.21.15.159:0/3804430106 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251831 (secure 0 0 0) 0x7f867015bf70 con 0x7f865c077010 2024-07-24T16:39:12.184 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:39:12.186 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:39:12.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.182+0000 7f8675b79640 1 -- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f865c077010 msgr2=0x7f865c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:12.187 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.182+0000 7f8675b79640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f865c077010 0x7f865c0794d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8660033000 tx=0x7f8660004730 comp rx=0 tx=0).stop 2024-07-24T16:39:12.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.182+0000 7f8675b79640 1 -- 172.21.15.159:0/3804430106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86700cf860 msgr2=0x7f86700c4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:12.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.182+0000 7f8675b79640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86700cf860 0x7f86700c4490 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f866400d770 tx=0x7f866400dc30 comp rx=0 tx=0).stop 2024-07-24T16:39:12.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.183+0000 7f8675b79640 1 -- 172.21.15.159:0/3804430106 shutdown_connections 2024-07-24T16:39:12.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.183+0000 7f8675b79640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f8670158fe0 0x7f86700cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.183+0000 7f8675b79640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f865c077010 0x7f865c0794d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.183+0000 7f8675b79640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f86700cf860 0x7f86700c4490 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.183+0000 7f8675b79640 1 --2- 172.21.15.159:0/3804430106 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f867006d670 0x7f86701f8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.188 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.183+0000 7f8675b79640 1 -- 172.21.15.159:0/3804430106 >> 172.21.15.159:0/3804430106 conn(0x7f867006c560 msgr2=0x7f867015a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.183+0000 7f8675b79640 1 -- 172.21.15.159:0/3804430106 shutdown_connections 2024-07-24T16:39:12.189 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.183+0000 7f8675b79640 1 -- 172.21.15.159:0/3804430106 wait complete. 2024-07-24T16:39:12.196 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-07-24T16:39:10.574496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594021,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":174,"num_write_kb":1645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319224,"kb_used_data":7304,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754655496,"statfs":{"total":773094113280,"available":772767227904,"internally_reserved":0,"allocated":7479296,"data_stored":4285698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002297"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668281+0000","last_change":"2024-07-24T16:37:04.000283+0000","last_active":"2024-07-24T16:37:45.668281+0000","last_peered":"2024-07-24T16:37:45.668281+0000","last_clean":"2024-07-24T16:37:45.668281+0000","last_became_active":"2024-07-24T16:37:04.000007+0000","last_became_peered":"2024-07-24T16:37:04.000007+0000","last_unstale":"2024-07-24T16:37:45.668281+0000","last_undegraded":"2024-07-24T16:37:45.668281+0000","last_fullsized":"2024-07-24T16:37:45.668281+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:22:29.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075097+0000","last_change":"2024-07-24T16:37:04.011891+0000","last_active":"2024-07-24T16:37:46.075097+0000","last_peered":"2024-07-24T16:37:46.075097+0000","last_clean":"2024-07-24T16:37:46.075097+0000","last_became_active":"2024-07-24T16:37:04.011627+0000","last_became_peered":"2024-07-24T16:37:04.011627+0000","last_unstale":"2024-07-24T16:37:46.075097+0000","last_undegraded":"2024-07-24T16:37:46.075097+0000","last_fullsized":"2024-07-24T16:37:46.075097+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:06.176465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667446+0000","last_change":"2024-07-24T16:37:04.014901+0000","last_active":"2024-07-24T16:37:45.667446+0000","last_peered":"2024-07-24T16:37:45.667446+0000","last_clean":"2024-07-24T16:37:45.667446+0000","last_became_active":"2024-07-24T16:37:04.014649+0000","last_became_peered":"2024-07-24T16:37:04.014649+0000","last_unstale":"2024-07-24T16:37:45.667446+0000","last_undegraded":"2024-07-24T16:37:45.667446+0000","last_fullsized":"2024-07-24T16:37:45.667446+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:31:41.870538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075295+0000","last_change":"2024-07-24T16:37:04.011677+0000","last_active":"2024-07-24T16:37:46.075295+0000","last_peered":"2024-07-24T16:37:46.075295+0000","last_clean":"2024-07-24T16:37:46.075295+0000","last_became_active":"2024-07-24T16:37:04.011002+0000","last_became_peered":"2024-07-24T16:37:04.011002+0000","last_unstale":"2024-07-24T16:37:46.075295+0000","last_undegraded":"2024-07-24T16:37:46.075295+0000","last_fullsized":"2024-07-24T16:37:46.075295+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:36.298799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075070+0000","last_change":"2024-07-24T16:37:04.005188+0000","last_active":"2024-07-24T16:37:46.075070+0000","last_peered":"2024-07-24T16:37:46.075070+0000","last_clean":"2024-07-24T16:37:46.075070+0000","last_became_active":"2024-07-24T16:37:04.004895+0000","last_became_peered":"2024-07-24T16:37:04.004895+0000","last_unstale":"2024-07-24T16:37:46.075070+0000","last_undegraded":"2024-07-24T16:37:46.075070+0000","last_fullsized":"2024-07-24T16:37:46.075070+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:22:29.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668314+0000","last_change":"2024-07-24T16:37:04.009148+0000","last_active":"2024-07-24T16:37:45.668314+0000","last_peered":"2024-07-24T16:37:45.668314+0000","last_clean":"2024-07-24T16:37:45.668314+0000","last_became_active":"2024-07-24T16:37:04.008866+0000","last_became_peered":"2024-07-24T16:37:04.008866+0000","last_unstale":"2024-07-24T16:37:45.668314+0000","last_undegraded":"2024-07-24T16:37:45.668314+0000","last_fullsized":"2024-07-24T16:37:45.668314+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:08:08.449053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666777+0000","last_change":"2024-07-24T16:37:04.020944+0000","last_active":"2024-07-24T16:37:45.666777+0000","last_peered":"2024-07-24T16:37:45.666777+0000","last_clean":"2024-07-24T16:37:45.666777+0000","last_became_active":"2024-07-24T16:37:04.019103+0000","last_became_peered":"2024-07-24T16:37:04.019103+0000","last_unstale":"2024-07-24T16:37:45.666777+0000","last_undegraded":"2024-07-24T16:37:45.666777+0000","last_fullsized":"2024-07-24T16:37:45.666777+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:27:17.770264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":23,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.671500+0000","last_change":"2024-07-24T16:37:45.671415+0000","last_active":"2024-07-24T16:37:45.671500+0000","last_peered":"2024-07-24T16:37:45.671500+0000","last_clean":"2024-07-24T16:37:45.671500+0000","last_became_active":"2024-07-24T16:37:45.671060+0000","last_became_peered":"2024-07-24T16:37:45.671060+0000","last_unstale":"2024-07-24T16:37:45.671500+0000","last_undegraded":"2024-07-24T16:37:45.671500+0000","last_fullsized":"2024-07-24T16:37:45.671500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:54:47.659029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669317+0000","last_change":"2024-07-24T16:37:04.024211+0000","last_active":"2024-07-24T16:37:45.669317+0000","last_peered":"2024-07-24T16:37:45.669317+0000","last_clean":"2024-07-24T16:37:45.669317+0000","last_became_active":"2024-07-24T16:37:04.023933+0000","last_became_peered":"2024-07-24T16:37:04.023933+0000","last_unstale":"2024-07-24T16:37:45.669317+0000","last_undegraded":"2024-07-24T16:37:45.669317+0000","last_fullsized":"2024-07-24T16:37:45.669317+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:08:35.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668130+0000","last_change":"2024-07-24T16:37:03.998622+0000","last_active":"2024-07-24T16:37:45.668130+0000","last_peered":"2024-07-24T16:37:45.668130+0000","last_clean":"2024-07-24T16:37:45.668130+0000","last_became_active":"2024-07-24T16:37:03.997985+0000","last_became_peered":"2024-07-24T16:37:03.997985+0000","last_unstale":"2024-07-24T16:37:45.668130+0000","last_undegraded":"2024-07-24T16:37:45.668130+0000","last_fullsized":"2024-07-24T16:37:45.668130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:08:12.604308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074662+0000","last_change":"2024-07-24T16:37:04.008205+0000","last_active":"2024-07-24T16:37:46.074662+0000","last_peered":"2024-07-24T16:37:46.074662+0000","last_clean":"2024-07-24T16:37:46.074662+0000","last_became_active":"2024-07-24T16:37:04.006298+0000","last_became_peered":"2024-07-24T16:37:04.006298+0000","last_unstale":"2024-07-24T16:37:46.074662+0000","last_undegraded":"2024-07-24T16:37:46.074662+0000","last_fullsized":"2024-07-24T16:37:46.074662+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:51:24.513752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669526+0000","last_change":"2024-07-24T16:37:04.006667+0000","last_active":"2024-07-24T16:37:45.669526+0000","last_peered":"2024-07-24T16:37:45.669526+0000","last_clean":"2024-07-24T16:37:45.669526+0000","last_became_active":"2024-07-24T16:37:04.005908+0000","last_became_peered":"2024-07-24T16:37:04.005908+0000","last_unstale":"2024-07-24T16:37:45.669526+0000","last_undegraded":"2024-07-24T16:37:45.669526+0000","last_fullsized":"2024-07-24T16:37:45.669526+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:17.192204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668121+0000","last_change":"2024-07-24T16:37:04.002494+0000","last_active":"2024-07-24T16:37:45.668121+0000","last_peered":"2024-07-24T16:37:45.668121+0000","last_clean":"2024-07-24T16:37:45.668121+0000","last_became_active":"2024-07-24T16:37:04.001872+0000","last_became_peered":"2024-07-24T16:37:04.001872+0000","last_unstale":"2024-07-24T16:37:45.668121+0000","last_undegraded":"2024-07-24T16:37:45.668121+0000","last_fullsized":"2024-07-24T16:37:45.668121+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:44.694240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667052+0000","last_change":"2024-07-24T16:37:04.018574+0000","last_active":"2024-07-24T16:37:45.667052+0000","last_peered":"2024-07-24T16:37:45.667052+0000","last_clean":"2024-07-24T16:37:45.667052+0000","last_became_active":"2024-07-24T16:37:04.018314+0000","last_became_peered":"2024-07-24T16:37:04.018314+0000","last_unstale":"2024-07-24T16:37:45.667052+0000","last_undegraded":"2024-07-24T16:37:45.667052+0000","last_fullsized":"2024-07-24T16:37:45.667052+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:11:02.137962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074761+0000","last_change":"2024-07-24T16:37:04.009736+0000","last_active":"2024-07-24T16:37:46.074761+0000","last_peered":"2024-07-24T16:37:46.074761+0000","last_clean":"2024-07-24T16:37:46.074761+0000","last_became_active":"2024-07-24T16:37:04.009473+0000","last_became_peered":"2024-07-24T16:37:04.009473+0000","last_unstale":"2024-07-24T16:37:46.074761+0000","last_undegraded":"2024-07-24T16:37:46.074761+0000","last_fullsized":"2024-07-24T16:37:46.074761+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:05:05.128427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668018+0000","last_change":"2024-07-24T16:37:04.001780+0000","last_active":"2024-07-24T16:37:45.668018+0000","last_peered":"2024-07-24T16:37:45.668018+0000","last_clean":"2024-07-24T16:37:45.668018+0000","last_became_active":"2024-07-24T16:37:04.001535+0000","last_became_peered":"2024-07-24T16:37:04.001535+0000","last_unstale":"2024-07-24T16:37:45.668018+0000","last_undegraded":"2024-07-24T16:37:45.668018+0000","last_fullsized":"2024-07-24T16:37:45.668018+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:00:08.654329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668814+0000","last_change":"2024-07-24T16:37:45.668749+0000","last_active":"2024-07-24T16:37:45.668814+0000","last_peered":"2024-07-24T16:37:45.668814+0000","last_clean":"2024-07-24T16:37:45.668814+0000","last_became_active":"2024-07-24T16:37:45.668460+0000","last_became_peered":"2024-07-24T16:37:45.668460+0000","last_unstale":"2024-07-24T16:37:45.668814+0000","last_undegraded":"2024-07-24T16:37:45.668814+0000","last_fullsized":"2024-07-24T16:37:45.668814+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:08:12.604308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075161+0000","last_change":"2024-07-24T16:37:04.011422+0000","last_active":"2024-07-24T16:37:46.075161+0000","last_peered":"2024-07-24T16:37:46.075161+0000","last_clean":"2024-07-24T16:37:46.075161+0000","last_became_active":"2024-07-24T16:37:04.011166+0000","last_became_peered":"2024-07-24T16:37:04.011166+0000","last_unstale":"2024-07-24T16:37:46.075161+0000","last_undegraded":"2024-07-24T16:37:46.075161+0000","last_fullsized":"2024-07-24T16:37:46.075161+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:34.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667421+0000","last_change":"2024-07-24T16:37:04.008292+0000","last_active":"2024-07-24T16:37:45.667421+0000","last_peered":"2024-07-24T16:37:45.667421+0000","last_clean":"2024-07-24T16:37:45.667421+0000","last_became_active":"2024-07-24T16:37:04.008030+0000","last_became_peered":"2024-07-24T16:37:04.008030+0000","last_unstale":"2024-07-24T16:37:45.667421+0000","last_undegraded":"2024-07-24T16:37:45.667421+0000","last_fullsized":"2024-07-24T16:37:45.667421+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:32:43.315454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667556+0000","last_change":"2024-07-24T16:37:04.007961+0000","last_active":"2024-07-24T16:37:45.667556+0000","last_peered":"2024-07-24T16:37:45.667556+0000","last_clean":"2024-07-24T16:37:45.667556+0000","last_became_active":"2024-07-24T16:37:04.007154+0000","last_became_peered":"2024-07-24T16:37:04.007154+0000","last_unstale":"2024-07-24T16:37:45.667556+0000","last_undegraded":"2024-07-24T16:37:45.667556+0000","last_fullsized":"2024-07-24T16:37:45.667556+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:45.075854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667469+0000","last_change":"2024-07-24T16:37:04.007037+0000","last_active":"2024-07-24T16:37:45.667469+0000","last_peered":"2024-07-24T16:37:45.667469+0000","last_clean":"2024-07-24T16:37:45.667469+0000","last_became_active":"2024-07-24T16:37:04.006749+0000","last_became_peered":"2024-07-24T16:37:04.006749+0000","last_unstale":"2024-07-24T16:37:45.667469+0000","last_undegraded":"2024-07-24T16:37:45.667469+0000","last_fullsized":"2024-07-24T16:37:45.667469+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:20.158902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668852+0000","last_change":"2024-07-24T16:37:04.020205+0000","last_active":"2024-07-24T16:37:45.668852+0000","last_peered":"2024-07-24T16:37:45.668852+0000","last_clean":"2024-07-24T16:37:45.668852+0000","last_became_active":"2024-07-24T16:37:04.019931+0000","last_became_peered":"2024-07-24T16:37:04.019931+0000","last_unstale":"2024-07-24T16:37:45.668852+0000","last_undegraded":"2024-07-24T16:37:45.668852+0000","last_fullsized":"2024-07-24T16:37:45.668852+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:38:56.986337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074402+0000","last_change":"2024-07-24T16:37:04.003751+0000","last_active":"2024-07-24T16:37:46.074402+0000","last_peered":"2024-07-24T16:37:46.074402+0000","last_clean":"2024-07-24T16:37:46.074402+0000","last_became_active":"2024-07-24T16:37:04.003501+0000","last_became_peered":"2024-07-24T16:37:04.003501+0000","last_unstale":"2024-07-24T16:37:46.074402+0000","last_undegraded":"2024-07-24T16:37:46.074402+0000","last_fullsized":"2024-07-24T16:37:46.074402+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:47:41.761372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666694+0000","last_change":"2024-07-24T16:37:04.023076+0000","last_active":"2024-07-24T16:37:45.666694+0000","last_peered":"2024-07-24T16:37:45.666694+0000","last_clean":"2024-07-24T16:37:45.666694+0000","last_became_active":"2024-07-24T16:37:04.021397+0000","last_became_peered":"2024-07-24T16:37:04.021397+0000","last_unstale":"2024-07-24T16:37:45.666694+0000","last_undegraded":"2024-07-24T16:37:45.666694+0000","last_fullsized":"2024-07-24T16:37:45.666694+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:15:36.295295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667842+0000","last_change":"2024-07-24T16:37:04.021808+0000","last_active":"2024-07-24T16:37:45.667842+0000","last_peered":"2024-07-24T16:37:45.667842+0000","last_clean":"2024-07-24T16:37:45.667842+0000","last_became_active":"2024-07-24T16:37:04.021195+0000","last_became_peered":"2024-07-24T16:37:04.021195+0000","last_unstale":"2024-07-24T16:37:45.667842+0000","last_undegraded":"2024-07-24T16:37:45.667842+0000","last_fullsized":"2024-07-24T16:37:45.667842+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:09:05.945632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669107+0000","last_change":"2024-07-24T16:37:04.005510+0000","last_active":"2024-07-24T16:37:45.669107+0000","last_peered":"2024-07-24T16:37:45.669107+0000","last_clean":"2024-07-24T16:37:45.669107+0000","last_became_active":"2024-07-24T16:37:04.004807+0000","last_became_peered":"2024-07-24T16:37:04.004807+0000","last_unstale":"2024-07-24T16:37:45.669107+0000","last_undegraded":"2024-07-24T16:37:45.669107+0000","last_fullsized":"2024-07-24T16:37:45.669107+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:02:47.950208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668424+0000","last_change":"2024-07-24T16:37:04.016153+0000","last_active":"2024-07-24T16:37:45.668424+0000","last_peered":"2024-07-24T16:37:45.668424+0000","last_clean":"2024-07-24T16:37:45.668424+0000","last_became_active":"2024-07-24T16:37:04.015860+0000","last_became_peered":"2024-07-24T16:37:04.015860+0000","last_unstale":"2024-07-24T16:37:45.668424+0000","last_undegraded":"2024-07-24T16:37:45.668424+0000","last_fullsized":"2024-07-24T16:37:45.668424+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:37.931655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667580+0000","last_change":"2024-07-24T16:37:04.006057+0000","last_active":"2024-07-24T16:37:45.667580+0000","last_peered":"2024-07-24T16:37:45.667580+0000","last_clean":"2024-07-24T16:37:45.667580+0000","last_became_active":"2024-07-24T16:37:04.005597+0000","last_became_peered":"2024-07-24T16:37:04.005597+0000","last_unstale":"2024-07-24T16:37:45.667580+0000","last_undegraded":"2024-07-24T16:37:45.667580+0000","last_fullsized":"2024-07-24T16:37:45.667580+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:24.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667174+0000","last_change":"2024-07-24T16:37:04.015925+0000","last_active":"2024-07-24T16:37:45.667174+0000","last_peered":"2024-07-24T16:37:45.667174+0000","last_clean":"2024-07-24T16:37:45.667174+0000","last_became_active":"2024-07-24T16:37:04.015678+0000","last_became_peered":"2024-07-24T16:37:04.015678+0000","last_unstale":"2024-07-24T16:37:45.667174+0000","last_undegraded":"2024-07-24T16:37:45.667174+0000","last_fullsized":"2024-07-24T16:37:45.667174+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:40:11.250834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075009+0000","last_change":"2024-07-24T16:37:04.014588+0000","last_active":"2024-07-24T16:37:46.075009+0000","last_peered":"2024-07-24T16:37:46.075009+0000","last_clean":"2024-07-24T16:37:46.075009+0000","last_became_active":"2024-07-24T16:37:04.014310+0000","last_became_peered":"2024-07-24T16:37:04.014310+0000","last_unstale":"2024-07-24T16:37:46.075009+0000","last_undegraded":"2024-07-24T16:37:46.075009+0000","last_fullsized":"2024-07-24T16:37:46.075009+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:58:11.471962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666927+0000","last_change":"2024-07-24T16:37:04.007655+0000","last_active":"2024-07-24T16:37:45.666927+0000","last_peered":"2024-07-24T16:37:45.666927+0000","last_clean":"2024-07-24T16:37:45.666927+0000","last_became_active":"2024-07-24T16:37:04.007367+0000","last_became_peered":"2024-07-24T16:37:04.007367+0000","last_unstale":"2024-07-24T16:37:45.666927+0000","last_undegraded":"2024-07-24T16:37:45.666927+0000","last_fullsized":"2024-07-24T16:37:45.666927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:51:44.948803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665643+0000","last_change":"2024-07-24T16:37:04.011681+0000","last_active":"2024-07-24T16:37:45.665643+0000","last_peered":"2024-07-24T16:37:45.665643+0000","last_clean":"2024-07-24T16:37:45.665643+0000","last_became_active":"2024-07-24T16:37:04.011439+0000","last_became_peered":"2024-07-24T16:37:04.011439+0000","last_unstale":"2024-07-24T16:37:45.665643+0000","last_undegraded":"2024-07-24T16:37:45.665643+0000","last_fullsized":"2024-07-24T16:37:45.665643+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:06.176465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074554+0000","last_change":"2024-07-24T16:37:04.008494+0000","last_active":"2024-07-24T16:37:46.074554+0000","last_peered":"2024-07-24T16:37:46.074554+0000","last_clean":"2024-07-24T16:37:46.074554+0000","last_became_active":"2024-07-24T16:37:04.008128+0000","last_became_peered":"2024-07-24T16:37:04.008128+0000","last_unstale":"2024-07-24T16:37:46.074554+0000","last_undegraded":"2024-07-24T16:37:46.074554+0000","last_fullsized":"2024-07-24T16:37:46.074554+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:30:30.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"62'4","reported_seq":24,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667797+0000","last_change":"2024-07-24T16:37:03.003544+0000","last_active":"2024-07-24T16:37:45.667797+0000","last_peered":"2024-07-24T16:37:45.667797+0000","last_clean":"2024-07-24T16:37:45.667797+0000","last_became_active":"2024-07-24T16:37:03.003212+0000","last_became_peered":"2024-07-24T16:37:03.003212+0000","last_unstale":"2024-07-24T16:37:45.667797+0000","last_undegraded":"2024-07-24T16:37:45.667797+0000","last_fullsized":"2024-07-24T16:37:45.667797+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:10.767177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665478+0000","last_change":"2024-07-24T16:37:04.007097+0000","last_active":"2024-07-24T16:37:45.665478+0000","last_peered":"2024-07-24T16:37:45.665478+0000","last_clean":"2024-07-24T16:37:45.665478+0000","last_became_active":"2024-07-24T16:37:04.006833+0000","last_became_peered":"2024-07-24T16:37:04.006833+0000","last_unstale":"2024-07-24T16:37:45.665478+0000","last_undegraded":"2024-07-24T16:37:45.665478+0000","last_fullsized":"2024-07-24T16:37:45.665478+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:30:23.341481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"62'1","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668538+0000","last_change":"2024-07-24T16:37:03.008723+0000","last_active":"2024-07-24T16:37:45.668538+0000","last_peered":"2024-07-24T16:37:45.668538+0000","last_clean":"2024-07-24T16:37:45.668538+0000","last_became_active":"2024-07-24T16:37:03.008450+0000","last_became_peered":"2024-07-24T16:37:03.008450+0000","last_unstale":"2024-07-24T16:37:45.668538+0000","last_undegraded":"2024-07-24T16:37:45.668538+0000","last_fullsized":"2024-07-24T16:37:45.668538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:00:20.422519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667472+0000","last_change":"2024-07-24T16:37:04.009602+0000","last_active":"2024-07-24T16:37:45.667472+0000","last_peered":"2024-07-24T16:37:45.667472+0000","last_clean":"2024-07-24T16:37:45.667472+0000","last_became_active":"2024-07-24T16:37:04.009341+0000","last_became_peered":"2024-07-24T16:37:04.009341+0000","last_unstale":"2024-07-24T16:37:45.667472+0000","last_undegraded":"2024-07-24T16:37:45.667472+0000","last_fullsized":"2024-07-24T16:37:45.667472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:40.906131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668459+0000","last_change":"2024-07-24T16:37:02.999430+0000","last_active":"2024-07-24T16:37:45.668459+0000","last_peered":"2024-07-24T16:37:45.668459+0000","last_clean":"2024-07-24T16:37:45.668459+0000","last_became_active":"2024-07-24T16:37:02.999177+0000","last_became_peered":"2024-07-24T16:37:02.999177+0000","last_unstale":"2024-07-24T16:37:45.668459+0000","last_undegraded":"2024-07-24T16:37:45.668459+0000","last_fullsized":"2024-07-24T16:37:45.668459+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:14:39.765664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668584+0000","last_change":"2024-07-24T16:37:04.005041+0000","last_active":"2024-07-24T16:37:45.668584+0000","last_peered":"2024-07-24T16:37:45.668584+0000","last_clean":"2024-07-24T16:37:45.668584+0000","last_became_active":"2024-07-24T16:37:04.004752+0000","last_became_peered":"2024-07-24T16:37:04.004752+0000","last_unstale":"2024-07-24T16:37:45.668584+0000","last_undegraded":"2024-07-24T16:37:45.668584+0000","last_fullsized":"2024-07-24T16:37:45.668584+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:28:48.788361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665668+0000","last_change":"2024-07-24T16:37:03.013833+0000","last_active":"2024-07-24T16:37:45.665668+0000","last_peered":"2024-07-24T16:37:45.665668+0000","last_clean":"2024-07-24T16:37:45.665668+0000","last_became_active":"2024-07-24T16:37:03.013501+0000","last_became_peered":"2024-07-24T16:37:03.013501+0000","last_unstale":"2024-07-24T16:37:45.665668+0000","last_undegraded":"2024-07-24T16:37:45.665668+0000","last_fullsized":"2024-07-24T16:37:45.665668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:55.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075387+0000","last_change":"2024-07-24T16:37:04.008541+0000","last_active":"2024-07-24T16:37:46.075387+0000","last_peered":"2024-07-24T16:37:46.075387+0000","last_clean":"2024-07-24T16:37:46.075387+0000","last_became_active":"2024-07-24T16:37:04.008251+0000","last_became_peered":"2024-07-24T16:37:04.008251+0000","last_unstale":"2024-07-24T16:37:46.075387+0000","last_undegraded":"2024-07-24T16:37:46.075387+0000","last_fullsized":"2024-07-24T16:37:46.075387+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:23:03.807268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667230+0000","last_change":"2024-07-24T16:37:03.000053+0000","last_active":"2024-07-24T16:37:45.667230+0000","last_peered":"2024-07-24T16:37:45.667230+0000","last_clean":"2024-07-24T16:37:45.667230+0000","last_became_active":"2024-07-24T16:37:02.999733+0000","last_became_peered":"2024-07-24T16:37:02.999733+0000","last_unstale":"2024-07-24T16:37:45.667230+0000","last_undegraded":"2024-07-24T16:37:45.667230+0000","last_fullsized":"2024-07-24T16:37:45.667230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:43:16.732334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075007+0000","last_change":"2024-07-24T16:37:04.008622+0000","last_active":"2024-07-24T16:37:46.075007+0000","last_peered":"2024-07-24T16:37:46.075007+0000","last_clean":"2024-07-24T16:37:46.075007+0000","last_became_active":"2024-07-24T16:37:04.008293+0000","last_became_peered":"2024-07-24T16:37:04.008293+0000","last_unstale":"2024-07-24T16:37:46.075007+0000","last_undegraded":"2024-07-24T16:37:46.075007+0000","last_fullsized":"2024-07-24T16:37:46.075007+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:45:10.486075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074858+0000","last_change":"2024-07-24T16:37:03.005837+0000","last_active":"2024-07-24T16:37:46.074858+0000","last_peered":"2024-07-24T16:37:46.074858+0000","last_clean":"2024-07-24T16:37:46.074858+0000","last_became_active":"2024-07-24T16:37:03.005494+0000","last_became_peered":"2024-07-24T16:37:03.005494+0000","last_unstale":"2024-07-24T16:37:46.074858+0000","last_undegraded":"2024-07-24T16:37:46.074858+0000","last_fullsized":"2024-07-24T16:37:46.074858+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:19.152923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669257+0000","last_change":"2024-07-24T16:37:04.001679+0000","last_active":"2024-07-24T16:37:45.669257+0000","last_peered":"2024-07-24T16:37:45.669257+0000","last_clean":"2024-07-24T16:37:45.669257+0000","last_became_active":"2024-07-24T16:37:04.001396+0000","last_became_peered":"2024-07-24T16:37:04.001396+0000","last_unstale":"2024-07-24T16:37:45.669257+0000","last_undegraded":"2024-07-24T16:37:45.669257+0000","last_fullsized":"2024-07-24T16:37:45.669257+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:48.147517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667397+0000","last_change":"2024-07-24T16:37:03.003994+0000","last_active":"2024-07-24T16:37:45.667397+0000","last_peered":"2024-07-24T16:37:45.667397+0000","last_clean":"2024-07-24T16:37:45.667397+0000","last_became_active":"2024-07-24T16:37:03.003689+0000","last_became_peered":"2024-07-24T16:37:03.003689+0000","last_unstale":"2024-07-24T16:37:45.667397+0000","last_undegraded":"2024-07-24T16:37:45.667397+0000","last_fullsized":"2024-07-24T16:37:45.667397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:17:37.057978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074994+0000","last_change":"2024-07-24T16:37:04.024282+0000","last_active":"2024-07-24T16:37:46.074994+0000","last_peered":"2024-07-24T16:37:46.074994+0000","last_clean":"2024-07-24T16:37:46.074994+0000","last_became_active":"2024-07-24T16:37:04.024040+0000","last_became_peered":"2024-07-24T16:37:04.024040+0000","last_unstale":"2024-07-24T16:37:46.074994+0000","last_undegraded":"2024-07-24T16:37:46.074994+0000","last_fullsized":"2024-07-24T16:37:46.074994+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:55.570490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666848+0000","last_change":"2024-07-24T16:37:02.999879+0000","last_active":"2024-07-24T16:37:45.666848+0000","last_peered":"2024-07-24T16:37:45.666848+0000","last_clean":"2024-07-24T16:37:45.666848+0000","last_became_active":"2024-07-24T16:37:02.999554+0000","last_became_peered":"2024-07-24T16:37:02.999554+0000","last_unstale":"2024-07-24T16:37:45.666848+0000","last_undegraded":"2024-07-24T16:37:45.666848+0000","last_fullsized":"2024-07-24T16:37:45.666848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:10:25.228026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074597+0000","last_change":"2024-07-24T16:37:04.012481+0000","last_active":"2024-07-24T16:37:46.074597+0000","last_peered":"2024-07-24T16:37:46.074597+0000","last_clean":"2024-07-24T16:37:46.074597+0000","last_became_active":"2024-07-24T16:37:04.012217+0000","last_became_peered":"2024-07-24T16:37:04.012217+0000","last_unstale":"2024-07-24T16:37:46.074597+0000","last_undegraded":"2024-07-24T16:37:46.074597+0000","last_fullsized":"2024-07-24T16:37:46.074597+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:10:47.439606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075111+0000","last_change":"2024-07-24T16:37:03.005534+0000","last_active":"2024-07-24T16:37:46.075111+0000","last_peered":"2024-07-24T16:37:46.075111+0000","last_clean":"2024-07-24T16:37:46.075111+0000","last_became_active":"2024-07-24T16:37:03.005232+0000","last_became_peered":"2024-07-24T16:37:03.005232+0000","last_unstale":"2024-07-24T16:37:46.075111+0000","last_undegraded":"2024-07-24T16:37:46.075111+0000","last_fullsized":"2024-07-24T16:37:46.075111+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:18:00.748831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665427+0000","last_change":"2024-07-24T16:37:03.995253+0000","last_active":"2024-07-24T16:37:45.665427+0000","last_peered":"2024-07-24T16:37:45.665427+0000","last_clean":"2024-07-24T16:37:45.665427+0000","last_became_active":"2024-07-24T16:37:03.994904+0000","last_became_peered":"2024-07-24T16:37:03.994904+0000","last_unstale":"2024-07-24T16:37:45.665427+0000","last_undegraded":"2024-07-24T16:37:45.665427+0000","last_fullsized":"2024-07-24T16:37:45.665427+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:55.570490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075316+0000","last_change":"2024-07-24T16:37:03.004109+0000","last_active":"2024-07-24T16:37:46.075316+0000","last_peered":"2024-07-24T16:37:46.075316+0000","last_clean":"2024-07-24T16:37:46.075316+0000","last_became_active":"2024-07-24T16:37:03.003813+0000","last_became_peered":"2024-07-24T16:37:03.003813+0000","last_unstale":"2024-07-24T16:37:46.075316+0000","last_undegraded":"2024-07-24T16:37:46.075316+0000","last_fullsized":"2024-07-24T16:37:46.075316+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:44.069876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667153+0000","last_change":"2024-07-24T16:37:04.015827+0000","last_active":"2024-07-24T16:37:45.667153+0000","last_peered":"2024-07-24T16:37:45.667153+0000","last_clean":"2024-07-24T16:37:45.667153+0000","last_became_active":"2024-07-24T16:37:04.015577+0000","last_became_peered":"2024-07-24T16:37:04.015577+0000","last_unstale":"2024-07-24T16:37:45.667153+0000","last_undegraded":"2024-07-24T16:37:45.667153+0000","last_fullsized":"2024-07-24T16:37:45.667153+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:38:58.077671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"62'3","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075330+0000","last_change":"2024-07-24T16:37:03.002358+0000","last_active":"2024-07-24T16:37:46.075330+0000","last_peered":"2024-07-24T16:37:46.075330+0000","last_clean":"2024-07-24T16:37:46.075330+0000","last_became_active":"2024-07-24T16:37:03.001970+0000","last_became_peered":"2024-07-24T16:37:03.001970+0000","last_unstale":"2024-07-24T16:37:46.075330+0000","last_undegraded":"2024-07-24T16:37:46.075330+0000","last_fullsized":"2024-07-24T16:37:46.075330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:18:18.548923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075114+0000","last_change":"2024-07-24T16:37:03.996498+0000","last_active":"2024-07-24T16:37:46.075114+0000","last_peered":"2024-07-24T16:37:46.075114+0000","last_clean":"2024-07-24T16:37:46.075114+0000","last_became_active":"2024-07-24T16:37:03.996235+0000","last_became_peered":"2024-07-24T16:37:03.996235+0000","last_unstale":"2024-07-24T16:37:46.075114+0000","last_undegraded":"2024-07-24T16:37:46.075114+0000","last_fullsized":"2024-07-24T16:37:46.075114+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:50:22.080512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"63'8","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669496+0000","last_change":"2024-07-24T16:37:03.008087+0000","last_active":"2024-07-24T16:37:45.669496+0000","last_peered":"2024-07-24T16:37:45.669496+0000","last_clean":"2024-07-24T16:37:45.669496+0000","last_became_active":"2024-07-24T16:37:03.007813+0000","last_became_peered":"2024-07-24T16:37:03.007813+0000","last_unstale":"2024-07-24T16:37:45.669496+0000","last_undegraded":"2024-07-24T16:37:45.669496+0000","last_fullsized":"2024-07-24T16:37:45.669496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:45:09.480096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2855,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665800+0000","last_change":"2024-07-24T16:37:04.007864+0000","last_active":"2024-07-24T16:37:45.665800+0000","last_peered":"2024-07-24T16:37:45.665800+0000","last_clean":"2024-07-24T16:37:45.665800+0000","last_became_active":"2024-07-24T16:37:04.007559+0000","last_became_peered":"2024-07-24T16:37:04.007559+0000","last_unstale":"2024-07-24T16:37:45.665800+0000","last_undegraded":"2024-07-24T16:37:45.665800+0000","last_fullsized":"2024-07-24T16:37:45.665800+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:40:36.400835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667273+0000","last_change":"2024-07-24T16:37:03.003657+0000","last_active":"2024-07-24T16:37:45.667273+0000","last_peered":"2024-07-24T16:37:45.667273+0000","last_clean":"2024-07-24T16:37:45.667273+0000","last_became_active":"2024-07-24T16:37:03.003386+0000","last_became_peered":"2024-07-24T16:37:03.003386+0000","last_unstale":"2024-07-24T16:37:45.667273+0000","last_undegraded":"2024-07-24T16:37:45.667273+0000","last_fullsized":"2024-07-24T16:37:45.667273+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:08:09.502445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667518+0000","last_change":"2024-07-24T16:37:04.019133+0000","last_active":"2024-07-24T16:37:45.667518+0000","last_peered":"2024-07-24T16:37:45.667518+0000","last_clean":"2024-07-24T16:37:45.667518+0000","last_became_active":"2024-07-24T16:37:04.018826+0000","last_became_peered":"2024-07-24T16:37:04.018826+0000","last_unstale":"2024-07-24T16:37:45.667518+0000","last_undegraded":"2024-07-24T16:37:45.667518+0000","last_fullsized":"2024-07-24T16:37:45.667518+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:56.542664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667503+0000","last_change":"2024-07-24T16:37:03.003836+0000","last_active":"2024-07-24T16:37:45.667503+0000","last_peered":"2024-07-24T16:37:45.667503+0000","last_clean":"2024-07-24T16:37:45.667503+0000","last_became_active":"2024-07-24T16:37:03.003542+0000","last_became_peered":"2024-07-24T16:37:03.003542+0000","last_unstale":"2024-07-24T16:37:45.667503+0000","last_undegraded":"2024-07-24T16:37:45.667503+0000","last_fullsized":"2024-07-24T16:37:45.667503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:40:08.258903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669476+0000","last_change":"2024-07-24T16:37:04.011095+0000","last_active":"2024-07-24T16:37:45.669476+0000","last_peered":"2024-07-24T16:37:45.669476+0000","last_clean":"2024-07-24T16:37:45.669476+0000","last_became_active":"2024-07-24T16:37:04.010791+0000","last_became_peered":"2024-07-24T16:37:04.010791+0000","last_unstale":"2024-07-24T16:37:45.669476+0000","last_undegraded":"2024-07-24T16:37:45.669476+0000","last_fullsized":"2024-07-24T16:37:45.669476+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:53:23.625615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074790+0000","last_change":"2024-07-24T16:37:03.010829+0000","last_active":"2024-07-24T16:37:46.074790+0000","last_peered":"2024-07-24T16:37:46.074790+0000","last_clean":"2024-07-24T16:37:46.074790+0000","last_became_active":"2024-07-24T16:37:03.010566+0000","last_became_peered":"2024-07-24T16:37:03.010566+0000","last_unstale":"2024-07-24T16:37:46.074790+0000","last_undegraded":"2024-07-24T16:37:46.074790+0000","last_fullsized":"2024-07-24T16:37:46.074790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:58:26.392478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667702+0000","last_change":"2024-07-24T16:37:04.023416+0000","last_active":"2024-07-24T16:37:45.667702+0000","last_peered":"2024-07-24T16:37:45.667702+0000","last_clean":"2024-07-24T16:37:45.667702+0000","last_became_active":"2024-07-24T16:37:04.020968+0000","last_became_peered":"2024-07-24T16:37:04.020968+0000","last_unstale":"2024-07-24T16:37:45.667702+0000","last_undegraded":"2024-07-24T16:37:45.667702+0000","last_fullsized":"2024-07-24T16:37:45.667702+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:51:49.010336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"62'8","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668973+0000","last_change":"2024-07-24T16:37:03.006180+0000","last_active":"2024-07-24T16:37:45.668973+0000","last_peered":"2024-07-24T16:37:45.668973+0000","last_clean":"2024-07-24T16:37:45.668973+0000","last_became_active":"2024-07-24T16:37:03.005719+0000","last_became_peered":"2024-07-24T16:37:03.005719+0000","last_unstale":"2024-07-24T16:37:45.668973+0000","last_undegraded":"2024-07-24T16:37:45.668973+0000","last_fullsized":"2024-07-24T16:37:45.668973+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:05.170486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669046+0000","last_change":"2024-07-24T16:37:04.005089+0000","last_active":"2024-07-24T16:37:45.669046+0000","last_peered":"2024-07-24T16:37:45.669046+0000","last_clean":"2024-07-24T16:37:45.669046+0000","last_became_active":"2024-07-24T16:37:04.004750+0000","last_became_peered":"2024-07-24T16:37:04.004750+0000","last_unstale":"2024-07-24T16:37:45.669046+0000","last_undegraded":"2024-07-24T16:37:45.669046+0000","last_fullsized":"2024-07-24T16:37:45.669046+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:34:37.325695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667924+0000","last_change":"2024-07-24T16:37:03.013805+0000","last_active":"2024-07-24T16:37:45.667924+0000","last_peered":"2024-07-24T16:37:45.667924+0000","last_clean":"2024-07-24T16:37:45.667924+0000","last_became_active":"2024-07-24T16:37:03.013485+0000","last_became_peered":"2024-07-24T16:37:03.013485+0000","last_unstale":"2024-07-24T16:37:45.667924+0000","last_undegraded":"2024-07-24T16:37:45.667924+0000","last_fullsized":"2024-07-24T16:37:45.667924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:45:47.297991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668160+0000","last_change":"2024-07-24T16:37:04.019820+0000","last_active":"2024-07-24T16:37:45.668160+0000","last_peered":"2024-07-24T16:37:45.668160+0000","last_clean":"2024-07-24T16:37:45.668160+0000","last_became_active":"2024-07-24T16:37:04.019539+0000","last_became_peered":"2024-07-24T16:37:04.019539+0000","last_unstale":"2024-07-24T16:37:45.668160+0000","last_undegraded":"2024-07-24T16:37:45.668160+0000","last_fullsized":"2024-07-24T16:37:45.668160+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:50:22.080512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074705+0000","last_change":"2024-07-24T16:37:02.998295+0000","last_active":"2024-07-24T16:37:46.074705+0000","last_peered":"2024-07-24T16:37:46.074705+0000","last_clean":"2024-07-24T16:37:46.074705+0000","last_became_active":"2024-07-24T16:37:02.998007+0000","last_became_peered":"2024-07-24T16:37:02.998007+0000","last_unstale":"2024-07-24T16:37:46.074705+0000","last_undegraded":"2024-07-24T16:37:46.074705+0000","last_fullsized":"2024-07-24T16:37:46.074705+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:32:49.184726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074828+0000","last_change":"2024-07-24T16:37:04.022338+0000","last_active":"2024-07-24T16:37:46.074828+0000","last_peered":"2024-07-24T16:37:46.074828+0000","last_clean":"2024-07-24T16:37:46.074828+0000","last_became_active":"2024-07-24T16:37:04.022113+0000","last_became_peered":"2024-07-24T16:37:04.022113+0000","last_unstale":"2024-07-24T16:37:46.074828+0000","last_undegraded":"2024-07-24T16:37:46.074828+0000","last_fullsized":"2024-07-24T16:37:46.074828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:26:46.966508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667700+0000","last_change":"2024-07-24T16:37:03.001292+0000","last_active":"2024-07-24T16:37:45.667700+0000","last_peered":"2024-07-24T16:37:45.667700+0000","last_clean":"2024-07-24T16:37:45.667700+0000","last_became_active":"2024-07-24T16:37:03.001003+0000","last_became_peered":"2024-07-24T16:37:03.001003+0000","last_unstale":"2024-07-24T16:37:45.667700+0000","last_undegraded":"2024-07-24T16:37:45.667700+0000","last_fullsized":"2024-07-24T16:37:45.667700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:51:36.249129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668277+0000","last_change":"2024-07-24T16:37:03.999104+0000","last_active":"2024-07-24T16:37:45.668277+0000","last_peered":"2024-07-24T16:37:45.668277+0000","last_clean":"2024-07-24T16:37:45.668277+0000","last_became_active":"2024-07-24T16:37:03.998825+0000","last_became_peered":"2024-07-24T16:37:03.998825+0000","last_unstale":"2024-07-24T16:37:45.668277+0000","last_undegraded":"2024-07-24T16:37:45.668277+0000","last_fullsized":"2024-07-24T16:37:45.668277+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:10:47.439606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667674+0000","last_change":"2024-07-24T16:37:03.013889+0000","last_active":"2024-07-24T16:37:45.667674+0000","last_peered":"2024-07-24T16:37:45.667674+0000","last_clean":"2024-07-24T16:37:45.667674+0000","last_became_active":"2024-07-24T16:37:03.013550+0000","last_became_peered":"2024-07-24T16:37:03.013550+0000","last_unstale":"2024-07-24T16:37:45.667674+0000","last_undegraded":"2024-07-24T16:37:45.667674+0000","last_fullsized":"2024-07-24T16:37:45.667674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:32.419679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665609+0000","last_change":"2024-07-24T16:37:04.000366+0000","last_active":"2024-07-24T16:37:45.665609+0000","last_peered":"2024-07-24T16:37:45.665609+0000","last_clean":"2024-07-24T16:37:45.665609+0000","last_became_active":"2024-07-24T16:37:04.000074+0000","last_became_peered":"2024-07-24T16:37:04.000074+0000","last_unstale":"2024-07-24T16:37:45.665609+0000","last_undegraded":"2024-07-24T16:37:45.665609+0000","last_fullsized":"2024-07-24T16:37:45.665609+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:13:56.585430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668328+0000","last_change":"2024-07-24T16:37:02.995822+0000","last_active":"2024-07-24T16:37:45.668328+0000","last_peered":"2024-07-24T16:37:45.668328+0000","last_clean":"2024-07-24T16:37:45.668328+0000","last_became_active":"2024-07-24T16:37:02.995536+0000","last_became_peered":"2024-07-24T16:37:02.995536+0000","last_unstale":"2024-07-24T16:37:45.668328+0000","last_undegraded":"2024-07-24T16:37:45.668328+0000","last_fullsized":"2024-07-24T16:37:45.668328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:00:55.075881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667752+0000","last_change":"2024-07-24T16:37:04.004492+0000","last_active":"2024-07-24T16:37:45.667752+0000","last_peered":"2024-07-24T16:37:45.667752+0000","last_clean":"2024-07-24T16:37:45.667752+0000","last_became_active":"2024-07-24T16:37:04.004210+0000","last_became_peered":"2024-07-24T16:37:04.004210+0000","last_unstale":"2024-07-24T16:37:45.667752+0000","last_undegraded":"2024-07-24T16:37:45.667752+0000","last_fullsized":"2024-07-24T16:37:45.667752+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:28:19.279886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668948+0000","last_change":"2024-07-24T16:37:03.007200+0000","last_active":"2024-07-24T16:37:45.668948+0000","last_peered":"2024-07-24T16:37:45.668948+0000","last_clean":"2024-07-24T16:37:45.668948+0000","last_became_active":"2024-07-24T16:37:03.006461+0000","last_became_peered":"2024-07-24T16:37:03.006461+0000","last_unstale":"2024-07-24T16:37:45.668948+0000","last_undegraded":"2024-07-24T16:37:45.668948+0000","last_fullsized":"2024-07-24T16:37:45.668948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:58:10.465983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667633+0000","last_change":"2024-07-24T16:37:04.011548+0000","last_active":"2024-07-24T16:37:45.667633+0000","last_peered":"2024-07-24T16:37:45.667633+0000","last_clean":"2024-07-24T16:37:45.667633+0000","last_became_active":"2024-07-24T16:37:04.011301+0000","last_became_peered":"2024-07-24T16:37:04.011301+0000","last_unstale":"2024-07-24T16:37:45.667633+0000","last_undegraded":"2024-07-24T16:37:45.667633+0000","last_fullsized":"2024-07-24T16:37:45.667633+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:18:19.554902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666987+0000","last_change":"2024-07-24T16:37:03.000155+0000","last_active":"2024-07-24T16:37:45.666987+0000","last_peered":"2024-07-24T16:37:45.666987+0000","last_clean":"2024-07-24T16:37:45.666987+0000","last_became_active":"2024-07-24T16:37:02.999863+0000","last_became_peered":"2024-07-24T16:37:02.999863+0000","last_unstale":"2024-07-24T16:37:45.666987+0000","last_undegraded":"2024-07-24T16:37:45.666987+0000","last_fullsized":"2024-07-24T16:37:45.666987+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:03.005579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668338+0000","last_change":"2024-07-24T16:37:04.009717+0000","last_active":"2024-07-24T16:37:45.668338+0000","last_peered":"2024-07-24T16:37:45.668338+0000","last_clean":"2024-07-24T16:37:45.668338+0000","last_became_active":"2024-07-24T16:37:04.009453+0000","last_became_peered":"2024-07-24T16:37:04.009453+0000","last_unstale":"2024-07-24T16:37:45.668338+0000","last_undegraded":"2024-07-24T16:37:45.668338+0000","last_fullsized":"2024-07-24T16:37:45.668338+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:23:03.807268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074402+0000","last_change":"2024-07-24T16:37:03.000905+0000","last_active":"2024-07-24T16:37:46.074402+0000","last_peered":"2024-07-24T16:37:46.074402+0000","last_clean":"2024-07-24T16:37:46.074402+0000","last_became_active":"2024-07-24T16:37:03.000630+0000","last_became_peered":"2024-07-24T16:37:03.000630+0000","last_unstale":"2024-07-24T16:37:46.074402+0000","last_undegraded":"2024-07-24T16:37:46.074402+0000","last_fullsized":"2024-07-24T16:37:46.074402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:26:24.140079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665444+0000","last_change":"2024-07-24T16:37:04.001385+0000","last_active":"2024-07-24T16:37:45.665444+0000","last_peered":"2024-07-24T16:37:45.665444+0000","last_clean":"2024-07-24T16:37:45.665444+0000","last_became_active":"2024-07-24T16:37:04.001124+0000","last_became_peered":"2024-07-24T16:37:04.001124+0000","last_unstale":"2024-07-24T16:37:45.665444+0000","last_undegraded":"2024-07-24T16:37:45.665444+0000","last_fullsized":"2024-07-24T16:37:45.665444+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:34.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667832+0000","last_change":"2024-07-24T16:37:03.003668+0000","last_active":"2024-07-24T16:37:45.667832+0000","last_peered":"2024-07-24T16:37:45.667832+0000","last_clean":"2024-07-24T16:37:45.667832+0000","last_became_active":"2024-07-24T16:37:03.003387+0000","last_became_peered":"2024-07-24T16:37:03.003387+0000","last_unstale":"2024-07-24T16:37:45.667832+0000","last_undegraded":"2024-07-24T16:37:45.667832+0000","last_fullsized":"2024-07-24T16:37:45.667832+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:50:35.318606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668412+0000","last_change":"2024-07-24T16:37:04.000123+0000","last_active":"2024-07-24T16:37:45.668412+0000","last_peered":"2024-07-24T16:37:45.668412+0000","last_clean":"2024-07-24T16:37:45.668412+0000","last_became_active":"2024-07-24T16:37:03.999841+0000","last_became_peered":"2024-07-24T16:37:03.999841+0000","last_unstale":"2024-07-24T16:37:45.668412+0000","last_undegraded":"2024-07-24T16:37:45.668412+0000","last_fullsized":"2024-07-24T16:37:45.668412+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:26:46.966508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075276+0000","last_change":"2024-07-24T16:37:03.003110+0000","last_active":"2024-07-24T16:37:46.075276+0000","last_peered":"2024-07-24T16:37:46.075276+0000","last_clean":"2024-07-24T16:37:46.075276+0000","last_became_active":"2024-07-24T16:37:03.002819+0000","last_became_peered":"2024-07-24T16:37:03.002819+0000","last_unstale":"2024-07-24T16:37:46.075276+0000","last_undegraded":"2024-07-24T16:37:46.075276+0000","last_fullsized":"2024-07-24T16:37:46.075276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:32:42.309475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669126+0000","last_change":"2024-07-24T16:37:04.007895+0000","last_active":"2024-07-24T16:37:45.669126+0000","last_peered":"2024-07-24T16:37:45.669126+0000","last_clean":"2024-07-24T16:37:45.669126+0000","last_became_active":"2024-07-24T16:37:04.007614+0000","last_became_peered":"2024-07-24T16:37:04.007614+0000","last_unstale":"2024-07-24T16:37:45.669126+0000","last_undegraded":"2024-07-24T16:37:45.669126+0000","last_fullsized":"2024-07-24T16:37:45.669126+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:36:32.427250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667342+0000","last_change":"2024-07-24T16:37:03.002515+0000","last_active":"2024-07-24T16:37:45.667342+0000","last_peered":"2024-07-24T16:37:45.667342+0000","last_clean":"2024-07-24T16:37:45.667342+0000","last_became_active":"2024-07-24T16:37:03.002219+0000","last_became_peered":"2024-07-24T16:37:03.002219+0000","last_unstale":"2024-07-24T16:37:45.667342+0000","last_undegraded":"2024-07-24T16:37:45.667342+0000","last_fullsized":"2024-07-24T16:37:45.667342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:29:44.553198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667412+0000","last_change":"2024-07-24T16:37:04.021367+0000","last_active":"2024-07-24T16:37:45.667412+0000","last_peered":"2024-07-24T16:37:45.667412+0000","last_clean":"2024-07-24T16:37:45.667412+0000","last_became_active":"2024-07-24T16:37:04.021059+0000","last_became_peered":"2024-07-24T16:37:04.021059+0000","last_unstale":"2024-07-24T16:37:45.667412+0000","last_undegraded":"2024-07-24T16:37:45.667412+0000","last_fullsized":"2024-07-24T16:37:45.667412+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:18:01.754809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669294+0000","last_change":"2024-07-24T16:37:03.009702+0000","last_active":"2024-07-24T16:37:45.669294+0000","last_peered":"2024-07-24T16:37:45.669294+0000","last_clean":"2024-07-24T16:37:45.669294+0000","last_became_active":"2024-07-24T16:37:03.009216+0000","last_became_peered":"2024-07-24T16:37:03.009216+0000","last_unstale":"2024-07-24T16:37:45.669294+0000","last_undegraded":"2024-07-24T16:37:45.669294+0000","last_fullsized":"2024-07-24T16:37:45.669294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:33.301368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665544+0000","last_change":"2024-07-24T16:37:04.007332+0000","last_active":"2024-07-24T16:37:45.665544+0000","last_peered":"2024-07-24T16:37:45.665544+0000","last_clean":"2024-07-24T16:37:45.665544+0000","last_became_active":"2024-07-24T16:37:04.007096+0000","last_became_peered":"2024-07-24T16:37:04.007096+0000","last_unstale":"2024-07-24T16:37:45.665544+0000","last_undegraded":"2024-07-24T16:37:45.665544+0000","last_fullsized":"2024-07-24T16:37:45.665544+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:23:03.806832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669021+0000","last_change":"2024-07-24T16:37:03.008273+0000","last_active":"2024-07-24T16:37:45.669021+0000","last_peered":"2024-07-24T16:37:45.669021+0000","last_clean":"2024-07-24T16:37:45.669021+0000","last_became_active":"2024-07-24T16:37:03.008025+0000","last_became_peered":"2024-07-24T16:37:03.008025+0000","last_unstale":"2024-07-24T16:37:45.669021+0000","last_undegraded":"2024-07-24T16:37:45.669021+0000","last_fullsized":"2024-07-24T16:37:45.669021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:54.564511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667613+0000","last_change":"2024-07-24T16:37:04.018001+0000","last_active":"2024-07-24T16:37:45.667613+0000","last_peered":"2024-07-24T16:37:45.667613+0000","last_clean":"2024-07-24T16:37:45.667613+0000","last_became_active":"2024-07-24T16:37:04.017748+0000","last_became_peered":"2024-07-24T16:37:04.017748+0000","last_unstale":"2024-07-24T16:37:45.667613+0000","last_undegraded":"2024-07-24T16:37:45.667613+0000","last_fullsized":"2024-07-24T16:37:45.667613+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:58:27.398456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075393+0000","last_change":"2024-07-24T16:37:03.008246+0000","last_active":"2024-07-24T16:37:46.075393+0000","last_peered":"2024-07-24T16:37:46.075393+0000","last_clean":"2024-07-24T16:37:46.075393+0000","last_became_active":"2024-07-24T16:37:03.008010+0000","last_became_peered":"2024-07-24T16:37:03.008010+0000","last_unstale":"2024-07-24T16:37:46.075393+0000","last_undegraded":"2024-07-24T16:37:46.075393+0000","last_fullsized":"2024-07-24T16:37:46.075393+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:23.842357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669435+0000","last_change":"2024-07-24T16:37:04.004696+0000","last_active":"2024-07-24T16:37:45.669435+0000","last_peered":"2024-07-24T16:37:45.669435+0000","last_clean":"2024-07-24T16:37:45.669435+0000","last_became_active":"2024-07-24T16:37:04.004446+0000","last_became_peered":"2024-07-24T16:37:04.004446+0000","last_unstale":"2024-07-24T16:37:45.669435+0000","last_undegraded":"2024-07-24T16:37:45.669435+0000","last_fullsized":"2024-07-24T16:37:45.669435+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:33:56.086626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665618+0000","last_change":"2024-07-24T16:37:02.997130+0000","last_active":"2024-07-24T16:37:45.665618+0000","last_peered":"2024-07-24T16:37:45.665618+0000","last_clean":"2024-07-24T16:37:45.665618+0000","last_became_active":"2024-07-24T16:37:02.996841+0000","last_became_peered":"2024-07-24T16:37:02.996841+0000","last_unstale":"2024-07-24T16:37:45.665618+0000","last_undegraded":"2024-07-24T16:37:45.665618+0000","last_fullsized":"2024-07-24T16:37:45.665618+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:27:02.167426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667380+0000","last_change":"2024-07-24T16:37:04.005886+0000","last_active":"2024-07-24T16:37:45.667380+0000","last_peered":"2024-07-24T16:37:45.667380+0000","last_clean":"2024-07-24T16:37:45.667380+0000","last_became_active":"2024-07-24T16:37:04.005578+0000","last_became_peered":"2024-07-24T16:37:04.005578+0000","last_unstale":"2024-07-24T16:37:45.667380+0000","last_undegraded":"2024-07-24T16:37:45.667380+0000","last_fullsized":"2024-07-24T16:37:45.667380+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:32:24.649601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"65'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667754+0000","last_change":"2024-07-24T16:37:03.002115+0000","last_active":"2024-07-24T16:37:45.667754+0000","last_peered":"2024-07-24T16:37:45.667754+0000","last_clean":"2024-07-24T16:37:45.667754+0000","last_became_active":"2024-07-24T16:37:03.001758+0000","last_became_peered":"2024-07-24T16:37:03.001758+0000","last_unstale":"2024-07-24T16:37:45.667754+0000","last_undegraded":"2024-07-24T16:37:45.667754+0000","last_fullsized":"2024-07-24T16:37:45.667754+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:10:49.225665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'86","reported_seq":249,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074704+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:37:46.074704+0000","last_peered":"2024-07-24T16:37:46.074704+0000","last_clean":"2024-07-24T16:37:46.074704+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:37:46.074704+0000","last_undegraded":"2024-07-24T16:37:46.074704+0000","last_fullsized":"2024-07-24T16:37:46.074704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":3653,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575032,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54736,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317104,"statfs":{"total":96636764160,"available":96580714496,"internally_reserved":0,"allocated":1380352,"data_stored":977699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":387859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575032,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49988,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321852,"statfs":{"total":96636764160,"available":96585576448,"internally_reserved":0,"allocated":778240,"data_stored":387207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575033,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":387789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575033,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":794624,"data_stored":390084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54160,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317680,"statfs":{"total":96636764160,"available":96581304320,"internally_reserved":0,"allocated":790528,"data_stored":390062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575032,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":387367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575033,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1380352,"data_stored":977631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:39:12.199 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-07-24T16:39:12.199 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:39:12.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.337+0000 7fe929760640 1 -- 172.21.15.159:0/2993985908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9240d1350 msgr2=0x7fe9240b7510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:12.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.337+0000 7fe929760640 1 --2- 172.21.15.159:0/2993985908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9240d1350 0x7fe9240b7510 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fe91c005fd0 tx=0x7fe91c02a540 comp rx=0 tx=0).stop 2024-07-24T16:39:12.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.337+0000 7fe929760640 1 -- 172.21.15.159:0/2993985908 shutdown_connections 2024-07-24T16:39:12.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.337+0000 7fe929760640 1 --2- 172.21.15.159:0/2993985908 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe9240d2270 0x7fe9240b6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.337+0000 7fe929760640 1 --2- 172.21.15.159:0/2993985908 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9240d1350 0x7fe9240b7510 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.337+0000 7fe929760640 1 -- 172.21.15.159:0/2993985908 >> 172.21.15.159:0/2993985908 conn(0x7fe9240d3810 msgr2=0x7fe9240d3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:12.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.337+0000 7fe929760640 1 -- 172.21.15.159:0/2993985908 shutdown_connections 2024-07-24T16:39:12.341 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.337+0000 7fe929760640 1 -- 172.21.15.159:0/2993985908 wait complete. 2024-07-24T16:39:12.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.339+0000 7fe929760640 1 Processor -- start 2024-07-24T16:39:12.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.339+0000 7fe929760640 1 -- start start 2024-07-24T16:39:12.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.339+0000 7fe929760640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe9240b5290 0x7fe9241e85a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:12.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.339+0000 7fe929760640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9240d1350 0x7fe9240cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:12.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.339+0000 7fe929760640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9240d2270 0x7fe924144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:12.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.339+0000 7fe929760640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fe9240b7de0 con 0x7fe9240d1350 2024-07-24T16:39:12.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.339+0000 7fe929760640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fe9240b7c60 con 0x7fe9240d2270 2024-07-24T16:39:12.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.339+0000 7fe929760640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fe9240b7f60 con 0x7fe9240b5290 2024-07-24T16:39:12.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.339+0000 7fe9227fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9240d1350 0x7fe9240cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:12.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.339+0000 7fe9227fc640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9240d1350 0x7fe9240cbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49784/0 (socket says 172.21.15.159:49784) 2024-07-24T16:39:12.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.339+0000 7fe9227fc640 1 -- 172.21.15.159:0/323235956 learned_addr learned my addr 172.21.15.159:0/323235956 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:12.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe922ffd640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe9240b5290 0x7fe9241e85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:12.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe9237fe640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9240d2270 0x7fe924144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:12.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe9227fc640 1 -- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe9240b5290 msgr2=0x7fe9241e85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:12.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe9227fc640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe9240b5290 0x7fe9241e85a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe9227fc640 1 -- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9240d2270 msgr2=0x7fe924144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:12.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe9227fc640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9240d2270 0x7fe924144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe9227fc640 1 -- 172.21.15.159:0/323235956 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9240cc8d0 con 0x7fe9240d1350 2024-07-24T16:39:12.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe9237fe640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9240d2270 0x7fe924144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:39:12.346 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe9227fc640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9240d1350 0x7fe9240cbf60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00d750 tx=0x7fe90c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:12.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe91b7fe640 1 -- 172.21.15.159:0/323235956 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c017070 con 0x7fe9240d1350 2024-07-24T16:39:12.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe91b7fe640 1 -- 172.21.15.159:0/323235956 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe90c009b10 con 0x7fe9240d1350 2024-07-24T16:39:12.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe929760640 1 -- 172.21.15.159:0/323235956 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9240ccbb0 con 0x7fe9240d1350 2024-07-24T16:39:12.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe91b7fe640 1 -- 172.21.15.159:0/323235956 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe90c010460 con 0x7fe9240d1350 2024-07-24T16:39:12.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.340+0000 7fe929760640 1 -- 172.21.15.159:0/323235956 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9240cd170 con 0x7fe9240d1350 2024-07-24T16:39:12.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.341+0000 7fe929760640 1 -- 172.21.15.159:0/323235956 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9240b5670 con 0x7fe9240d1350 2024-07-24T16:39:12.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.342+0000 7fe91b7fe640 1 -- 172.21.15.159:0/323235956 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fe90c01a070 con 0x7fe9240d1350 2024-07-24T16:39:12.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.342+0000 7fe91b7fe640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe904077010 0x7fe9040794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:12.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.343+0000 7fe91b7fe640 1 -- 172.21.15.159:0/323235956 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7fe90c098ea0 con 0x7fe9240d1350 2024-07-24T16:39:12.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.343+0000 7fe922ffd640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe904077010 0x7fe9040794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:12.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.343+0000 7fe922ffd640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe904077010 0x7fe9040794d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe9140012e0 tx=0x7fe914009040 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:12.349 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.347+0000 7fe91b7fe640 1 -- 172.21.15.159:0/323235956 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fe90c061880 con 0x7fe9240d1350 2024-07-24T16:39:12.531 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.528+0000 7fe929760640 1 -- 172.21.15.159:0/323235956 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe92406a190 con 0x7fe904077010 2024-07-24T16:39:12.535 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.533+0000 7fe91b7fe640 1 -- 172.21.15.159:0/323235956 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251831 (secure 0 0 0) 0x7fe92406a190 con 0x7fe904077010 2024-07-24T16:39:12.538 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:39:12.539 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:39:12.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.536+0000 7fe929760640 1 -- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe904077010 msgr2=0x7fe9040794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:12.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.536+0000 7fe929760640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe904077010 0x7fe9040794d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe9140012e0 tx=0x7fe914009040 comp rx=0 tx=0).stop 2024-07-24T16:39:12.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.536+0000 7fe929760640 1 -- 172.21.15.159:0/323235956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9240d1350 msgr2=0x7fe9240cbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:12.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.536+0000 7fe929760640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9240d1350 0x7fe9240cbf60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fe90c00d750 tx=0x7fe90c00dc10 comp rx=0 tx=0).stop 2024-07-24T16:39:12.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.536+0000 7fe929760640 1 -- 172.21.15.159:0/323235956 shutdown_connections 2024-07-24T16:39:12.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.536+0000 7fe929760640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fe9240d2270 0x7fe924144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.536+0000 7fe929760640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fe904077010 0x7fe9040794d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.536+0000 7fe929760640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fe9240d1350 0x7fe9240cbf60 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.536+0000 7fe929760640 1 --2- 172.21.15.159:0/323235956 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fe9240b5290 0x7fe9241e85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.536+0000 7fe929760640 1 -- 172.21.15.159:0/323235956 >> 172.21.15.159:0/323235956 conn(0x7fe9240d3810 msgr2=0x7fe92415bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:12.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.536+0000 7fe929760640 1 -- 172.21.15.159:0/323235956 shutdown_connections 2024-07-24T16:39:12.542 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.536+0000 7fe929760640 1 -- 172.21.15.159:0/323235956 wait complete. 2024-07-24T16:39:12.550 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":89,"stamp":"2024-07-24T16:39:10.574496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594021,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":174,"num_write_kb":1645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319224,"kb_used_data":7304,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754655496,"statfs":{"total":773094113280,"available":772767227904,"internally_reserved":0,"allocated":7479296,"data_stored":4285698,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002297"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668281+0000","last_change":"2024-07-24T16:37:04.000283+0000","last_active":"2024-07-24T16:37:45.668281+0000","last_peered":"2024-07-24T16:37:45.668281+0000","last_clean":"2024-07-24T16:37:45.668281+0000","last_became_active":"2024-07-24T16:37:04.000007+0000","last_became_peered":"2024-07-24T16:37:04.000007+0000","last_unstale":"2024-07-24T16:37:45.668281+0000","last_undegraded":"2024-07-24T16:37:45.668281+0000","last_fullsized":"2024-07-24T16:37:45.668281+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:22:29.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075097+0000","last_change":"2024-07-24T16:37:04.011891+0000","last_active":"2024-07-24T16:37:46.075097+0000","last_peered":"2024-07-24T16:37:46.075097+0000","last_clean":"2024-07-24T16:37:46.075097+0000","last_became_active":"2024-07-24T16:37:04.011627+0000","last_became_peered":"2024-07-24T16:37:04.011627+0000","last_unstale":"2024-07-24T16:37:46.075097+0000","last_undegraded":"2024-07-24T16:37:46.075097+0000","last_fullsized":"2024-07-24T16:37:46.075097+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:06.176465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667446+0000","last_change":"2024-07-24T16:37:04.014901+0000","last_active":"2024-07-24T16:37:45.667446+0000","last_peered":"2024-07-24T16:37:45.667446+0000","last_clean":"2024-07-24T16:37:45.667446+0000","last_became_active":"2024-07-24T16:37:04.014649+0000","last_became_peered":"2024-07-24T16:37:04.014649+0000","last_unstale":"2024-07-24T16:37:45.667446+0000","last_undegraded":"2024-07-24T16:37:45.667446+0000","last_fullsized":"2024-07-24T16:37:45.667446+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:31:41.870538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075295+0000","last_change":"2024-07-24T16:37:04.011677+0000","last_active":"2024-07-24T16:37:46.075295+0000","last_peered":"2024-07-24T16:37:46.075295+0000","last_clean":"2024-07-24T16:37:46.075295+0000","last_became_active":"2024-07-24T16:37:04.011002+0000","last_became_peered":"2024-07-24T16:37:04.011002+0000","last_unstale":"2024-07-24T16:37:46.075295+0000","last_undegraded":"2024-07-24T16:37:46.075295+0000","last_fullsized":"2024-07-24T16:37:46.075295+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:36.298799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075070+0000","last_change":"2024-07-24T16:37:04.005188+0000","last_active":"2024-07-24T16:37:46.075070+0000","last_peered":"2024-07-24T16:37:46.075070+0000","last_clean":"2024-07-24T16:37:46.075070+0000","last_became_active":"2024-07-24T16:37:04.004895+0000","last_became_peered":"2024-07-24T16:37:04.004895+0000","last_unstale":"2024-07-24T16:37:46.075070+0000","last_undegraded":"2024-07-24T16:37:46.075070+0000","last_fullsized":"2024-07-24T16:37:46.075070+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:22:29.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668314+0000","last_change":"2024-07-24T16:37:04.009148+0000","last_active":"2024-07-24T16:37:45.668314+0000","last_peered":"2024-07-24T16:37:45.668314+0000","last_clean":"2024-07-24T16:37:45.668314+0000","last_became_active":"2024-07-24T16:37:04.008866+0000","last_became_peered":"2024-07-24T16:37:04.008866+0000","last_unstale":"2024-07-24T16:37:45.668314+0000","last_undegraded":"2024-07-24T16:37:45.668314+0000","last_fullsized":"2024-07-24T16:37:45.668314+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:08:08.449053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666777+0000","last_change":"2024-07-24T16:37:04.020944+0000","last_active":"2024-07-24T16:37:45.666777+0000","last_peered":"2024-07-24T16:37:45.666777+0000","last_clean":"2024-07-24T16:37:45.666777+0000","last_became_active":"2024-07-24T16:37:04.019103+0000","last_became_peered":"2024-07-24T16:37:04.019103+0000","last_unstale":"2024-07-24T16:37:45.666777+0000","last_undegraded":"2024-07-24T16:37:45.666777+0000","last_fullsized":"2024-07-24T16:37:45.666777+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:27:17.770264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":23,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.671500+0000","last_change":"2024-07-24T16:37:45.671415+0000","last_active":"2024-07-24T16:37:45.671500+0000","last_peered":"2024-07-24T16:37:45.671500+0000","last_clean":"2024-07-24T16:37:45.671500+0000","last_became_active":"2024-07-24T16:37:45.671060+0000","last_became_peered":"2024-07-24T16:37:45.671060+0000","last_unstale":"2024-07-24T16:37:45.671500+0000","last_undegraded":"2024-07-24T16:37:45.671500+0000","last_fullsized":"2024-07-24T16:37:45.671500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:54:47.659029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669317+0000","last_change":"2024-07-24T16:37:04.024211+0000","last_active":"2024-07-24T16:37:45.669317+0000","last_peered":"2024-07-24T16:37:45.669317+0000","last_clean":"2024-07-24T16:37:45.669317+0000","last_became_active":"2024-07-24T16:37:04.023933+0000","last_became_peered":"2024-07-24T16:37:04.023933+0000","last_unstale":"2024-07-24T16:37:45.669317+0000","last_undegraded":"2024-07-24T16:37:45.669317+0000","last_fullsized":"2024-07-24T16:37:45.669317+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:08:35.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668130+0000","last_change":"2024-07-24T16:37:03.998622+0000","last_active":"2024-07-24T16:37:45.668130+0000","last_peered":"2024-07-24T16:37:45.668130+0000","last_clean":"2024-07-24T16:37:45.668130+0000","last_became_active":"2024-07-24T16:37:03.997985+0000","last_became_peered":"2024-07-24T16:37:03.997985+0000","last_unstale":"2024-07-24T16:37:45.668130+0000","last_undegraded":"2024-07-24T16:37:45.668130+0000","last_fullsized":"2024-07-24T16:37:45.668130+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:08:12.604308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074662+0000","last_change":"2024-07-24T16:37:04.008205+0000","last_active":"2024-07-24T16:37:46.074662+0000","last_peered":"2024-07-24T16:37:46.074662+0000","last_clean":"2024-07-24T16:37:46.074662+0000","last_became_active":"2024-07-24T16:37:04.006298+0000","last_became_peered":"2024-07-24T16:37:04.006298+0000","last_unstale":"2024-07-24T16:37:46.074662+0000","last_undegraded":"2024-07-24T16:37:46.074662+0000","last_fullsized":"2024-07-24T16:37:46.074662+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:51:24.513752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669526+0000","last_change":"2024-07-24T16:37:04.006667+0000","last_active":"2024-07-24T16:37:45.669526+0000","last_peered":"2024-07-24T16:37:45.669526+0000","last_clean":"2024-07-24T16:37:45.669526+0000","last_became_active":"2024-07-24T16:37:04.005908+0000","last_became_peered":"2024-07-24T16:37:04.005908+0000","last_unstale":"2024-07-24T16:37:45.669526+0000","last_undegraded":"2024-07-24T16:37:45.669526+0000","last_fullsized":"2024-07-24T16:37:45.669526+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:17.192204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668121+0000","last_change":"2024-07-24T16:37:04.002494+0000","last_active":"2024-07-24T16:37:45.668121+0000","last_peered":"2024-07-24T16:37:45.668121+0000","last_clean":"2024-07-24T16:37:45.668121+0000","last_became_active":"2024-07-24T16:37:04.001872+0000","last_became_peered":"2024-07-24T16:37:04.001872+0000","last_unstale":"2024-07-24T16:37:45.668121+0000","last_undegraded":"2024-07-24T16:37:45.668121+0000","last_fullsized":"2024-07-24T16:37:45.668121+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:44.694240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667052+0000","last_change":"2024-07-24T16:37:04.018574+0000","last_active":"2024-07-24T16:37:45.667052+0000","last_peered":"2024-07-24T16:37:45.667052+0000","last_clean":"2024-07-24T16:37:45.667052+0000","last_became_active":"2024-07-24T16:37:04.018314+0000","last_became_peered":"2024-07-24T16:37:04.018314+0000","last_unstale":"2024-07-24T16:37:45.667052+0000","last_undegraded":"2024-07-24T16:37:45.667052+0000","last_fullsized":"2024-07-24T16:37:45.667052+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:11:02.137962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074761+0000","last_change":"2024-07-24T16:37:04.009736+0000","last_active":"2024-07-24T16:37:46.074761+0000","last_peered":"2024-07-24T16:37:46.074761+0000","last_clean":"2024-07-24T16:37:46.074761+0000","last_became_active":"2024-07-24T16:37:04.009473+0000","last_became_peered":"2024-07-24T16:37:04.009473+0000","last_unstale":"2024-07-24T16:37:46.074761+0000","last_undegraded":"2024-07-24T16:37:46.074761+0000","last_fullsized":"2024-07-24T16:37:46.074761+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:05:05.128427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668018+0000","last_change":"2024-07-24T16:37:04.001780+0000","last_active":"2024-07-24T16:37:45.668018+0000","last_peered":"2024-07-24T16:37:45.668018+0000","last_clean":"2024-07-24T16:37:45.668018+0000","last_became_active":"2024-07-24T16:37:04.001535+0000","last_became_peered":"2024-07-24T16:37:04.001535+0000","last_unstale":"2024-07-24T16:37:45.668018+0000","last_undegraded":"2024-07-24T16:37:45.668018+0000","last_fullsized":"2024-07-24T16:37:45.668018+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:00:08.654329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668814+0000","last_change":"2024-07-24T16:37:45.668749+0000","last_active":"2024-07-24T16:37:45.668814+0000","last_peered":"2024-07-24T16:37:45.668814+0000","last_clean":"2024-07-24T16:37:45.668814+0000","last_became_active":"2024-07-24T16:37:45.668460+0000","last_became_peered":"2024-07-24T16:37:45.668460+0000","last_unstale":"2024-07-24T16:37:45.668814+0000","last_undegraded":"2024-07-24T16:37:45.668814+0000","last_fullsized":"2024-07-24T16:37:45.668814+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:08:12.604308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075161+0000","last_change":"2024-07-24T16:37:04.011422+0000","last_active":"2024-07-24T16:37:46.075161+0000","last_peered":"2024-07-24T16:37:46.075161+0000","last_clean":"2024-07-24T16:37:46.075161+0000","last_became_active":"2024-07-24T16:37:04.011166+0000","last_became_peered":"2024-07-24T16:37:04.011166+0000","last_unstale":"2024-07-24T16:37:46.075161+0000","last_undegraded":"2024-07-24T16:37:46.075161+0000","last_fullsized":"2024-07-24T16:37:46.075161+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:34.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667421+0000","last_change":"2024-07-24T16:37:04.008292+0000","last_active":"2024-07-24T16:37:45.667421+0000","last_peered":"2024-07-24T16:37:45.667421+0000","last_clean":"2024-07-24T16:37:45.667421+0000","last_became_active":"2024-07-24T16:37:04.008030+0000","last_became_peered":"2024-07-24T16:37:04.008030+0000","last_unstale":"2024-07-24T16:37:45.667421+0000","last_undegraded":"2024-07-24T16:37:45.667421+0000","last_fullsized":"2024-07-24T16:37:45.667421+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:32:43.315454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667556+0000","last_change":"2024-07-24T16:37:04.007961+0000","last_active":"2024-07-24T16:37:45.667556+0000","last_peered":"2024-07-24T16:37:45.667556+0000","last_clean":"2024-07-24T16:37:45.667556+0000","last_became_active":"2024-07-24T16:37:04.007154+0000","last_became_peered":"2024-07-24T16:37:04.007154+0000","last_unstale":"2024-07-24T16:37:45.667556+0000","last_undegraded":"2024-07-24T16:37:45.667556+0000","last_fullsized":"2024-07-24T16:37:45.667556+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:45.075854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667469+0000","last_change":"2024-07-24T16:37:04.007037+0000","last_active":"2024-07-24T16:37:45.667469+0000","last_peered":"2024-07-24T16:37:45.667469+0000","last_clean":"2024-07-24T16:37:45.667469+0000","last_became_active":"2024-07-24T16:37:04.006749+0000","last_became_peered":"2024-07-24T16:37:04.006749+0000","last_unstale":"2024-07-24T16:37:45.667469+0000","last_undegraded":"2024-07-24T16:37:45.667469+0000","last_fullsized":"2024-07-24T16:37:45.667469+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:20.158902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668852+0000","last_change":"2024-07-24T16:37:04.020205+0000","last_active":"2024-07-24T16:37:45.668852+0000","last_peered":"2024-07-24T16:37:45.668852+0000","last_clean":"2024-07-24T16:37:45.668852+0000","last_became_active":"2024-07-24T16:37:04.019931+0000","last_became_peered":"2024-07-24T16:37:04.019931+0000","last_unstale":"2024-07-24T16:37:45.668852+0000","last_undegraded":"2024-07-24T16:37:45.668852+0000","last_fullsized":"2024-07-24T16:37:45.668852+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:38:56.986337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074402+0000","last_change":"2024-07-24T16:37:04.003751+0000","last_active":"2024-07-24T16:37:46.074402+0000","last_peered":"2024-07-24T16:37:46.074402+0000","last_clean":"2024-07-24T16:37:46.074402+0000","last_became_active":"2024-07-24T16:37:04.003501+0000","last_became_peered":"2024-07-24T16:37:04.003501+0000","last_unstale":"2024-07-24T16:37:46.074402+0000","last_undegraded":"2024-07-24T16:37:46.074402+0000","last_fullsized":"2024-07-24T16:37:46.074402+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:47:41.761372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666694+0000","last_change":"2024-07-24T16:37:04.023076+0000","last_active":"2024-07-24T16:37:45.666694+0000","last_peered":"2024-07-24T16:37:45.666694+0000","last_clean":"2024-07-24T16:37:45.666694+0000","last_became_active":"2024-07-24T16:37:04.021397+0000","last_became_peered":"2024-07-24T16:37:04.021397+0000","last_unstale":"2024-07-24T16:37:45.666694+0000","last_undegraded":"2024-07-24T16:37:45.666694+0000","last_fullsized":"2024-07-24T16:37:45.666694+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:15:36.295295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667842+0000","last_change":"2024-07-24T16:37:04.021808+0000","last_active":"2024-07-24T16:37:45.667842+0000","last_peered":"2024-07-24T16:37:45.667842+0000","last_clean":"2024-07-24T16:37:45.667842+0000","last_became_active":"2024-07-24T16:37:04.021195+0000","last_became_peered":"2024-07-24T16:37:04.021195+0000","last_unstale":"2024-07-24T16:37:45.667842+0000","last_undegraded":"2024-07-24T16:37:45.667842+0000","last_fullsized":"2024-07-24T16:37:45.667842+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:09:05.945632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669107+0000","last_change":"2024-07-24T16:37:04.005510+0000","last_active":"2024-07-24T16:37:45.669107+0000","last_peered":"2024-07-24T16:37:45.669107+0000","last_clean":"2024-07-24T16:37:45.669107+0000","last_became_active":"2024-07-24T16:37:04.004807+0000","last_became_peered":"2024-07-24T16:37:04.004807+0000","last_unstale":"2024-07-24T16:37:45.669107+0000","last_undegraded":"2024-07-24T16:37:45.669107+0000","last_fullsized":"2024-07-24T16:37:45.669107+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:02:47.950208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668424+0000","last_change":"2024-07-24T16:37:04.016153+0000","last_active":"2024-07-24T16:37:45.668424+0000","last_peered":"2024-07-24T16:37:45.668424+0000","last_clean":"2024-07-24T16:37:45.668424+0000","last_became_active":"2024-07-24T16:37:04.015860+0000","last_became_peered":"2024-07-24T16:37:04.015860+0000","last_unstale":"2024-07-24T16:37:45.668424+0000","last_undegraded":"2024-07-24T16:37:45.668424+0000","last_fullsized":"2024-07-24T16:37:45.668424+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:37.931655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667580+0000","last_change":"2024-07-24T16:37:04.006057+0000","last_active":"2024-07-24T16:37:45.667580+0000","last_peered":"2024-07-24T16:37:45.667580+0000","last_clean":"2024-07-24T16:37:45.667580+0000","last_became_active":"2024-07-24T16:37:04.005597+0000","last_became_peered":"2024-07-24T16:37:04.005597+0000","last_unstale":"2024-07-24T16:37:45.667580+0000","last_undegraded":"2024-07-24T16:37:45.667580+0000","last_fullsized":"2024-07-24T16:37:45.667580+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:24.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667174+0000","last_change":"2024-07-24T16:37:04.015925+0000","last_active":"2024-07-24T16:37:45.667174+0000","last_peered":"2024-07-24T16:37:45.667174+0000","last_clean":"2024-07-24T16:37:45.667174+0000","last_became_active":"2024-07-24T16:37:04.015678+0000","last_became_peered":"2024-07-24T16:37:04.015678+0000","last_unstale":"2024-07-24T16:37:45.667174+0000","last_undegraded":"2024-07-24T16:37:45.667174+0000","last_fullsized":"2024-07-24T16:37:45.667174+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:40:11.250834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075009+0000","last_change":"2024-07-24T16:37:04.014588+0000","last_active":"2024-07-24T16:37:46.075009+0000","last_peered":"2024-07-24T16:37:46.075009+0000","last_clean":"2024-07-24T16:37:46.075009+0000","last_became_active":"2024-07-24T16:37:04.014310+0000","last_became_peered":"2024-07-24T16:37:04.014310+0000","last_unstale":"2024-07-24T16:37:46.075009+0000","last_undegraded":"2024-07-24T16:37:46.075009+0000","last_fullsized":"2024-07-24T16:37:46.075009+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:58:11.471962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666927+0000","last_change":"2024-07-24T16:37:04.007655+0000","last_active":"2024-07-24T16:37:45.666927+0000","last_peered":"2024-07-24T16:37:45.666927+0000","last_clean":"2024-07-24T16:37:45.666927+0000","last_became_active":"2024-07-24T16:37:04.007367+0000","last_became_peered":"2024-07-24T16:37:04.007367+0000","last_unstale":"2024-07-24T16:37:45.666927+0000","last_undegraded":"2024-07-24T16:37:45.666927+0000","last_fullsized":"2024-07-24T16:37:45.666927+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:51:44.948803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665643+0000","last_change":"2024-07-24T16:37:04.011681+0000","last_active":"2024-07-24T16:37:45.665643+0000","last_peered":"2024-07-24T16:37:45.665643+0000","last_clean":"2024-07-24T16:37:45.665643+0000","last_became_active":"2024-07-24T16:37:04.011439+0000","last_became_peered":"2024-07-24T16:37:04.011439+0000","last_unstale":"2024-07-24T16:37:45.665643+0000","last_undegraded":"2024-07-24T16:37:45.665643+0000","last_fullsized":"2024-07-24T16:37:45.665643+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:06.176465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074554+0000","last_change":"2024-07-24T16:37:04.008494+0000","last_active":"2024-07-24T16:37:46.074554+0000","last_peered":"2024-07-24T16:37:46.074554+0000","last_clean":"2024-07-24T16:37:46.074554+0000","last_became_active":"2024-07-24T16:37:04.008128+0000","last_became_peered":"2024-07-24T16:37:04.008128+0000","last_unstale":"2024-07-24T16:37:46.074554+0000","last_undegraded":"2024-07-24T16:37:46.074554+0000","last_fullsized":"2024-07-24T16:37:46.074554+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:30:30.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"62'4","reported_seq":24,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667797+0000","last_change":"2024-07-24T16:37:03.003544+0000","last_active":"2024-07-24T16:37:45.667797+0000","last_peered":"2024-07-24T16:37:45.667797+0000","last_clean":"2024-07-24T16:37:45.667797+0000","last_became_active":"2024-07-24T16:37:03.003212+0000","last_became_peered":"2024-07-24T16:37:03.003212+0000","last_unstale":"2024-07-24T16:37:45.667797+0000","last_undegraded":"2024-07-24T16:37:45.667797+0000","last_fullsized":"2024-07-24T16:37:45.667797+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:10.767177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665478+0000","last_change":"2024-07-24T16:37:04.007097+0000","last_active":"2024-07-24T16:37:45.665478+0000","last_peered":"2024-07-24T16:37:45.665478+0000","last_clean":"2024-07-24T16:37:45.665478+0000","last_became_active":"2024-07-24T16:37:04.006833+0000","last_became_peered":"2024-07-24T16:37:04.006833+0000","last_unstale":"2024-07-24T16:37:45.665478+0000","last_undegraded":"2024-07-24T16:37:45.665478+0000","last_fullsized":"2024-07-24T16:37:45.665478+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:30:23.341481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"62'1","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668538+0000","last_change":"2024-07-24T16:37:03.008723+0000","last_active":"2024-07-24T16:37:45.668538+0000","last_peered":"2024-07-24T16:37:45.668538+0000","last_clean":"2024-07-24T16:37:45.668538+0000","last_became_active":"2024-07-24T16:37:03.008450+0000","last_became_peered":"2024-07-24T16:37:03.008450+0000","last_unstale":"2024-07-24T16:37:45.668538+0000","last_undegraded":"2024-07-24T16:37:45.668538+0000","last_fullsized":"2024-07-24T16:37:45.668538+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:00:20.422519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667472+0000","last_change":"2024-07-24T16:37:04.009602+0000","last_active":"2024-07-24T16:37:45.667472+0000","last_peered":"2024-07-24T16:37:45.667472+0000","last_clean":"2024-07-24T16:37:45.667472+0000","last_became_active":"2024-07-24T16:37:04.009341+0000","last_became_peered":"2024-07-24T16:37:04.009341+0000","last_unstale":"2024-07-24T16:37:45.667472+0000","last_undegraded":"2024-07-24T16:37:45.667472+0000","last_fullsized":"2024-07-24T16:37:45.667472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:40.906131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668459+0000","last_change":"2024-07-24T16:37:02.999430+0000","last_active":"2024-07-24T16:37:45.668459+0000","last_peered":"2024-07-24T16:37:45.668459+0000","last_clean":"2024-07-24T16:37:45.668459+0000","last_became_active":"2024-07-24T16:37:02.999177+0000","last_became_peered":"2024-07-24T16:37:02.999177+0000","last_unstale":"2024-07-24T16:37:45.668459+0000","last_undegraded":"2024-07-24T16:37:45.668459+0000","last_fullsized":"2024-07-24T16:37:45.668459+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:14:39.765664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668584+0000","last_change":"2024-07-24T16:37:04.005041+0000","last_active":"2024-07-24T16:37:45.668584+0000","last_peered":"2024-07-24T16:37:45.668584+0000","last_clean":"2024-07-24T16:37:45.668584+0000","last_became_active":"2024-07-24T16:37:04.004752+0000","last_became_peered":"2024-07-24T16:37:04.004752+0000","last_unstale":"2024-07-24T16:37:45.668584+0000","last_undegraded":"2024-07-24T16:37:45.668584+0000","last_fullsized":"2024-07-24T16:37:45.668584+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:28:48.788361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665668+0000","last_change":"2024-07-24T16:37:03.013833+0000","last_active":"2024-07-24T16:37:45.665668+0000","last_peered":"2024-07-24T16:37:45.665668+0000","last_clean":"2024-07-24T16:37:45.665668+0000","last_became_active":"2024-07-24T16:37:03.013501+0000","last_became_peered":"2024-07-24T16:37:03.013501+0000","last_unstale":"2024-07-24T16:37:45.665668+0000","last_undegraded":"2024-07-24T16:37:45.665668+0000","last_fullsized":"2024-07-24T16:37:45.665668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:55.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075387+0000","last_change":"2024-07-24T16:37:04.008541+0000","last_active":"2024-07-24T16:37:46.075387+0000","last_peered":"2024-07-24T16:37:46.075387+0000","last_clean":"2024-07-24T16:37:46.075387+0000","last_became_active":"2024-07-24T16:37:04.008251+0000","last_became_peered":"2024-07-24T16:37:04.008251+0000","last_unstale":"2024-07-24T16:37:46.075387+0000","last_undegraded":"2024-07-24T16:37:46.075387+0000","last_fullsized":"2024-07-24T16:37:46.075387+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:23:03.807268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667230+0000","last_change":"2024-07-24T16:37:03.000053+0000","last_active":"2024-07-24T16:37:45.667230+0000","last_peered":"2024-07-24T16:37:45.667230+0000","last_clean":"2024-07-24T16:37:45.667230+0000","last_became_active":"2024-07-24T16:37:02.999733+0000","last_became_peered":"2024-07-24T16:37:02.999733+0000","last_unstale":"2024-07-24T16:37:45.667230+0000","last_undegraded":"2024-07-24T16:37:45.667230+0000","last_fullsized":"2024-07-24T16:37:45.667230+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:43:16.732334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075007+0000","last_change":"2024-07-24T16:37:04.008622+0000","last_active":"2024-07-24T16:37:46.075007+0000","last_peered":"2024-07-24T16:37:46.075007+0000","last_clean":"2024-07-24T16:37:46.075007+0000","last_became_active":"2024-07-24T16:37:04.008293+0000","last_became_peered":"2024-07-24T16:37:04.008293+0000","last_unstale":"2024-07-24T16:37:46.075007+0000","last_undegraded":"2024-07-24T16:37:46.075007+0000","last_fullsized":"2024-07-24T16:37:46.075007+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:45:10.486075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074858+0000","last_change":"2024-07-24T16:37:03.005837+0000","last_active":"2024-07-24T16:37:46.074858+0000","last_peered":"2024-07-24T16:37:46.074858+0000","last_clean":"2024-07-24T16:37:46.074858+0000","last_became_active":"2024-07-24T16:37:03.005494+0000","last_became_peered":"2024-07-24T16:37:03.005494+0000","last_unstale":"2024-07-24T16:37:46.074858+0000","last_undegraded":"2024-07-24T16:37:46.074858+0000","last_fullsized":"2024-07-24T16:37:46.074858+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:19.152923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669257+0000","last_change":"2024-07-24T16:37:04.001679+0000","last_active":"2024-07-24T16:37:45.669257+0000","last_peered":"2024-07-24T16:37:45.669257+0000","last_clean":"2024-07-24T16:37:45.669257+0000","last_became_active":"2024-07-24T16:37:04.001396+0000","last_became_peered":"2024-07-24T16:37:04.001396+0000","last_unstale":"2024-07-24T16:37:45.669257+0000","last_undegraded":"2024-07-24T16:37:45.669257+0000","last_fullsized":"2024-07-24T16:37:45.669257+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:48.147517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667397+0000","last_change":"2024-07-24T16:37:03.003994+0000","last_active":"2024-07-24T16:37:45.667397+0000","last_peered":"2024-07-24T16:37:45.667397+0000","last_clean":"2024-07-24T16:37:45.667397+0000","last_became_active":"2024-07-24T16:37:03.003689+0000","last_became_peered":"2024-07-24T16:37:03.003689+0000","last_unstale":"2024-07-24T16:37:45.667397+0000","last_undegraded":"2024-07-24T16:37:45.667397+0000","last_fullsized":"2024-07-24T16:37:45.667397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:17:37.057978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074994+0000","last_change":"2024-07-24T16:37:04.024282+0000","last_active":"2024-07-24T16:37:46.074994+0000","last_peered":"2024-07-24T16:37:46.074994+0000","last_clean":"2024-07-24T16:37:46.074994+0000","last_became_active":"2024-07-24T16:37:04.024040+0000","last_became_peered":"2024-07-24T16:37:04.024040+0000","last_unstale":"2024-07-24T16:37:46.074994+0000","last_undegraded":"2024-07-24T16:37:46.074994+0000","last_fullsized":"2024-07-24T16:37:46.074994+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:55.570490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666848+0000","last_change":"2024-07-24T16:37:02.999879+0000","last_active":"2024-07-24T16:37:45.666848+0000","last_peered":"2024-07-24T16:37:45.666848+0000","last_clean":"2024-07-24T16:37:45.666848+0000","last_became_active":"2024-07-24T16:37:02.999554+0000","last_became_peered":"2024-07-24T16:37:02.999554+0000","last_unstale":"2024-07-24T16:37:45.666848+0000","last_undegraded":"2024-07-24T16:37:45.666848+0000","last_fullsized":"2024-07-24T16:37:45.666848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:10:25.228026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074597+0000","last_change":"2024-07-24T16:37:04.012481+0000","last_active":"2024-07-24T16:37:46.074597+0000","last_peered":"2024-07-24T16:37:46.074597+0000","last_clean":"2024-07-24T16:37:46.074597+0000","last_became_active":"2024-07-24T16:37:04.012217+0000","last_became_peered":"2024-07-24T16:37:04.012217+0000","last_unstale":"2024-07-24T16:37:46.074597+0000","last_undegraded":"2024-07-24T16:37:46.074597+0000","last_fullsized":"2024-07-24T16:37:46.074597+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:10:47.439606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075111+0000","last_change":"2024-07-24T16:37:03.005534+0000","last_active":"2024-07-24T16:37:46.075111+0000","last_peered":"2024-07-24T16:37:46.075111+0000","last_clean":"2024-07-24T16:37:46.075111+0000","last_became_active":"2024-07-24T16:37:03.005232+0000","last_became_peered":"2024-07-24T16:37:03.005232+0000","last_unstale":"2024-07-24T16:37:46.075111+0000","last_undegraded":"2024-07-24T16:37:46.075111+0000","last_fullsized":"2024-07-24T16:37:46.075111+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:18:00.748831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665427+0000","last_change":"2024-07-24T16:37:03.995253+0000","last_active":"2024-07-24T16:37:45.665427+0000","last_peered":"2024-07-24T16:37:45.665427+0000","last_clean":"2024-07-24T16:37:45.665427+0000","last_became_active":"2024-07-24T16:37:03.994904+0000","last_became_peered":"2024-07-24T16:37:03.994904+0000","last_unstale":"2024-07-24T16:37:45.665427+0000","last_undegraded":"2024-07-24T16:37:45.665427+0000","last_fullsized":"2024-07-24T16:37:45.665427+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:55.570490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075316+0000","last_change":"2024-07-24T16:37:03.004109+0000","last_active":"2024-07-24T16:37:46.075316+0000","last_peered":"2024-07-24T16:37:46.075316+0000","last_clean":"2024-07-24T16:37:46.075316+0000","last_became_active":"2024-07-24T16:37:03.003813+0000","last_became_peered":"2024-07-24T16:37:03.003813+0000","last_unstale":"2024-07-24T16:37:46.075316+0000","last_undegraded":"2024-07-24T16:37:46.075316+0000","last_fullsized":"2024-07-24T16:37:46.075316+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:44.069876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667153+0000","last_change":"2024-07-24T16:37:04.015827+0000","last_active":"2024-07-24T16:37:45.667153+0000","last_peered":"2024-07-24T16:37:45.667153+0000","last_clean":"2024-07-24T16:37:45.667153+0000","last_became_active":"2024-07-24T16:37:04.015577+0000","last_became_peered":"2024-07-24T16:37:04.015577+0000","last_unstale":"2024-07-24T16:37:45.667153+0000","last_undegraded":"2024-07-24T16:37:45.667153+0000","last_fullsized":"2024-07-24T16:37:45.667153+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:38:58.077671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"62'3","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075330+0000","last_change":"2024-07-24T16:37:03.002358+0000","last_active":"2024-07-24T16:37:46.075330+0000","last_peered":"2024-07-24T16:37:46.075330+0000","last_clean":"2024-07-24T16:37:46.075330+0000","last_became_active":"2024-07-24T16:37:03.001970+0000","last_became_peered":"2024-07-24T16:37:03.001970+0000","last_unstale":"2024-07-24T16:37:46.075330+0000","last_undegraded":"2024-07-24T16:37:46.075330+0000","last_fullsized":"2024-07-24T16:37:46.075330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:18:18.548923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075114+0000","last_change":"2024-07-24T16:37:03.996498+0000","last_active":"2024-07-24T16:37:46.075114+0000","last_peered":"2024-07-24T16:37:46.075114+0000","last_clean":"2024-07-24T16:37:46.075114+0000","last_became_active":"2024-07-24T16:37:03.996235+0000","last_became_peered":"2024-07-24T16:37:03.996235+0000","last_unstale":"2024-07-24T16:37:46.075114+0000","last_undegraded":"2024-07-24T16:37:46.075114+0000","last_fullsized":"2024-07-24T16:37:46.075114+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:50:22.080512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"63'8","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669496+0000","last_change":"2024-07-24T16:37:03.008087+0000","last_active":"2024-07-24T16:37:45.669496+0000","last_peered":"2024-07-24T16:37:45.669496+0000","last_clean":"2024-07-24T16:37:45.669496+0000","last_became_active":"2024-07-24T16:37:03.007813+0000","last_became_peered":"2024-07-24T16:37:03.007813+0000","last_unstale":"2024-07-24T16:37:45.669496+0000","last_undegraded":"2024-07-24T16:37:45.669496+0000","last_fullsized":"2024-07-24T16:37:45.669496+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:45:09.480096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2855,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665800+0000","last_change":"2024-07-24T16:37:04.007864+0000","last_active":"2024-07-24T16:37:45.665800+0000","last_peered":"2024-07-24T16:37:45.665800+0000","last_clean":"2024-07-24T16:37:45.665800+0000","last_became_active":"2024-07-24T16:37:04.007559+0000","last_became_peered":"2024-07-24T16:37:04.007559+0000","last_unstale":"2024-07-24T16:37:45.665800+0000","last_undegraded":"2024-07-24T16:37:45.665800+0000","last_fullsized":"2024-07-24T16:37:45.665800+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:40:36.400835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667273+0000","last_change":"2024-07-24T16:37:03.003657+0000","last_active":"2024-07-24T16:37:45.667273+0000","last_peered":"2024-07-24T16:37:45.667273+0000","last_clean":"2024-07-24T16:37:45.667273+0000","last_became_active":"2024-07-24T16:37:03.003386+0000","last_became_peered":"2024-07-24T16:37:03.003386+0000","last_unstale":"2024-07-24T16:37:45.667273+0000","last_undegraded":"2024-07-24T16:37:45.667273+0000","last_fullsized":"2024-07-24T16:37:45.667273+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:08:09.502445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667518+0000","last_change":"2024-07-24T16:37:04.019133+0000","last_active":"2024-07-24T16:37:45.667518+0000","last_peered":"2024-07-24T16:37:45.667518+0000","last_clean":"2024-07-24T16:37:45.667518+0000","last_became_active":"2024-07-24T16:37:04.018826+0000","last_became_peered":"2024-07-24T16:37:04.018826+0000","last_unstale":"2024-07-24T16:37:45.667518+0000","last_undegraded":"2024-07-24T16:37:45.667518+0000","last_fullsized":"2024-07-24T16:37:45.667518+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:56.542664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667503+0000","last_change":"2024-07-24T16:37:03.003836+0000","last_active":"2024-07-24T16:37:45.667503+0000","last_peered":"2024-07-24T16:37:45.667503+0000","last_clean":"2024-07-24T16:37:45.667503+0000","last_became_active":"2024-07-24T16:37:03.003542+0000","last_became_peered":"2024-07-24T16:37:03.003542+0000","last_unstale":"2024-07-24T16:37:45.667503+0000","last_undegraded":"2024-07-24T16:37:45.667503+0000","last_fullsized":"2024-07-24T16:37:45.667503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:40:08.258903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669476+0000","last_change":"2024-07-24T16:37:04.011095+0000","last_active":"2024-07-24T16:37:45.669476+0000","last_peered":"2024-07-24T16:37:45.669476+0000","last_clean":"2024-07-24T16:37:45.669476+0000","last_became_active":"2024-07-24T16:37:04.010791+0000","last_became_peered":"2024-07-24T16:37:04.010791+0000","last_unstale":"2024-07-24T16:37:45.669476+0000","last_undegraded":"2024-07-24T16:37:45.669476+0000","last_fullsized":"2024-07-24T16:37:45.669476+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:53:23.625615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074790+0000","last_change":"2024-07-24T16:37:03.010829+0000","last_active":"2024-07-24T16:37:46.074790+0000","last_peered":"2024-07-24T16:37:46.074790+0000","last_clean":"2024-07-24T16:37:46.074790+0000","last_became_active":"2024-07-24T16:37:03.010566+0000","last_became_peered":"2024-07-24T16:37:03.010566+0000","last_unstale":"2024-07-24T16:37:46.074790+0000","last_undegraded":"2024-07-24T16:37:46.074790+0000","last_fullsized":"2024-07-24T16:37:46.074790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:58:26.392478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667702+0000","last_change":"2024-07-24T16:37:04.023416+0000","last_active":"2024-07-24T16:37:45.667702+0000","last_peered":"2024-07-24T16:37:45.667702+0000","last_clean":"2024-07-24T16:37:45.667702+0000","last_became_active":"2024-07-24T16:37:04.020968+0000","last_became_peered":"2024-07-24T16:37:04.020968+0000","last_unstale":"2024-07-24T16:37:45.667702+0000","last_undegraded":"2024-07-24T16:37:45.667702+0000","last_fullsized":"2024-07-24T16:37:45.667702+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:51:49.010336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"62'8","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668973+0000","last_change":"2024-07-24T16:37:03.006180+0000","last_active":"2024-07-24T16:37:45.668973+0000","last_peered":"2024-07-24T16:37:45.668973+0000","last_clean":"2024-07-24T16:37:45.668973+0000","last_became_active":"2024-07-24T16:37:03.005719+0000","last_became_peered":"2024-07-24T16:37:03.005719+0000","last_unstale":"2024-07-24T16:37:45.668973+0000","last_undegraded":"2024-07-24T16:37:45.668973+0000","last_fullsized":"2024-07-24T16:37:45.668973+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:05.170486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669046+0000","last_change":"2024-07-24T16:37:04.005089+0000","last_active":"2024-07-24T16:37:45.669046+0000","last_peered":"2024-07-24T16:37:45.669046+0000","last_clean":"2024-07-24T16:37:45.669046+0000","last_became_active":"2024-07-24T16:37:04.004750+0000","last_became_peered":"2024-07-24T16:37:04.004750+0000","last_unstale":"2024-07-24T16:37:45.669046+0000","last_undegraded":"2024-07-24T16:37:45.669046+0000","last_fullsized":"2024-07-24T16:37:45.669046+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:34:37.325695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667924+0000","last_change":"2024-07-24T16:37:03.013805+0000","last_active":"2024-07-24T16:37:45.667924+0000","last_peered":"2024-07-24T16:37:45.667924+0000","last_clean":"2024-07-24T16:37:45.667924+0000","last_became_active":"2024-07-24T16:37:03.013485+0000","last_became_peered":"2024-07-24T16:37:03.013485+0000","last_unstale":"2024-07-24T16:37:45.667924+0000","last_undegraded":"2024-07-24T16:37:45.667924+0000","last_fullsized":"2024-07-24T16:37:45.667924+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:45:47.297991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668160+0000","last_change":"2024-07-24T16:37:04.019820+0000","last_active":"2024-07-24T16:37:45.668160+0000","last_peered":"2024-07-24T16:37:45.668160+0000","last_clean":"2024-07-24T16:37:45.668160+0000","last_became_active":"2024-07-24T16:37:04.019539+0000","last_became_peered":"2024-07-24T16:37:04.019539+0000","last_unstale":"2024-07-24T16:37:45.668160+0000","last_undegraded":"2024-07-24T16:37:45.668160+0000","last_fullsized":"2024-07-24T16:37:45.668160+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:50:22.080512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074705+0000","last_change":"2024-07-24T16:37:02.998295+0000","last_active":"2024-07-24T16:37:46.074705+0000","last_peered":"2024-07-24T16:37:46.074705+0000","last_clean":"2024-07-24T16:37:46.074705+0000","last_became_active":"2024-07-24T16:37:02.998007+0000","last_became_peered":"2024-07-24T16:37:02.998007+0000","last_unstale":"2024-07-24T16:37:46.074705+0000","last_undegraded":"2024-07-24T16:37:46.074705+0000","last_fullsized":"2024-07-24T16:37:46.074705+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:32:49.184726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074828+0000","last_change":"2024-07-24T16:37:04.022338+0000","last_active":"2024-07-24T16:37:46.074828+0000","last_peered":"2024-07-24T16:37:46.074828+0000","last_clean":"2024-07-24T16:37:46.074828+0000","last_became_active":"2024-07-24T16:37:04.022113+0000","last_became_peered":"2024-07-24T16:37:04.022113+0000","last_unstale":"2024-07-24T16:37:46.074828+0000","last_undegraded":"2024-07-24T16:37:46.074828+0000","last_fullsized":"2024-07-24T16:37:46.074828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:26:46.966508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667700+0000","last_change":"2024-07-24T16:37:03.001292+0000","last_active":"2024-07-24T16:37:45.667700+0000","last_peered":"2024-07-24T16:37:45.667700+0000","last_clean":"2024-07-24T16:37:45.667700+0000","last_became_active":"2024-07-24T16:37:03.001003+0000","last_became_peered":"2024-07-24T16:37:03.001003+0000","last_unstale":"2024-07-24T16:37:45.667700+0000","last_undegraded":"2024-07-24T16:37:45.667700+0000","last_fullsized":"2024-07-24T16:37:45.667700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:51:36.249129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668277+0000","last_change":"2024-07-24T16:37:03.999104+0000","last_active":"2024-07-24T16:37:45.668277+0000","last_peered":"2024-07-24T16:37:45.668277+0000","last_clean":"2024-07-24T16:37:45.668277+0000","last_became_active":"2024-07-24T16:37:03.998825+0000","last_became_peered":"2024-07-24T16:37:03.998825+0000","last_unstale":"2024-07-24T16:37:45.668277+0000","last_undegraded":"2024-07-24T16:37:45.668277+0000","last_fullsized":"2024-07-24T16:37:45.668277+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:10:47.439606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667674+0000","last_change":"2024-07-24T16:37:03.013889+0000","last_active":"2024-07-24T16:37:45.667674+0000","last_peered":"2024-07-24T16:37:45.667674+0000","last_clean":"2024-07-24T16:37:45.667674+0000","last_became_active":"2024-07-24T16:37:03.013550+0000","last_became_peered":"2024-07-24T16:37:03.013550+0000","last_unstale":"2024-07-24T16:37:45.667674+0000","last_undegraded":"2024-07-24T16:37:45.667674+0000","last_fullsized":"2024-07-24T16:37:45.667674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:32.419679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665609+0000","last_change":"2024-07-24T16:37:04.000366+0000","last_active":"2024-07-24T16:37:45.665609+0000","last_peered":"2024-07-24T16:37:45.665609+0000","last_clean":"2024-07-24T16:37:45.665609+0000","last_became_active":"2024-07-24T16:37:04.000074+0000","last_became_peered":"2024-07-24T16:37:04.000074+0000","last_unstale":"2024-07-24T16:37:45.665609+0000","last_undegraded":"2024-07-24T16:37:45.665609+0000","last_fullsized":"2024-07-24T16:37:45.665609+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:13:56.585430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668328+0000","last_change":"2024-07-24T16:37:02.995822+0000","last_active":"2024-07-24T16:37:45.668328+0000","last_peered":"2024-07-24T16:37:45.668328+0000","last_clean":"2024-07-24T16:37:45.668328+0000","last_became_active":"2024-07-24T16:37:02.995536+0000","last_became_peered":"2024-07-24T16:37:02.995536+0000","last_unstale":"2024-07-24T16:37:45.668328+0000","last_undegraded":"2024-07-24T16:37:45.668328+0000","last_fullsized":"2024-07-24T16:37:45.668328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:00:55.075881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667752+0000","last_change":"2024-07-24T16:37:04.004492+0000","last_active":"2024-07-24T16:37:45.667752+0000","last_peered":"2024-07-24T16:37:45.667752+0000","last_clean":"2024-07-24T16:37:45.667752+0000","last_became_active":"2024-07-24T16:37:04.004210+0000","last_became_peered":"2024-07-24T16:37:04.004210+0000","last_unstale":"2024-07-24T16:37:45.667752+0000","last_undegraded":"2024-07-24T16:37:45.667752+0000","last_fullsized":"2024-07-24T16:37:45.667752+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:28:19.279886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668948+0000","last_change":"2024-07-24T16:37:03.007200+0000","last_active":"2024-07-24T16:37:45.668948+0000","last_peered":"2024-07-24T16:37:45.668948+0000","last_clean":"2024-07-24T16:37:45.668948+0000","last_became_active":"2024-07-24T16:37:03.006461+0000","last_became_peered":"2024-07-24T16:37:03.006461+0000","last_unstale":"2024-07-24T16:37:45.668948+0000","last_undegraded":"2024-07-24T16:37:45.668948+0000","last_fullsized":"2024-07-24T16:37:45.668948+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:58:10.465983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667633+0000","last_change":"2024-07-24T16:37:04.011548+0000","last_active":"2024-07-24T16:37:45.667633+0000","last_peered":"2024-07-24T16:37:45.667633+0000","last_clean":"2024-07-24T16:37:45.667633+0000","last_became_active":"2024-07-24T16:37:04.011301+0000","last_became_peered":"2024-07-24T16:37:04.011301+0000","last_unstale":"2024-07-24T16:37:45.667633+0000","last_undegraded":"2024-07-24T16:37:45.667633+0000","last_fullsized":"2024-07-24T16:37:45.667633+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:18:19.554902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666987+0000","last_change":"2024-07-24T16:37:03.000155+0000","last_active":"2024-07-24T16:37:45.666987+0000","last_peered":"2024-07-24T16:37:45.666987+0000","last_clean":"2024-07-24T16:37:45.666987+0000","last_became_active":"2024-07-24T16:37:02.999863+0000","last_became_peered":"2024-07-24T16:37:02.999863+0000","last_unstale":"2024-07-24T16:37:45.666987+0000","last_undegraded":"2024-07-24T16:37:45.666987+0000","last_fullsized":"2024-07-24T16:37:45.666987+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:53:03.005579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668338+0000","last_change":"2024-07-24T16:37:04.009717+0000","last_active":"2024-07-24T16:37:45.668338+0000","last_peered":"2024-07-24T16:37:45.668338+0000","last_clean":"2024-07-24T16:37:45.668338+0000","last_became_active":"2024-07-24T16:37:04.009453+0000","last_became_peered":"2024-07-24T16:37:04.009453+0000","last_unstale":"2024-07-24T16:37:45.668338+0000","last_undegraded":"2024-07-24T16:37:45.668338+0000","last_fullsized":"2024-07-24T16:37:45.668338+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:23:03.807268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074402+0000","last_change":"2024-07-24T16:37:03.000905+0000","last_active":"2024-07-24T16:37:46.074402+0000","last_peered":"2024-07-24T16:37:46.074402+0000","last_clean":"2024-07-24T16:37:46.074402+0000","last_became_active":"2024-07-24T16:37:03.000630+0000","last_became_peered":"2024-07-24T16:37:03.000630+0000","last_unstale":"2024-07-24T16:37:46.074402+0000","last_undegraded":"2024-07-24T16:37:46.074402+0000","last_fullsized":"2024-07-24T16:37:46.074402+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:26:24.140079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665444+0000","last_change":"2024-07-24T16:37:04.001385+0000","last_active":"2024-07-24T16:37:45.665444+0000","last_peered":"2024-07-24T16:37:45.665444+0000","last_clean":"2024-07-24T16:37:45.665444+0000","last_became_active":"2024-07-24T16:37:04.001124+0000","last_became_peered":"2024-07-24T16:37:04.001124+0000","last_unstale":"2024-07-24T16:37:45.665444+0000","last_undegraded":"2024-07-24T16:37:45.665444+0000","last_fullsized":"2024-07-24T16:37:45.665444+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:34.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667832+0000","last_change":"2024-07-24T16:37:03.003668+0000","last_active":"2024-07-24T16:37:45.667832+0000","last_peered":"2024-07-24T16:37:45.667832+0000","last_clean":"2024-07-24T16:37:45.667832+0000","last_became_active":"2024-07-24T16:37:03.003387+0000","last_became_peered":"2024-07-24T16:37:03.003387+0000","last_unstale":"2024-07-24T16:37:45.667832+0000","last_undegraded":"2024-07-24T16:37:45.667832+0000","last_fullsized":"2024-07-24T16:37:45.667832+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:50:35.318606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668412+0000","last_change":"2024-07-24T16:37:04.000123+0000","last_active":"2024-07-24T16:37:45.668412+0000","last_peered":"2024-07-24T16:37:45.668412+0000","last_clean":"2024-07-24T16:37:45.668412+0000","last_became_active":"2024-07-24T16:37:03.999841+0000","last_became_peered":"2024-07-24T16:37:03.999841+0000","last_unstale":"2024-07-24T16:37:45.668412+0000","last_undegraded":"2024-07-24T16:37:45.668412+0000","last_fullsized":"2024-07-24T16:37:45.668412+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:26:46.966508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075276+0000","last_change":"2024-07-24T16:37:03.003110+0000","last_active":"2024-07-24T16:37:46.075276+0000","last_peered":"2024-07-24T16:37:46.075276+0000","last_clean":"2024-07-24T16:37:46.075276+0000","last_became_active":"2024-07-24T16:37:03.002819+0000","last_became_peered":"2024-07-24T16:37:03.002819+0000","last_unstale":"2024-07-24T16:37:46.075276+0000","last_undegraded":"2024-07-24T16:37:46.075276+0000","last_fullsized":"2024-07-24T16:37:46.075276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:32:42.309475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669126+0000","last_change":"2024-07-24T16:37:04.007895+0000","last_active":"2024-07-24T16:37:45.669126+0000","last_peered":"2024-07-24T16:37:45.669126+0000","last_clean":"2024-07-24T16:37:45.669126+0000","last_became_active":"2024-07-24T16:37:04.007614+0000","last_became_peered":"2024-07-24T16:37:04.007614+0000","last_unstale":"2024-07-24T16:37:45.669126+0000","last_undegraded":"2024-07-24T16:37:45.669126+0000","last_fullsized":"2024-07-24T16:37:45.669126+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:36:32.427250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667342+0000","last_change":"2024-07-24T16:37:03.002515+0000","last_active":"2024-07-24T16:37:45.667342+0000","last_peered":"2024-07-24T16:37:45.667342+0000","last_clean":"2024-07-24T16:37:45.667342+0000","last_became_active":"2024-07-24T16:37:03.002219+0000","last_became_peered":"2024-07-24T16:37:03.002219+0000","last_unstale":"2024-07-24T16:37:45.667342+0000","last_undegraded":"2024-07-24T16:37:45.667342+0000","last_fullsized":"2024-07-24T16:37:45.667342+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:29:44.553198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667412+0000","last_change":"2024-07-24T16:37:04.021367+0000","last_active":"2024-07-24T16:37:45.667412+0000","last_peered":"2024-07-24T16:37:45.667412+0000","last_clean":"2024-07-24T16:37:45.667412+0000","last_became_active":"2024-07-24T16:37:04.021059+0000","last_became_peered":"2024-07-24T16:37:04.021059+0000","last_unstale":"2024-07-24T16:37:45.667412+0000","last_undegraded":"2024-07-24T16:37:45.667412+0000","last_fullsized":"2024-07-24T16:37:45.667412+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:18:01.754809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669294+0000","last_change":"2024-07-24T16:37:03.009702+0000","last_active":"2024-07-24T16:37:45.669294+0000","last_peered":"2024-07-24T16:37:45.669294+0000","last_clean":"2024-07-24T16:37:45.669294+0000","last_became_active":"2024-07-24T16:37:03.009216+0000","last_became_peered":"2024-07-24T16:37:03.009216+0000","last_unstale":"2024-07-24T16:37:45.669294+0000","last_undegraded":"2024-07-24T16:37:45.669294+0000","last_fullsized":"2024-07-24T16:37:45.669294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:33.301368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665544+0000","last_change":"2024-07-24T16:37:04.007332+0000","last_active":"2024-07-24T16:37:45.665544+0000","last_peered":"2024-07-24T16:37:45.665544+0000","last_clean":"2024-07-24T16:37:45.665544+0000","last_became_active":"2024-07-24T16:37:04.007096+0000","last_became_peered":"2024-07-24T16:37:04.007096+0000","last_unstale":"2024-07-24T16:37:45.665544+0000","last_undegraded":"2024-07-24T16:37:45.665544+0000","last_fullsized":"2024-07-24T16:37:45.665544+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:23:03.806832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669021+0000","last_change":"2024-07-24T16:37:03.008273+0000","last_active":"2024-07-24T16:37:45.669021+0000","last_peered":"2024-07-24T16:37:45.669021+0000","last_clean":"2024-07-24T16:37:45.669021+0000","last_became_active":"2024-07-24T16:37:03.008025+0000","last_became_peered":"2024-07-24T16:37:03.008025+0000","last_unstale":"2024-07-24T16:37:45.669021+0000","last_undegraded":"2024-07-24T16:37:45.669021+0000","last_fullsized":"2024-07-24T16:37:45.669021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:54.564511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667613+0000","last_change":"2024-07-24T16:37:04.018001+0000","last_active":"2024-07-24T16:37:45.667613+0000","last_peered":"2024-07-24T16:37:45.667613+0000","last_clean":"2024-07-24T16:37:45.667613+0000","last_became_active":"2024-07-24T16:37:04.017748+0000","last_became_peered":"2024-07-24T16:37:04.017748+0000","last_unstale":"2024-07-24T16:37:45.667613+0000","last_undegraded":"2024-07-24T16:37:45.667613+0000","last_fullsized":"2024-07-24T16:37:45.667613+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:58:27.398456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075393+0000","last_change":"2024-07-24T16:37:03.008246+0000","last_active":"2024-07-24T16:37:46.075393+0000","last_peered":"2024-07-24T16:37:46.075393+0000","last_clean":"2024-07-24T16:37:46.075393+0000","last_became_active":"2024-07-24T16:37:03.008010+0000","last_became_peered":"2024-07-24T16:37:03.008010+0000","last_unstale":"2024-07-24T16:37:46.075393+0000","last_undegraded":"2024-07-24T16:37:46.075393+0000","last_fullsized":"2024-07-24T16:37:46.075393+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:23.842357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669435+0000","last_change":"2024-07-24T16:37:04.004696+0000","last_active":"2024-07-24T16:37:45.669435+0000","last_peered":"2024-07-24T16:37:45.669435+0000","last_clean":"2024-07-24T16:37:45.669435+0000","last_became_active":"2024-07-24T16:37:04.004446+0000","last_became_peered":"2024-07-24T16:37:04.004446+0000","last_unstale":"2024-07-24T16:37:45.669435+0000","last_undegraded":"2024-07-24T16:37:45.669435+0000","last_fullsized":"2024-07-24T16:37:45.669435+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:33:56.086626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665618+0000","last_change":"2024-07-24T16:37:02.997130+0000","last_active":"2024-07-24T16:37:45.665618+0000","last_peered":"2024-07-24T16:37:45.665618+0000","last_clean":"2024-07-24T16:37:45.665618+0000","last_became_active":"2024-07-24T16:37:02.996841+0000","last_became_peered":"2024-07-24T16:37:02.996841+0000","last_unstale":"2024-07-24T16:37:45.665618+0000","last_undegraded":"2024-07-24T16:37:45.665618+0000","last_fullsized":"2024-07-24T16:37:45.665618+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:27:02.167426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667380+0000","last_change":"2024-07-24T16:37:04.005886+0000","last_active":"2024-07-24T16:37:45.667380+0000","last_peered":"2024-07-24T16:37:45.667380+0000","last_clean":"2024-07-24T16:37:45.667380+0000","last_became_active":"2024-07-24T16:37:04.005578+0000","last_became_peered":"2024-07-24T16:37:04.005578+0000","last_unstale":"2024-07-24T16:37:45.667380+0000","last_undegraded":"2024-07-24T16:37:45.667380+0000","last_fullsized":"2024-07-24T16:37:45.667380+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:32:24.649601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"65'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667754+0000","last_change":"2024-07-24T16:37:03.002115+0000","last_active":"2024-07-24T16:37:45.667754+0000","last_peered":"2024-07-24T16:37:45.667754+0000","last_clean":"2024-07-24T16:37:45.667754+0000","last_became_active":"2024-07-24T16:37:03.001758+0000","last_became_peered":"2024-07-24T16:37:03.001758+0000","last_unstale":"2024-07-24T16:37:45.667754+0000","last_undegraded":"2024-07-24T16:37:45.667754+0000","last_fullsized":"2024-07-24T16:37:45.667754+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:10:49.225665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'86","reported_seq":249,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074704+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:37:46.074704+0000","last_peered":"2024-07-24T16:37:46.074704+0000","last_clean":"2024-07-24T16:37:46.074704+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:37:46.074704+0000","last_undegraded":"2024-07-24T16:37:46.074704+0000","last_fullsized":"2024-07-24T16:37:46.074704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":3653,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7306,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575032,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54736,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317104,"statfs":{"total":96636764160,"available":96580714496,"internally_reserved":0,"allocated":1380352,"data_stored":977699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575032,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":786432,"data_stored":387859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575032,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49988,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321852,"statfs":{"total":96636764160,"available":96585576448,"internally_reserved":0,"allocated":778240,"data_stored":387207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575033,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":387789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575033,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31960,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339880,"statfs":{"total":96636764160,"available":96604037120,"internally_reserved":0,"allocated":794624,"data_stored":390084,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575033,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54160,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317680,"statfs":{"total":96636764160,"available":96581304320,"internally_reserved":0,"allocated":790528,"data_stored":390062,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575032,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":387367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575033,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1380352,"data_stored":977631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2877,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:39:12.553 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-07-24T16:39:12.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.693+0000 7f30b5190640 1 -- 172.21.15.159:0/767020100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f309c005e50 msgr2=0x7f309c0062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:12.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.693+0000 7f30b5190640 1 --2- 172.21.15.159:0/767020100 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f309c005e50 0x7f309c0062d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009ed0 tx=0x7f309c006940 comp rx=0 tx=0).stop 2024-07-24T16:39:12.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.693+0000 7f30af59e640 1 -- 172.21.15.159:0/767020100 reap_dead start 2024-07-24T16:39:12.696 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.693+0000 7f30b5190640 1 -- 172.21.15.159:0/767020100 shutdown_connections 2024-07-24T16:39:12.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.693+0000 7f30b5190640 1 -- 172.21.15.159:0/767020100 >> 172.21.15.159:0/767020100 conn(0x7f30b006c560 msgr2=0x7f30b006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:12.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.693+0000 7f30b5190640 1 -- 172.21.15.159:0/767020100 shutdown_connections 2024-07-24T16:39:12.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.693+0000 7f30b5190640 1 -- 172.21.15.159:0/767020100 wait complete. 2024-07-24T16:39:12.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.694+0000 7f30b5190640 1 Processor -- start 2024-07-24T16:39:12.697 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.695+0000 7f30b5190640 1 -- start start 2024-07-24T16:39:12.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.695+0000 7f30b5190640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c005e50 0x7f30b0158d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:12.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.695+0000 7f30b5190640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30b01e5d10 0x7f30b01e6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:12.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.695+0000 7f30b5190640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b013ebc0 0x7f30b013f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:12.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.695+0000 7f30b5190640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f30b006de70 con 0x7f30b013ebc0 2024-07-24T16:39:12.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.695+0000 7f30b5190640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f30b006dcf0 con 0x7f309c005e50 2024-07-24T16:39:12.700 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.695+0000 7f30b5190640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f30b0151180 con 0x7f30b01e5d10 2024-07-24T16:39:12.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.695+0000 7f30af59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b013ebc0 0x7f30b013f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:12.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30af59e640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b013ebc0 0x7f30b013f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49810/0 (socket says 172.21.15.159:49810) 2024-07-24T16:39:12.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30af59e640 1 -- 172.21.15.159:0/2602947955 learned_addr learned my addr 172.21.15.159:0/2602947955 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:12.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30a659c640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30b01e5d10 0x7f30b01e6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:12.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30aed9d640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c005e50 0x7f30b0158d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:12.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30af59e640 1 -- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30b01e5d10 msgr2=0x7f30b01e6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:12.701 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30af59e640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30b01e5d10 0x7f30b01e6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30af59e640 1 -- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c005e50 msgr2=0x7f30b0158d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:12.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30af59e640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c005e50 0x7f30b0158d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30af59e640 1 -- 172.21.15.159:0/2602947955 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b013f8d0 con 0x7f30b013ebc0 2024-07-24T16:39:12.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30aed9d640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c005e50 0x7f30b0158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:39:12.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30a659c640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30b01e5d10 0x7f30b01e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:39:12.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30af59e640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b013ebc0 0x7f30b013f020 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f30a802aec0 tx=0x7f30a8033bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:12.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30a7fff640 1 -- 172.21.15.159:0/2602947955 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8042070 con 0x7f30b013ebc0 2024-07-24T16:39:12.702 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30a7fff640 1 -- 172.21.15.159:0/2602947955 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30a8003970 con 0x7f30b013ebc0 2024-07-24T16:39:12.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30a7fff640 1 -- 172.21.15.159:0/2602947955 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a8038040 con 0x7f30b013ebc0 2024-07-24T16:39:12.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30b5190640 1 -- 172.21.15.159:0/2602947955 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b013ccd0 con 0x7f30b013ebc0 2024-07-24T16:39:12.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.696+0000 7f30b5190640 1 -- 172.21.15.159:0/2602947955 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b013d290 con 0x7f30b013ebc0 2024-07-24T16:39:12.703 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.697+0000 7f30b5190640 1 -- 172.21.15.159:0/2602947955 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30b00cf820 con 0x7f30b013ebc0 2024-07-24T16:39:12.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.698+0000 7f30a7fff640 1 -- 172.21.15.159:0/2602947955 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f30a8004030 con 0x7f30b013ebc0 2024-07-24T16:39:12.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.698+0000 7f30a7fff640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3090077010 0x7f30900794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:12.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.698+0000 7f30a7fff640 1 -- 172.21.15.159:0/2602947955 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f30a80b8df0 con 0x7f30b013ebc0 2024-07-24T16:39:12.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.699+0000 7f30aed9d640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3090077010 0x7f30900794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:12.704 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.699+0000 7f30aed9d640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3090077010 0x7f30900794d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30a0000fb0 tx=0x7f30a00015a0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:12.705 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.702+0000 7f30a7fff640 1 -- 172.21.15.159:0/2602947955 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f30a80816b0 con 0x7f30b013ebc0 2024-07-24T16:39:12.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.888+0000 7f30b5190640 1 -- 172.21.15.159:0/2602947955 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f30b00ce970 con 0x7f30b013ebc0 2024-07-24T16:39:12.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.889+0000 7f30a7fff640 1 -- 172.21.15.159:0/2602947955 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) ==== 74+0+17472 (secure 0 0 0) 0x7f30a8085c00 con 0x7f30b013ebc0 2024-07-24T16:39:12.891 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:39:12.892 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":65,"fsid":"15e9c2b9-79b9-45cf-833e-5ce98c29c7f6","created":"2024-07-24T16:23:45.976808+0000","modified":"2024-07-24T16:37:45.661810+0000","last_up_change":"2024-07-24T16:23:57.295150+0000","last_in_change":"2024-07-24T16:23:49.071285+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-07-24T16:23:58.377345+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-07-24T16:37:00.987259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-07-24T16:37:02.311704+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b968801f-08a9-417b-987d-cd15190d1510","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6811","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6812","nonce":1335917367}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6815","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6820","nonce":1335917367}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6830","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6831","nonce":1335917367}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6823","nonce":1335917367},{"type":"v1","addr":"172.21.15.159:6827","nonce":1335917367}]},"public_addr":"172.21.15.159:6812/1335917367","cluster_addr":"172.21.15.159:6820/1335917367","heartbeat_back_addr":"172.21.15.159:6831/1335917367","heartbeat_front_addr":"172.21.15.159:6827/1335917367","state":["exists","up"]},{"osd":1,"uuid":"7eb2f57d-b24e-49d0-8118-f4cb0332b493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6808","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6809","nonce":3830259864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6813","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6817","nonce":3830259864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6825","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6828","nonce":3830259864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6819","nonce":3830259864},{"type":"v1","addr":"172.21.15.159:6822","nonce":3830259864}]},"public_addr":"172.21.15.159:6809/3830259864","cluster_addr":"172.21.15.159:6817/3830259864","heartbeat_back_addr":"172.21.15.159:6828/3830259864","heartbeat_front_addr":"172.21.15.159:6822/3830259864","state":["exists","up"]},{"osd":2,"uuid":"89ea8990-47fc-4de8-a658-e0bd98fb34a8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6810","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6814","nonce":3425927328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6816","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6818","nonce":3425927328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6826","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6829","nonce":3425927328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6821","nonce":3425927328},{"type":"v1","addr":"172.21.15.159:6824","nonce":3425927328}]},"public_addr":"172.21.15.159:6814/3425927328","cluster_addr":"172.21.15.159:6818/3425927328","heartbeat_back_addr":"172.21.15.159:6829/3425927328","heartbeat_front_addr":"172.21.15.159:6824/3425927328","state":["exists","up"]},{"osd":3,"uuid":"439171fb-b1e7-44f0-8ff9-87de8d7d925a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6800","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6801","nonce":1890079338}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6802","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6803","nonce":1890079338}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6806","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6807","nonce":1890079338}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6804","nonce":1890079338},{"type":"v1","addr":"172.21.15.159:6805","nonce":1890079338}]},"public_addr":"172.21.15.159:6801/1890079338","cluster_addr":"172.21.15.159:6803/1890079338","heartbeat_back_addr":"172.21.15.159:6807/1890079338","heartbeat_front_addr":"172.21.15.159:6805/1890079338","state":["exists","up"]},{"osd":4,"uuid":"74a17e41-c387-4c27-bc9a-ea8a28cc434f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6824","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6825","nonce":2092166389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6826","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6827","nonce":2092166389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6830","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6831","nonce":2092166389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6828","nonce":2092166389},{"type":"v1","addr":"172.21.15.193:6829","nonce":2092166389}]},"public_addr":"172.21.15.193:6825/2092166389","cluster_addr":"172.21.15.193:6827/2092166389","heartbeat_back_addr":"172.21.15.193:6831/2092166389","heartbeat_front_addr":"172.21.15.193:6829/2092166389","state":["exists","up"]},{"osd":5,"uuid":"c4e80816-7542-4b1a-83f2-928e806045f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6800","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6801","nonce":262722874}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6802","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6803","nonce":262722874}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6806","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6807","nonce":262722874}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6804","nonce":262722874},{"type":"v1","addr":"172.21.15.193:6805","nonce":262722874}]},"public_addr":"172.21.15.193:6801/262722874","cluster_addr":"172.21.15.193:6803/262722874","heartbeat_back_addr":"172.21.15.193:6807/262722874","heartbeat_front_addr":"172.21.15.193:6805/262722874","state":["exists","up"]},{"osd":6,"uuid":"fe1fd78a-24b4-45a0-a6dc-46f605e582f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6812","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6813","nonce":2474946218}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6815","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6817","nonce":2474946218}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6822","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6823","nonce":2474946218}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6818","nonce":2474946218},{"type":"v1","addr":"172.21.15.193:6820","nonce":2474946218}]},"public_addr":"172.21.15.193:6813/2474946218","cluster_addr":"172.21.15.193:6817/2474946218","heartbeat_back_addr":"172.21.15.193:6823/2474946218","heartbeat_front_addr":"172.21.15.193:6820/2474946218","state":["exists","up"]},{"osd":7,"uuid":"7c98fae9-9940-4fca-86d0-6e3c0971b77e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6808","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6809","nonce":745996008}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6810","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6811","nonce":745996008}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6819","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6821","nonce":745996008}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6814","nonce":745996008},{"type":"v1","addr":"172.21.15.193:6816","nonce":745996008}]},"public_addr":"172.21.15.193:6809/745996008","cluster_addr":"172.21.15.193:6811/745996008","heartbeat_back_addr":"172.21.15.193:6821/745996008","heartbeat_front_addr":"172.21.15.193:6816/745996008","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.250809+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.239256+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.228542+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.192793+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.212137+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.203309+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.172830+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-07-24T16:23:54.175680+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"8.2f","mappings":[{"from":0,"to":6}]},{"pgid":"8.38","mappings":[{"from":0,"to":6}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":6,"snaps":[{"begin":4,"length":1},{"begin":14,"length":1},{"begin":24,"length":1},{"begin":35,"length":1},{"begin":41,"length":2},{"begin":46,"length":1},{"begin":52,"length":1},{"begin":56,"length":1},{"begin":63,"length":1},{"begin":67,"length":1},{"begin":74,"length":1},{"begin":78,"length":1},{"begin":84,"length":1},{"begin":88,"length":1},{"begin":95,"length":1},{"begin":99,"length":1},{"begin":106,"length":1},{"begin":203,"length":18}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-07-24T16:39:12.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.891+0000 7f30b5190640 1 -- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3090077010 msgr2=0x7f30900794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:12.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.891+0000 7f30b5190640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3090077010 0x7f30900794d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f30a0000fb0 tx=0x7f30a00015a0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.891+0000 7f30b5190640 1 -- 172.21.15.159:0/2602947955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b013ebc0 msgr2=0x7f30b013f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:12.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.891+0000 7f30b5190640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b013ebc0 0x7f30b013f020 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f30a802aec0 tx=0x7f30a8033bf0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.891+0000 7f30b5190640 1 -- 172.21.15.159:0/2602947955 shutdown_connections 2024-07-24T16:39:12.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.891+0000 7f30b5190640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3090077010 0x7f30900794d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.891+0000 7f30b5190640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f30b013ebc0 0x7f30b013f020 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.891+0000 7f30b5190640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f30b01e5d10 0x7f30b01e6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.891+0000 7f30b5190640 1 --2- 172.21.15.159:0/2602947955 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f309c005e50 0x7f30b0158d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:12.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.891+0000 7f30b5190640 1 -- 172.21.15.159:0/2602947955 >> 172.21.15.159:0/2602947955 conn(0x7f30b006c560 msgr2=0x7f30b015b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:12.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.891+0000 7f30b5190640 1 -- 172.21.15.159:0/2602947955 shutdown_connections 2024-07-24T16:39:12.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:12.891+0000 7f30b5190640 1 -- 172.21.15.159:0/2602947955 wait complete. 2024-07-24T16:39:13.905 INFO:tasks.ceph:Scrubbing osd.0 2024-07-24T16:39:13.906 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-07-24T16:39:13.982 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:39:13.985 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:39:14.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.021+0000 7f6d6af72640 1 -- 172.21.15.159:0/3063320262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d6415c800 msgr2=0x7f6d6415cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.021+0000 7f6d6af72640 1 --2- 172.21.15.159:0/3063320262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d6415c800 0x7f6d6415cc90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c005fd0 tx=0x7f6d5c02aa00 comp rx=0 tx=0).stop 2024-07-24T16:39:14.024 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.021+0000 7f6d6af72640 1 -- 172.21.15.159:0/3063320262 shutdown_connections 2024-07-24T16:39:14.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.021+0000 7f6d6af72640 1 --2- 172.21.15.159:0/3063320262 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6d6415b4b0 0x7f6d6406ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.021+0000 7f6d6af72640 1 --2- 172.21.15.159:0/3063320262 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d6415c800 0x7f6d6415cc90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.021+0000 7f6d6af72640 1 -- 172.21.15.159:0/3063320262 >> 172.21.15.159:0/3063320262 conn(0x7f6d6406c560 msgr2=0x7f6d6406c940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:14.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.021+0000 7f6d6af72640 1 -- 172.21.15.159:0/3063320262 shutdown_connections 2024-07-24T16:39:14.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.021+0000 7f6d6af72640 1 -- 172.21.15.159:0/3063320262 wait complete. 2024-07-24T16:39:14.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.022+0000 7f6d6af72640 1 Processor -- start 2024-07-24T16:39:14.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.022+0000 7f6d6af72640 1 -- start start 2024-07-24T16:39:14.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.023+0000 7f6d6af72640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d640733a0 0x7f6d64154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.023+0000 7f6d6af72640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d6415b4b0 0x7f6d6413f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.023+0000 7f6d6af72640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6d6415c800 0x7f6d64157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.023+0000 7f6d6af72640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6415d350 con 0x7f6d6415b4b0 2024-07-24T16:39:14.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.023+0000 7f6d6af72640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6415d1d0 con 0x7f6d640733a0 2024-07-24T16:39:14.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.023+0000 7f6d6af72640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6d6415d4d0 con 0x7f6d6415c800 2024-07-24T16:39:14.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.023+0000 7f6d63fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d6415b4b0 0x7f6d6413f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.023+0000 7f6d63fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d6415b4b0 0x7f6d6413f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49838/0 (socket says 172.21.15.159:49838) 2024-07-24T16:39:14.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.023+0000 7f6d63fff640 1 -- 172.21.15.159:0/474601979 learned_addr learned my addr 172.21.15.159:0/474601979 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:14.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.023+0000 7f6d68d0e640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d640733a0 0x7f6d64154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.023+0000 7f6d6950f640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6d6415c800 0x7f6d64157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.024+0000 7f6d63fff640 1 -- 172.21.15.159:0/474601979 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6d6415c800 msgr2=0x7f6d64157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.024+0000 7f6d63fff640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6d6415c800 0x7f6d64157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.024+0000 7f6d63fff640 1 -- 172.21.15.159:0/474601979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d640733a0 msgr2=0x7f6d64154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.024+0000 7f6d63fff640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6d640733a0 0x7f6d64154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.024+0000 7f6d63fff640 1 -- 172.21.15.159:0/474601979 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6413fcc0 con 0x7f6d6415b4b0 2024-07-24T16:39:14.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.024+0000 7f6d63fff640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d6415b4b0 0x7f6d6413f140 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00c970 tx=0x7f6d4c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:14.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.024+0000 7f6d617fa640 1 -- 172.21.15.159:0/474601979 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c007bb0 con 0x7f6d6415b4b0 2024-07-24T16:39:14.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.024+0000 7f6d617fa640 1 -- 172.21.15.159:0/474601979 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d4c005020 con 0x7f6d6415b4b0 2024-07-24T16:39:14.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.024+0000 7f6d6af72640 1 -- 172.21.15.159:0/474601979 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d64140240 con 0x7f6d6415b4b0 2024-07-24T16:39:14.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.024+0000 7f6d617fa640 1 -- 172.21.15.159:0/474601979 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d4c007e60 con 0x7f6d6415b4b0 2024-07-24T16:39:14.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.024+0000 7f6d6af72640 1 -- 172.21.15.159:0/474601979 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d64140800 con 0x7f6d6415b4b0 2024-07-24T16:39:14.031 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.025+0000 7f6d6af72640 1 -- 172.21.15.159:0/474601979 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6d6415d920 con 0x7f6d6415b4b0 2024-07-24T16:39:14.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.026+0000 7f6d617fa640 1 -- 172.21.15.159:0/474601979 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f6d4c005470 con 0x7f6d6415b4b0 2024-07-24T16:39:14.032 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.026+0000 7f6d617fa640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f6d44077010 0x7f6d440794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.026+0000 7f6d617fa640 1 -- 172.21.15.159:0/474601979 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f6d4c099530 con 0x7f6d6415b4b0 2024-07-24T16:39:14.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.026+0000 7f6d68d0e640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f6d44077010 0x7f6d440794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.026+0000 7f6d617fa640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] conn(0x7f6d4407fd40 0x7f6d44082190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.026+0000 7f6d617fa640 1 -- 172.21.15.159:0/474601979 --> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d4c017e70 con 0x7f6d4407fd40 2024-07-24T16:39:14.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.026+0000 7f6d617fa640 1 -- 172.21.15.159:0/474601979 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f6d4c0999c0 con 0x7f6d6415b4b0 2024-07-24T16:39:14.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.026+0000 7f6d6950f640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] conn(0x7f6d4407fd40 0x7f6d44082190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.027+0000 7f6d6950f640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] conn(0x7f6d4407fd40 0x7f6d44082190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:14.033 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.027+0000 7f6d68d0e640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f6d44077010 0x7f6d440794d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6d54004f60 tx=0x7f6d54007e30 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:14.034 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.027+0000 7f6d617fa640 1 -- 172.21.15.159:0/474601979 <== osd.0 v2:172.21.15.159:6811/1335917367 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6d4c017e70 con 0x7f6d4407fd40 2024-07-24T16:39:14.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.041+0000 7f6d6af72640 1 -- 172.21.15.159:0/474601979 --> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6d6413f8d0 con 0x7f6d4407fd40 2024-07-24T16:39:14.043 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.041+0000 7f6d617fa640 1 -- 172.21.15.159:0/474601979 <== osd.0 v2:172.21.15.159:6811/1335917367 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6d6413f8d0 con 0x7f6d4407fd40 2024-07-24T16:39:14.044 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:39:14.044 INFO:teuthology.orchestra.run.smithi159.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-24T16:39:14.044 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:39:14.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.041+0000 7f6d6af72640 1 -- 172.21.15.159:0/474601979 >> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] conn(0x7f6d4407fd40 msgr2=0x7f6d44082190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.041+0000 7f6d6af72640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.159:6811/1335917367,v1:172.21.15.159:6812/1335917367] conn(0x7f6d4407fd40 0x7f6d44082190 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.041+0000 7f6d6af72640 1 -- 172.21.15.159:0/474601979 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f6d44077010 msgr2=0x7f6d440794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.041+0000 7f6d6af72640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f6d44077010 0x7f6d440794d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6d54004f60 tx=0x7f6d54007e30 comp rx=0 tx=0).stop 2024-07-24T16:39:14.045 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.041+0000 7f6d6af72640 1 -- 172.21.15.159:0/474601979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d6415b4b0 msgr2=0x7f6d6413f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.041+0000 7f6d6af72640 1 --2- 172.21.15.159:0/474601979 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6d6415b4b0 0x7f6d6413f140 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f6d4c00c970 tx=0x7f6d4c00ce30 comp rx=0 tx=0).stop 2024-07-24T16:39:14.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.041+0000 7f6d6950f640 1 -- 172.21.15.159:0/474601979 reap_dead start 2024-07-24T16:39:14.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.041+0000 7f6d6af72640 1 -- 172.21.15.159:0/474601979 shutdown_connections 2024-07-24T16:39:14.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.041+0000 7f6d6af72640 1 -- 172.21.15.159:0/474601979 >> 172.21.15.159:0/474601979 conn(0x7f6d6406c560 msgr2=0x7f6d6415e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:14.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.041+0000 7f6d6af72640 1 -- 172.21.15.159:0/474601979 shutdown_connections 2024-07-24T16:39:14.046 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.042+0000 7f6d6af72640 1 -- 172.21.15.159:0/474601979 wait complete. 2024-07-24T16:39:14.055 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-07-24T16:39:14.201 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.198+0000 7fa14b30c640 1 -- 172.21.15.159:0/2739816051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c004d40 msgr2=0x7fa12c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.198+0000 7fa14b30c640 1 --2- 172.21.15.159:0/2739816051 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c004d40 0x7fa12c0051c0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fa13c001690 tx=0x7fa12c005830 comp rx=0 tx=0).stop 2024-07-24T16:39:14.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.198+0000 7fa1498a9640 1 -- 172.21.15.159:0/2739816051 reap_dead start 2024-07-24T16:39:14.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.199+0000 7fa14b30c640 1 -- 172.21.15.159:0/2739816051 shutdown_connections 2024-07-24T16:39:14.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.199+0000 7fa14b30c640 1 -- 172.21.15.159:0/2739816051 >> 172.21.15.159:0/2739816051 conn(0x7fa14406c560 msgr2=0x7fa14406c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:14.202 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.199+0000 7fa14b30c640 1 -- 172.21.15.159:0/2739816051 shutdown_connections 2024-07-24T16:39:14.203 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.199+0000 7fa14b30c640 1 -- 172.21.15.159:0/2739816051 wait complete. 2024-07-24T16:39:14.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.200+0000 7fa14b30c640 1 Processor -- start 2024-07-24T16:39:14.205 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.200+0000 7fa14b30c640 1 -- start start 2024-07-24T16:39:14.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa14b30c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c004d40 0x7fa144157430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa14b30c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa1441501c0 0x7fa1441f29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa14b30c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa144157970 0x7fa144150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa14b30c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa14415c6a0 con 0x7fa12c004d40 2024-07-24T16:39:14.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa14b30c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa14415c820 con 0x7fa144157970 2024-07-24T16:39:14.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa14b30c640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa14414f120 con 0x7fa1441501c0 2024-07-24T16:39:14.206 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa1490a8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c004d40 0x7fa144157430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa1490a8640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c004d40 0x7fa144157430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49856/0 (socket says 172.21.15.159:49856) 2024-07-24T16:39:14.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa1490a8640 1 -- 172.21.15.159:0/1367729672 learned_addr learned my addr 172.21.15.159:0/1367729672 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:14.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa1488a7640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa1441501c0 0x7fa1441f29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa1498a9640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa144157970 0x7fa144150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa1490a8640 1 -- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa1441501c0 msgr2=0x7fa1441f29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.207 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa1490a8640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa1441501c0 0x7fa1441f29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa1490a8640 1 -- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa144157970 msgr2=0x7fa144150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa1490a8640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa144157970 0x7fa144150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa1490a8640 1 -- 172.21.15.159:0/1367729672 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa14414f400 con 0x7fa12c004d40 2024-07-24T16:39:14.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa1490a8640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c004d40 0x7fa144157430 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa134011d60 tx=0x7fa13400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:14.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa141ffb640 1 -- 172.21.15.159:0/1367729672 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134003d80 con 0x7fa12c004d40 2024-07-24T16:39:14.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa141ffb640 1 -- 172.21.15.159:0/1367729672 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa134011e50 con 0x7fa12c004d40 2024-07-24T16:39:14.208 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa141ffb640 1 -- 172.21.15.159:0/1367729672 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa134004d40 con 0x7fa12c004d40 2024-07-24T16:39:14.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.201+0000 7fa14b30c640 1 -- 172.21.15.159:0/1367729672 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa14414f6e0 con 0x7fa12c004d40 2024-07-24T16:39:14.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.202+0000 7fa14b30c640 1 -- 172.21.15.159:0/1367729672 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa14414fca0 con 0x7fa12c004d40 2024-07-24T16:39:14.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.203+0000 7fa14b30c640 1 -- 172.21.15.159:0/1367729672 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa14406fa00 con 0x7fa12c004d40 2024-07-24T16:39:14.209 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.203+0000 7fa141ffb640 1 -- 172.21.15.159:0/1367729672 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fa134004050 con 0x7fa12c004d40 2024-07-24T16:39:14.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.204+0000 7fa141ffb640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa130077040 0x7fa130079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.204+0000 7fa141ffb640 1 -- 172.21.15.159:0/1367729672 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7fa1340999a0 con 0x7fa12c004d40 2024-07-24T16:39:14.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.204+0000 7fa1488a7640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa130077040 0x7fa130079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.210 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.204+0000 7fa1488a7640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa130077040 0x7fa130079500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa144152520 tx=0x7fa138006720 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:14.211 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.208+0000 7fa141ffb640 1 -- 172.21.15.159:0/1367729672 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa134062380 con 0x7fa12c004d40 2024-07-24T16:39:14.393 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.390+0000 7fa14b30c640 1 -- 172.21.15.159:0/1367729672 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fa14415f2f0 con 0x7fa130077040 2024-07-24T16:39:14.394 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.391+0000 7fa141ffb640 1 -- 172.21.15.159:0/1367729672 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa138006c50 con 0x7fa130077040 2024-07-24T16:39:14.394 INFO:teuthology.orchestra.run.smithi159.stderr:instructed osd(s) 0 to deep-scrub 2024-07-24T16:39:14.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.393+0000 7fa14b30c640 1 -- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa130077040 msgr2=0x7fa130079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.393+0000 7fa14b30c640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa130077040 0x7fa130079500 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa144152520 tx=0x7fa138006720 comp rx=0 tx=0).stop 2024-07-24T16:39:14.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.393+0000 7fa14b30c640 1 -- 172.21.15.159:0/1367729672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c004d40 msgr2=0x7fa144157430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.393+0000 7fa14b30c640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c004d40 0x7fa144157430 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fa134011d60 tx=0x7fa13400f790 comp rx=0 tx=0).stop 2024-07-24T16:39:14.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.393+0000 7fa14b30c640 1 -- 172.21.15.159:0/1367729672 shutdown_connections 2024-07-24T16:39:14.397 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.393+0000 7fa14b30c640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa144157970 0x7fa144150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.393+0000 7fa14b30c640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa1441501c0 0x7fa1441f29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.393+0000 7fa14b30c640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa130077040 0x7fa130079500 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.393+0000 7fa14b30c640 1 --2- 172.21.15.159:0/1367729672 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa12c004d40 0x7fa144157430 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.394+0000 7fa14b30c640 1 -- 172.21.15.159:0/1367729672 >> 172.21.15.159:0/1367729672 conn(0x7fa14406c560 msgr2=0x7fa14415cc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:14.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.394+0000 7fa14b30c640 1 -- 172.21.15.159:0/1367729672 shutdown_connections 2024-07-24T16:39:14.398 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.394+0000 7fa14b30c640 1 -- 172.21.15.159:0/1367729672 wait complete. 2024-07-24T16:39:14.407 INFO:tasks.ceph:Scrubbing osd.1 2024-07-24T16:39:14.407 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-07-24T16:39:14.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.515+0000 7f81637ae640 1 -- 172.21.15.159:0/3187349746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8148003a30 msgr2=0x7f8148003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.518 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.515+0000 7f81637ae640 1 --2- 172.21.15.159:0/3187349746 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8148003a30 0x7f8148003e50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f815800c260 tx=0x7f8148005830 comp rx=0 tx=0).stop 2024-07-24T16:39:14.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.515+0000 7f8161d4b640 1 -- 172.21.15.159:0/3187349746 reap_dead start 2024-07-24T16:39:14.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.515+0000 7f81637ae640 1 -- 172.21.15.159:0/3187349746 shutdown_connections 2024-07-24T16:39:14.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.515+0000 7f81637ae640 1 -- 172.21.15.159:0/3187349746 >> 172.21.15.159:0/3187349746 conn(0x7f815c06c560 msgr2=0x7f815c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:14.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.515+0000 7f81637ae640 1 -- 172.21.15.159:0/3187349746 shutdown_connections 2024-07-24T16:39:14.519 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.515+0000 7f81637ae640 1 -- 172.21.15.159:0/3187349746 wait complete. 2024-07-24T16:39:14.521 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.517+0000 7f81637ae640 1 Processor -- start 2024-07-24T16:39:14.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.517+0000 7f81637ae640 1 -- start start 2024-07-24T16:39:14.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.517+0000 7f81637ae640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8148003a30 0x7f815c1f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.517+0000 7f81637ae640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f815c1591c0 0x7f815c159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.517+0000 7f81637ae640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f815c1eab00 0x7f815c1eaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.517+0000 7f81637ae640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f815c0cdd50 con 0x7f8148003a30 2024-07-24T16:39:14.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.517+0000 7f81637ae640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f815c0cdbd0 con 0x7f815c1591c0 2024-07-24T16:39:14.522 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.517+0000 7f81637ae640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f815c0cded0 con 0x7f815c1eab00 2024-07-24T16:39:14.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.517+0000 7f816154a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8148003a30 0x7f815c1f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.517+0000 7f816154a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8148003a30 0x7f815c1f8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49864/0 (socket says 172.21.15.159:49864) 2024-07-24T16:39:14.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.517+0000 7f816154a640 1 -- 172.21.15.159:0/1528429214 learned_addr learned my addr 172.21.15.159:0/1528429214 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:14.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.517+0000 7f8160d49640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f815c1591c0 0x7f815c159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.517+0000 7f8161d4b640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f815c1eab00 0x7f815c1eaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.518+0000 7f816154a640 1 -- 172.21.15.159:0/1528429214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f815c1eab00 msgr2=0x7f815c1eaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.518+0000 7f816154a640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f815c1eab00 0x7f815c1eaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.523 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.518+0000 7f816154a640 1 -- 172.21.15.159:0/1528429214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f815c1591c0 msgr2=0x7f815c159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.518+0000 7f816154a640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f815c1591c0 0x7f815c159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.518+0000 7f816154a640 1 -- 172.21.15.159:0/1528429214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815c1f8a40 con 0x7f8148003a30 2024-07-24T16:39:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.518+0000 7f816154a640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8148003a30 0x7f815c1f8500 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f815800c260 tx=0x7f8158006c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.518+0000 7f8151ffb640 1 -- 172.21.15.159:0/1528429214 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158031040 con 0x7f8148003a30 2024-07-24T16:39:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.518+0000 7f8151ffb640 1 -- 172.21.15.159:0/1528429214 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f81580035f0 con 0x7f8148003a30 2024-07-24T16:39:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.518+0000 7f81637ae640 1 -- 172.21.15.159:0/1528429214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f815c1f4850 con 0x7f8148003a30 2024-07-24T16:39:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.518+0000 7f8151ffb640 1 -- 172.21.15.159:0/1528429214 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8158003a40 con 0x7f8148003a30 2024-07-24T16:39:14.524 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.518+0000 7f81637ae640 1 -- 172.21.15.159:0/1528429214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f815c1f4e10 con 0x7f8148003a30 2024-07-24T16:39:14.525 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.519+0000 7f81637ae640 1 -- 172.21.15.159:0/1528429214 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f815c0ce430 con 0x7f8148003a30 2024-07-24T16:39:14.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.520+0000 7f8151ffb640 1 -- 172.21.15.159:0/1528429214 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f8158034070 con 0x7f8148003a30 2024-07-24T16:39:14.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.520+0000 7f8151ffb640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f8140077040 0x7f8140079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.526 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.521+0000 7f8151ffb640 1 -- 172.21.15.159:0/1528429214 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f81580b9720 con 0x7f8148003a30 2024-07-24T16:39:14.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.521+0000 7f8160d49640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f8140077040 0x7f8140079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.521+0000 7f8151ffb640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] conn(0x7f814007fd70 0x7f81400821c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.521+0000 7f8151ffb640 1 -- 172.21.15.159:0/1528429214 --> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8158004e70 con 0x7f814007fd70 2024-07-24T16:39:14.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.521+0000 7f8151ffb640 1 -- 172.21.15.159:0/1528429214 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f81580b9c00 con 0x7f8148003a30 2024-07-24T16:39:14.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.521+0000 7f8161d4b640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] conn(0x7f814007fd70 0x7f81400821c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.521+0000 7f8160d49640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f8140077040 0x7f8140079500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f815c0b16d0 tx=0x7f814c006d60 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:14.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.521+0000 7f8161d4b640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] conn(0x7f814007fd70 0x7f81400821c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:14.527 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.522+0000 7f8151ffb640 1 -- 172.21.15.159:0/1528429214 <== osd.1 v2:172.21.15.159:6808/3830259864 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8158004e70 con 0x7f814007fd70 2024-07-24T16:39:14.537 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.535+0000 7f81637ae640 1 -- 172.21.15.159:0/1528429214 --> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f815c0b2960 con 0x7f814007fd70 2024-07-24T16:39:14.538 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.535+0000 7f8151ffb640 1 -- 172.21.15.159:0/1528429214 <== osd.1 v2:172.21.15.159:6808/3830259864 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f815c0b2960 con 0x7f814007fd70 2024-07-24T16:39:14.538 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:39:14.538 INFO:teuthology.orchestra.run.smithi159.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-24T16:39:14.538 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:39:14.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.535+0000 7f81637ae640 1 -- 172.21.15.159:0/1528429214 >> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] conn(0x7f814007fd70 msgr2=0x7f81400821c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.539 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.535+0000 7f81637ae640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.159:6808/3830259864,v1:172.21.15.159:6809/3830259864] conn(0x7f814007fd70 0x7f81400821c0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.536+0000 7f81637ae640 1 -- 172.21.15.159:0/1528429214 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f8140077040 msgr2=0x7f8140079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.536+0000 7f81637ae640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f8140077040 0x7f8140079500 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f815c0b16d0 tx=0x7f814c006d60 comp rx=0 tx=0).stop 2024-07-24T16:39:14.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.536+0000 7f81637ae640 1 -- 172.21.15.159:0/1528429214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8148003a30 msgr2=0x7f815c1f8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.536+0000 7f81637ae640 1 --2- 172.21.15.159:0/1528429214 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f8148003a30 0x7f815c1f8500 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f815800c260 tx=0x7f8158006c30 comp rx=0 tx=0).stop 2024-07-24T16:39:14.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.536+0000 7f8161d4b640 1 -- 172.21.15.159:0/1528429214 reap_dead start 2024-07-24T16:39:14.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.536+0000 7f81637ae640 1 -- 172.21.15.159:0/1528429214 shutdown_connections 2024-07-24T16:39:14.540 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.536+0000 7f81637ae640 1 -- 172.21.15.159:0/1528429214 >> 172.21.15.159:0/1528429214 conn(0x7f815c06c560 msgr2=0x7f815c06c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:14.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.536+0000 7f81637ae640 1 -- 172.21.15.159:0/1528429214 shutdown_connections 2024-07-24T16:39:14.541 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.536+0000 7f81637ae640 1 -- 172.21.15.159:0/1528429214 wait complete. 2024-07-24T16:39:14.549 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-07-24T16:39:14.655 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.652+0000 7fb307408640 1 -- 172.21.15.159:0/1504018988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3000b2ae0 msgr2=0x7fb300161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.652+0000 7fb307408640 1 --2- 172.21.15.159:0/1504018988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3000b2ae0 0x7fb300161f20 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc005fd0 tx=0x7fb2fc02a710 comp rx=0 tx=0).stop 2024-07-24T16:39:14.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.652+0000 7fb307408640 1 -- 172.21.15.159:0/1504018988 shutdown_connections 2024-07-24T16:39:14.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.652+0000 7fb307408640 1 --2- 172.21.15.159:0/1504018988 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3000b2ae0 0x7fb300161f20 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.652+0000 7fb307408640 1 -- 172.21.15.159:0/1504018988 >> 172.21.15.159:0/1504018988 conn(0x7fb30009cd30 msgr2=0x7fb3000d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:14.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.653+0000 7fb307408640 1 -- 172.21.15.159:0/1504018988 shutdown_connections 2024-07-24T16:39:14.656 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.653+0000 7fb307408640 1 -- 172.21.15.159:0/1504018988 wait complete. 2024-07-24T16:39:14.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.654+0000 7fb307408640 1 Processor -- start 2024-07-24T16:39:14.658 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.654+0000 7fb307408640 1 -- start start 2024-07-24T16:39:14.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.654+0000 7fb307408640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3000b2ae0 0x7fb3001594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.654+0000 7fb307408640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb3000cf770 0x7fb3001f3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.654+0000 7fb307408640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb30015d950 0x7fb3000ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb307408640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fb3000d0b70 con 0x7fb3000b2ae0 2024-07-24T16:39:14.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb307408640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fb3000d09f0 con 0x7fb30015d950 2024-07-24T16:39:14.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb307408640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fb3000cfbc0 con 0x7fb3000cf770 2024-07-24T16:39:14.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb3051a4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3000b2ae0 0x7fb3001594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.659 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb3051a4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3000b2ae0 0x7fb3001594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49878/0 (socket says 172.21.15.159:49878) 2024-07-24T16:39:14.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb3051a4640 1 -- 172.21.15.159:0/985984029 learned_addr learned my addr 172.21.15.159:0/985984029 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:14.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb3049a3640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb3000cf770 0x7fb3001f3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb3059a5640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb30015d950 0x7fb3000ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb3051a4640 1 -- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb3000cf770 msgr2=0x7fb3001f3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb3051a4640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb3000cf770 0x7fb3001f3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb3051a4640 1 -- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb30015d950 msgr2=0x7fb3000ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb3051a4640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb30015d950 0x7fb3000ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.660 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb3051a4640 1 -- 172.21.15.159:0/985984029 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb300158430 con 0x7fb3000b2ae0 2024-07-24T16:39:14.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb3051a4640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3000b2ae0 0x7fb3001594d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400c370 tx=0x7fb2f400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:14.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb2f1ffb640 1 -- 172.21.15.159:0/985984029 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4017070 con 0x7fb3000b2ae0 2024-07-24T16:39:14.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb2f1ffb640 1 -- 172.21.15.159:0/985984029 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2f40035f0 con 0x7fb3000b2ae0 2024-07-24T16:39:14.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb2f1ffb640 1 -- 172.21.15.159:0/985984029 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2f4003a40 con 0x7fb3000b2ae0 2024-07-24T16:39:14.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb307408640 1 -- 172.21.15.159:0/985984029 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb300158710 con 0x7fb3000b2ae0 2024-07-24T16:39:14.661 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.655+0000 7fb307408640 1 -- 172.21.15.159:0/985984029 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb300158cd0 con 0x7fb3000b2ae0 2024-07-24T16:39:14.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.656+0000 7fb307408640 1 -- 172.21.15.159:0/985984029 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb300075740 con 0x7fb3000b2ae0 2024-07-24T16:39:14.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.657+0000 7fb2f1ffb640 1 -- 172.21.15.159:0/985984029 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fb2f401a070 con 0x7fb3000b2ae0 2024-07-24T16:39:14.662 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.657+0000 7fb2f1ffb640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb2e4077040 0x7fb2e4079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.658+0000 7fb2f1ffb640 1 -- 172.21.15.159:0/985984029 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7fb2f4097d90 con 0x7fb3000b2ae0 2024-07-24T16:39:14.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.658+0000 7fb3049a3640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb2e4077040 0x7fb2e4079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.663 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.658+0000 7fb3049a3640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb2e4077040 0x7fb2e4079500 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc033000 tx=0x7fb2fc004730 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:14.664 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.662+0000 7fb2f1ffb640 1 -- 172.21.15.159:0/985984029 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fb2f4060770 con 0x7fb3000b2ae0 2024-07-24T16:39:14.857 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.855+0000 7fb307408640 1 -- 172.21.15.159:0/985984029 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fb30006cfc0 con 0x7fb2e4077040 2024-07-24T16:39:14.858 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.855+0000 7fb2f1ffb640 1 -- 172.21.15.159:0/985984029 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb30006cfc0 con 0x7fb2e4077040 2024-07-24T16:39:14.858 INFO:teuthology.orchestra.run.smithi159.stderr:instructed osd(s) 1 to deep-scrub 2024-07-24T16:39:14.860 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.858+0000 7fb307408640 1 -- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb2e4077040 msgr2=0x7fb2e4079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.858+0000 7fb307408640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb2e4077040 0x7fb2e4079500 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc033000 tx=0x7fb2fc004730 comp rx=0 tx=0).stop 2024-07-24T16:39:14.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.858+0000 7fb307408640 1 -- 172.21.15.159:0/985984029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3000b2ae0 msgr2=0x7fb3001594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.858+0000 7fb307408640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3000b2ae0 0x7fb3001594d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fb2f400c370 tx=0x7fb2f400c830 comp rx=0 tx=0).stop 2024-07-24T16:39:14.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.858+0000 7fb307408640 1 -- 172.21.15.159:0/985984029 shutdown_connections 2024-07-24T16:39:14.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.858+0000 7fb307408640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fb30015d950 0x7fb3000ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.861 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.858+0000 7fb307408640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fb3000cf770 0x7fb3001f3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.858+0000 7fb307408640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fb2e4077040 0x7fb2e4079500 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.858+0000 7fb307408640 1 --2- 172.21.15.159:0/985984029 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fb3000b2ae0 0x7fb3001594d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.858+0000 7fb307408640 1 -- 172.21.15.159:0/985984029 >> 172.21.15.159:0/985984029 conn(0x7fb30009cd30 msgr2=0x7fb3000d4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:14.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.858+0000 7fb307408640 1 -- 172.21.15.159:0/985984029 shutdown_connections 2024-07-24T16:39:14.862 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.858+0000 7fb307408640 1 -- 172.21.15.159:0/985984029 wait complete. 2024-07-24T16:39:14.872 INFO:tasks.ceph:Scrubbing osd.2 2024-07-24T16:39:14.872 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-07-24T16:39:14.981 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.978+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/2153049337 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3e880ce740 msgr2=0x7f3e880b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.978+0000 7f3e8d7b0640 1 --2- 172.21.15.159:0/2153049337 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3e880ce740 0x7f3e880b3af0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3e70009860 tx=0x7f3e7002a530 comp rx=0 tx=0).stop 2024-07-24T16:39:14.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.978+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/2153049337 shutdown_connections 2024-07-24T16:39:14.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.978+0000 7f3e8d7b0640 1 --2- 172.21.15.159:0/2153049337 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3e880ce740 0x7f3e880b3af0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.978+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/2153049337 >> 172.21.15.159:0/2153049337 conn(0x7f3e8809aa20 msgr2=0x7f3e880b33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:14.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.978+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/2153049337 shutdown_connections 2024-07-24T16:39:14.982 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.978+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/2153049337 wait complete. 2024-07-24T16:39:14.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.980+0000 7f3e8d7b0640 1 Processor -- start 2024-07-24T16:39:14.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.980+0000 7f3e8d7b0640 1 -- start start 2024-07-24T16:39:14.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.980+0000 7f3e8d7b0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3e8809ae30 0x7f3e8809f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.980+0000 7f3e8d7b0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e880ce740 0x7f3e880b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.980+0000 7f3e8d7b0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e8815eb70 0x7f3e880b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.985 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.980+0000 7f3e8d7b0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3e880cd2b0 con 0x7f3e880ce740 2024-07-24T16:39:14.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.980+0000 7f3e8d7b0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3e880cd130 con 0x7f3e8815eb70 2024-07-24T16:39:14.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.980+0000 7f3e8d7b0640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3e880cd430 con 0x7f3e8809ae30 2024-07-24T16:39:14.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e7ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e880ce740 0x7f3e880b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e86ffd640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3e8809ae30 0x7f3e8809f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e7ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e880ce740 0x7f3e880b46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49888/0 (socket says 172.21.15.159:49888) 2024-07-24T16:39:14.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e7ffff640 1 -- 172.21.15.159:0/3594950197 learned_addr learned my addr 172.21.15.159:0/3594950197 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:14.986 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e877fe640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e8815eb70 0x7f3e880b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e86ffd640 1 -- 172.21.15.159:0/3594950197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e8815eb70 msgr2=0x7f3e880b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e86ffd640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3e8815eb70 0x7f3e880b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e86ffd640 1 -- 172.21.15.159:0/3594950197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e880ce740 msgr2=0x7f3e880b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:14.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e86ffd640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e880ce740 0x7f3e880b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:14.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e86ffd640 1 -- 172.21.15.159:0/3594950197 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e880b5130 con 0x7f3e8809ae30 2024-07-24T16:39:14.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e7ffff640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3e880ce740 0x7f3e880b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-07-24T16:39:14.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e86ffd640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3e8809ae30 0x7f3e8809f140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800c450 tx=0x7f3e7800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:14.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e7f7fe640 1 -- 172.21.15.159:0/3594950197 <== mon.2 v2:172.21.15.193:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78017070 con 0x7f3e8809ae30 2024-07-24T16:39:14.987 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e7f7fe640 1 -- 172.21.15.159:0/3594950197 <== mon.2 v2:172.21.15.193:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e780035f0 con 0x7f3e8809ae30 2024-07-24T16:39:14.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e7f7fe640 1 -- 172.21.15.159:0/3594950197 <== mon.2 v2:172.21.15.193:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e78003ac0 con 0x7f3e8809ae30 2024-07-24T16:39:14.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/3594950197 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e880b5410 con 0x7f3e8809ae30 2024-07-24T16:39:14.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.981+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/3594950197 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e880b59d0 con 0x7f3e8809ae30 2024-07-24T16:39:14.988 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.982+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/3594950197 --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3e880b3af0 con 0x7f3e8809ae30 2024-07-24T16:39:14.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.983+0000 7f3e7f7fe640 1 -- 172.21.15.159:0/3594950197 <== mon.2 v2:172.21.15.193:3301/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f3e7801a070 con 0x7f3e8809ae30 2024-07-24T16:39:14.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.983+0000 7f3e7f7fe640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3e68077010 0x7f3e680794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.989 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.983+0000 7f3e7f7fe640 1 -- 172.21.15.159:0/3594950197 <== mon.2 v2:172.21.15.193:3301/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f3e78098080 con 0x7f3e8809ae30 2024-07-24T16:39:14.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.984+0000 7f3e7f7fe640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] conn(0x7f3e6807fd40 0x7f3e68082190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:14.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.984+0000 7f3e7ffff640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3e68077010 0x7f3e680794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.984+0000 7f3e7f7fe640 1 -- 172.21.15.159:0/3594950197 --> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e78015e70 con 0x7f3e6807fd40 2024-07-24T16:39:14.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.984+0000 7f3e7f7fe640 1 -- 172.21.15.159:0/3594950197 <== mon.2 v2:172.21.15.193:3301/0 6 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f3e780984e0 con 0x7f3e8809ae30 2024-07-24T16:39:14.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.984+0000 7f3e877fe640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] conn(0x7f3e6807fd40 0x7f3e68082190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:14.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.984+0000 7f3e877fe640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] conn(0x7f3e6807fd40 0x7f3e68082190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:14.990 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.984+0000 7f3e7ffff640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3e68077010 0x7f3e680794d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e880b3450 tx=0x7f3e70004730 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:14.991 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.985+0000 7f3e7f7fe640 1 -- 172.21.15.159:0/3594950197 <== osd.2 v2:172.21.15.159:6810/3425927328 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3e78015e70 con 0x7f3e6807fd40 2024-07-24T16:39:15.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.998+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/3594950197 --> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3e880ce500 con 0x7f3e6807fd40 2024-07-24T16:39:15.000 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.998+0000 7f3e7f7fe640 1 -- 172.21.15.159:0/3594950197 <== osd.2 v2:172.21.15.159:6810/3425927328 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3e880ce500 con 0x7f3e6807fd40 2024-07-24T16:39:15.001 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:39:15.001 INFO:teuthology.orchestra.run.smithi159.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-24T16:39:15.001 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:39:15.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.998+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/3594950197 >> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] conn(0x7f3e6807fd40 msgr2=0x7f3e68082190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.998+0000 7f3e8d7b0640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.159:6810/3425927328,v1:172.21.15.159:6814/3425927328] conn(0x7f3e6807fd40 0x7f3e68082190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.998+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/3594950197 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3e68077010 msgr2=0x7f3e680794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.002 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.998+0000 7f3e8d7b0640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3e68077010 0x7f3e680794d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e880b3450 tx=0x7f3e70004730 comp rx=0 tx=0).stop 2024-07-24T16:39:15.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.998+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/3594950197 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3e8809ae30 msgr2=0x7f3e8809f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.998+0000 7f3e8d7b0640 1 --2- 172.21.15.159:0/3594950197 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3e8809ae30 0x7f3e8809f140 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3e7800c450 tx=0x7f3e7800c910 comp rx=0 tx=0).stop 2024-07-24T16:39:15.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.998+0000 7f3e877fe640 1 -- 172.21.15.159:0/3594950197 reap_dead start 2024-07-24T16:39:15.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.998+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/3594950197 shutdown_connections 2024-07-24T16:39:15.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.998+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/3594950197 >> 172.21.15.159:0/3594950197 conn(0x7f3e8809aa20 msgr2=0x7f3e8815c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:15.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.998+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/3594950197 shutdown_connections 2024-07-24T16:39:15.003 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:14.998+0000 7f3e8d7b0640 1 -- 172.21.15.159:0/3594950197 wait complete. 2024-07-24T16:39:15.011 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-07-24T16:39:15.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.115+0000 7fc187a16640 1 -- 172.21.15.159:0/3425994073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc18006caa0 msgr2=0x7fc18015b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.115+0000 7fc187a16640 1 --2- 172.21.15.159:0/3425994073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc18006caa0 0x7fc18015b960 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fc170009830 tx=0x7fc17002a4d0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.115+0000 7fc187a16640 1 -- 172.21.15.159:0/3425994073 shutdown_connections 2024-07-24T16:39:15.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.115+0000 7fc187a16640 1 --2- 172.21.15.159:0/3425994073 >> v2:172.21.15.193:3300/0 conn(0x7fc18015fbd0 0x7fc18006c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.115+0000 7fc187a16640 1 --2- 172.21.15.159:0/3425994073 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc18006caa0 0x7fc18015b960 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.115+0000 7fc187a16640 1 -- 172.21.15.159:0/3425994073 >> 172.21.15.159:0/3425994073 conn(0x7fc180071140 msgr2=0x7fc18006d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:15.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.115+0000 7fc187a16640 1 -- 172.21.15.159:0/3425994073 shutdown_connections 2024-07-24T16:39:15.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.115+0000 7fc187a16640 1 -- 172.21.15.159:0/3425994073 wait complete. 2024-07-24T16:39:15.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.116+0000 7fc187a16640 1 Processor -- start 2024-07-24T16:39:15.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.116+0000 7fc187a16640 1 -- start start 2024-07-24T16:39:15.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc187a16640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc18006caa0 0x7fc1800b3790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc187a16640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc180152370 0x7fc1801420e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.121 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc187a16640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc18015fbd0 0x7fc18014da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc187a16640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fc18015c230 con 0x7fc180152370 2024-07-24T16:39:15.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc187a16640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fc18015c0b0 con 0x7fc18015fbd0 2024-07-24T16:39:15.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc187a16640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fc18015c3b0 con 0x7fc18006caa0 2024-07-24T16:39:15.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc184fb1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc180152370 0x7fc1801420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc184fb1640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc180152370 0x7fc1801420e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49892/0 (socket says 172.21.15.159:49892) 2024-07-24T16:39:15.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc184fb1640 1 -- 172.21.15.159:0/2285725537 learned_addr learned my addr 172.21.15.159:0/2285725537 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:15.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc185fb3640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc18015fbd0 0x7fc18014da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.122 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc1857b2640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc18006caa0 0x7fc1800b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc184fb1640 1 -- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc18006caa0 msgr2=0x7fc1800b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc184fb1640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc18006caa0 0x7fc1800b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc184fb1640 1 -- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc18015fbd0 msgr2=0x7fc18014da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc184fb1640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc18015fbd0 0x7fc18014da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.117+0000 7fc184fb1640 1 -- 172.21.15.159:0/2285725537 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1800b3fe0 con 0x7fc180152370 2024-07-24T16:39:15.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.118+0000 7fc184fb1640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc180152370 0x7fc1801420e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc17400eb30 tx=0x7fc17400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:15.123 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.118+0000 7fc17dffb640 1 -- 172.21.15.159:0/2285725537 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174010430 con 0x7fc180152370 2024-07-24T16:39:15.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.118+0000 7fc17dffb640 1 -- 172.21.15.159:0/2285725537 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1740105d0 con 0x7fc180152370 2024-07-24T16:39:15.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.118+0000 7fc187a16640 1 -- 172.21.15.159:0/2285725537 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1800b42c0 con 0x7fc180152370 2024-07-24T16:39:15.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.118+0000 7fc17dffb640 1 -- 172.21.15.159:0/2285725537 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174010a20 con 0x7fc180152370 2024-07-24T16:39:15.124 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.118+0000 7fc187a16640 1 -- 172.21.15.159:0/2285725537 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1800b5010 con 0x7fc180152370 2024-07-24T16:39:15.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.119+0000 7fc187a16640 1 -- 172.21.15.159:0/2285725537 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc18015b960 con 0x7fc180152370 2024-07-24T16:39:15.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.120+0000 7fc17dffb640 1 -- 172.21.15.159:0/2285725537 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fc174010bc0 con 0x7fc180152370 2024-07-24T16:39:15.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.121+0000 7fc17dffb640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fc16c077040 0x7fc16c079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.121+0000 7fc17dffb640 1 -- 172.21.15.159:0/2285725537 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7fc174099750 con 0x7fc180152370 2024-07-24T16:39:15.125 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.121+0000 7fc1857b2640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fc16c077040 0x7fc16c079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.126 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.121+0000 7fc1857b2640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fc16c077040 0x7fc16c079500 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc178007fd0 tx=0x7fc178009040 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:15.127 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.125+0000 7fc17dffb640 1 -- 172.21.15.159:0/2285725537 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fc174062130 con 0x7fc180152370 2024-07-24T16:39:15.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.308+0000 7fc187a16640 1 -- 172.21.15.159:0/2285725537 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc18006eeb0 con 0x7fc16c077040 2024-07-24T16:39:15.311 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.309+0000 7fc17dffb640 1 -- 172.21.15.159:0/2285725537 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc18006eeb0 con 0x7fc16c077040 2024-07-24T16:39:15.312 INFO:teuthology.orchestra.run.smithi159.stderr:instructed osd(s) 2 to deep-scrub 2024-07-24T16:39:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.311+0000 7fc187a16640 1 -- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fc16c077040 msgr2=0x7fc16c079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.311+0000 7fc187a16640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fc16c077040 0x7fc16c079500 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc178007fd0 tx=0x7fc178009040 comp rx=0 tx=0).stop 2024-07-24T16:39:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.311+0000 7fc187a16640 1 -- 172.21.15.159:0/2285725537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc180152370 msgr2=0x7fc1801420e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.311+0000 7fc187a16640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc180152370 0x7fc1801420e0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fc17400eb30 tx=0x7fc17400c2d0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.314 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.311+0000 7fc187a16640 1 -- 172.21.15.159:0/2285725537 shutdown_connections 2024-07-24T16:39:15.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.311+0000 7fc187a16640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fc18015fbd0 0x7fc18014da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.311+0000 7fc187a16640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fc16c077040 0x7fc16c079500 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.311+0000 7fc187a16640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fc180152370 0x7fc1801420e0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.311+0000 7fc187a16640 1 --2- 172.21.15.159:0/2285725537 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fc18006caa0 0x7fc1800b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.311+0000 7fc187a16640 1 -- 172.21.15.159:0/2285725537 >> 172.21.15.159:0/2285725537 conn(0x7fc180071140 msgr2=0x7fc1800cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:15.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.311+0000 7fc187a16640 1 -- 172.21.15.159:0/2285725537 shutdown_connections 2024-07-24T16:39:15.315 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.311+0000 7fc187a16640 1 -- 172.21.15.159:0/2285725537 wait complete. 2024-07-24T16:39:15.324 INFO:tasks.ceph:Scrubbing osd.3 2024-07-24T16:39:15.324 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-07-24T16:39:15.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.430+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/2131821030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa80afb60 msgr2=0x7f3aa80cda20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.430+0000 7f3aaf0d3640 1 --2- 172.21.15.159:0/2131821030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa80afb60 0x7f3aa80cda20 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8156100 tx=0x7f3a9c02a4a0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.433 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.430+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/2131821030 shutdown_connections 2024-07-24T16:39:15.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.430+0000 7f3aaf0d3640 1 --2- 172.21.15.159:0/2131821030 >> v2:172.21.15.193:3300/0 conn(0x7f3aa806cc70 0x7f3aa80cf620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.430+0000 7f3aaf0d3640 1 --2- 172.21.15.159:0/2131821030 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa80afb60 0x7f3aa80cda20 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.430+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/2131821030 >> 172.21.15.159:0/2131821030 conn(0x7f3aa80b2440 msgr2=0x7f3aa80b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:15.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.430+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/2131821030 shutdown_connections 2024-07-24T16:39:15.434 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.430+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/2131821030 wait complete. 2024-07-24T16:39:15.436 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.431+0000 7f3aaf0d3640 1 Processor -- start 2024-07-24T16:39:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.431+0000 7f3aaf0d3640 1 -- start start 2024-07-24T16:39:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.432+0000 7f3aaf0d3640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3aa806cc70 0x7f3aa814e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.432+0000 7f3aaf0d3640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3aa80afb60 0x7f3aa80ae460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.432+0000 7f3aaf0d3640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa815bb40 0x7f3aa80ae9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.432+0000 7f3aaf0d3640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa80cfef0 con 0x7f3aa815bb40 2024-07-24T16:39:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.432+0000 7f3aaf0d3640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa80cfd70 con 0x7f3aa806cc70 2024-07-24T16:39:15.437 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.432+0000 7f3aaf0d3640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa80d0070 con 0x7f3aa80afb60 2024-07-24T16:39:15.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.432+0000 7f3aad670640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa815bb40 0x7f3aa80ae9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aad670640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa815bb40 0x7f3aa80ae9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49922/0 (socket says 172.21.15.159:49922) 2024-07-24T16:39:15.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aad670640 1 -- 172.21.15.159:0/3465312123 learned_addr learned my addr 172.21.15.159:0/3465312123 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:15.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aace6f640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3aa806cc70 0x7f3aa814e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aa7fff640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3aa80afb60 0x7f3aa80ae460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.438 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aad670640 1 -- 172.21.15.159:0/3465312123 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3aa80afb60 msgr2=0x7f3aa80ae460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aad670640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f3aa80afb60 0x7f3aa80ae460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aad670640 1 -- 172.21.15.159:0/3465312123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3aa806cc70 msgr2=0x7f3aa814e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aad670640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f3aa806cc70 0x7f3aa814e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aad670640 1 -- 172.21.15.159:0/3465312123 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa8152d00 con 0x7f3aa815bb40 2024-07-24T16:39:15.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aad670640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa815bb40 0x7f3aa80ae9a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000ea40 tx=0x7f3aa000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:15.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aa57fa640 1 -- 172.21.15.159:0/3465312123 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa000ce40 con 0x7f3aa815bb40 2024-07-24T16:39:15.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aa57fa640 1 -- 172.21.15.159:0/3465312123 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3aa0004c10 con 0x7f3aa815bb40 2024-07-24T16:39:15.439 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/3465312123 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa8152fe0 con 0x7f3aa815bb40 2024-07-24T16:39:15.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aa57fa640 1 -- 172.21.15.159:0/3465312123 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa0005020 con 0x7f3aa815bb40 2024-07-24T16:39:15.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.433+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/3465312123 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa81535a0 con 0x7f3aa815bb40 2024-07-24T16:39:15.440 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.434+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/3465312123 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3aa81f6130 con 0x7f3aa815bb40 2024-07-24T16:39:15.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.435+0000 7f3aa57fa640 1 -- 172.21.15.159:0/3465312123 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f3aa00051c0 con 0x7f3aa815bb40 2024-07-24T16:39:15.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.435+0000 7f3aa57fa640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3a8c077010 0x7f3a8c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.435+0000 7f3aa57fa640 1 -- 172.21.15.159:0/3465312123 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f3aa009a010 con 0x7f3aa815bb40 2024-07-24T16:39:15.441 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.436+0000 7f3aa57fa640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] conn(0x7f3a8c07fd40 0x7f3a8c082190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.436+0000 7f3aace6f640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3a8c077010 0x7f3a8c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.436+0000 7f3aa57fa640 1 -- 172.21.15.159:0/3465312123 --> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3aa0011ea0 con 0x7f3a8c07fd40 2024-07-24T16:39:15.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.436+0000 7f3aa57fa640 1 -- 172.21.15.159:0/3465312123 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f3aa009a4a0 con 0x7f3aa815bb40 2024-07-24T16:39:15.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.436+0000 7f3aa7fff640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] conn(0x7f3a8c07fd40 0x7f3a8c082190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.436+0000 7f3aa7fff640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] conn(0x7f3a8c07fd40 0x7f3a8c082190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:15.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.436+0000 7f3aace6f640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3a8c077010 0x7f3a8c0794d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c034000 tx=0x7f3a9c004730 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:15.442 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.437+0000 7f3aa57fa640 1 -- 172.21.15.159:0/3465312123 <== osd.3 v2:172.21.15.159:6800/1890079338 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3aa0011ea0 con 0x7f3a8c07fd40 2024-07-24T16:39:15.452 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.450+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/3465312123 --> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f3aa80b02a0 con 0x7f3a8c07fd40 2024-07-24T16:39:15.453 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.450+0000 7f3aa57fa640 1 -- 172.21.15.159:0/3465312123 <== osd.3 v2:172.21.15.159:6800/1890079338 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f3aa80b02a0 con 0x7f3a8c07fd40 2024-07-24T16:39:15.453 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:39:15.453 INFO:teuthology.orchestra.run.smithi159.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-24T16:39:15.453 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:39:15.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.450+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/3465312123 >> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] conn(0x7f3a8c07fd40 msgr2=0x7f3a8c082190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.454 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.450+0000 7f3aaf0d3640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.159:6800/1890079338,v1:172.21.15.159:6801/1890079338] conn(0x7f3a8c07fd40 0x7f3a8c082190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.450+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/3465312123 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3a8c077010 msgr2=0x7f3a8c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.450+0000 7f3aaf0d3640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f3a8c077010 0x7f3a8c0794d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3a9c034000 tx=0x7f3a9c004730 comp rx=0 tx=0).stop 2024-07-24T16:39:15.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.450+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/3465312123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa815bb40 msgr2=0x7f3aa80ae9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.450+0000 7f3aaf0d3640 1 --2- 172.21.15.159:0/3465312123 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f3aa815bb40 0x7f3aa80ae9a0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3aa000ea40 tx=0x7f3aa000ef00 comp rx=0 tx=0).stop 2024-07-24T16:39:15.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.450+0000 7f3aad670640 1 -- 172.21.15.159:0/3465312123 reap_dead start 2024-07-24T16:39:15.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.450+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/3465312123 shutdown_connections 2024-07-24T16:39:15.455 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.450+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/3465312123 >> 172.21.15.159:0/3465312123 conn(0x7f3aa80b2440 msgr2=0x7f3aa815ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:15.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.451+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/3465312123 shutdown_connections 2024-07-24T16:39:15.456 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.451+0000 7f3aaf0d3640 1 -- 172.21.15.159:0/3465312123 wait complete. 2024-07-24T16:39:15.463 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-07-24T16:39:15.567 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.564+0000 7f773bd53640 1 -- 172.21.15.159:0/3831509836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340d0fc0 msgr2=0x7f7734071ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.564+0000 7f773bd53640 1 --2- 172.21.15.159:0/3831509836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340d0fc0 0x7f7734071ca0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7728009830 tx=0x7f772802a4a0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.564+0000 7f773bd53640 1 -- 172.21.15.159:0/3831509836 shutdown_connections 2024-07-24T16:39:15.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.564+0000 7f773bd53640 1 --2- 172.21.15.159:0/3831509836 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340d0fc0 0x7f7734071ca0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.564+0000 7f773bd53640 1 -- 172.21.15.159:0/3831509836 >> 172.21.15.159:0/3831509836 conn(0x7f77340b33c0 msgr2=0x7f77340b37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:15.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.564+0000 7f773bd53640 1 -- 172.21.15.159:0/3831509836 shutdown_connections 2024-07-24T16:39:15.568 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.564+0000 7f773bd53640 1 -- 172.21.15.159:0/3831509836 wait complete. 2024-07-24T16:39:15.570 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.566+0000 7f773bd53640 1 Processor -- start 2024-07-24T16:39:15.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.566+0000 7f773bd53640 1 -- start start 2024-07-24T16:39:15.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.566+0000 7f773bd53640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77340721e0 0x7f77341585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.566+0000 7f773bd53640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77340b66e0 0x7f77341557d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.566+0000 7f773bd53640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340d0fc0 0x7f7734143000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.566+0000 7f773bd53640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f77340cf4c0 con 0x7f77340d0fc0 2024-07-24T16:39:15.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.566+0000 7f773bd53640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f77340744c0 con 0x7f77340b66e0 2024-07-24T16:39:15.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.566+0000 7f773bd53640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f77340cf640 con 0x7f77340721e0 2024-07-24T16:39:15.571 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.566+0000 7f773a2f0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340d0fc0 0x7f7734143000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f773a2f0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340d0fc0 0x7f7734143000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49942/0 (socket says 172.21.15.159:49942) 2024-07-24T16:39:15.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f773a2f0640 1 -- 172.21.15.159:0/3940593121 learned_addr learned my addr 172.21.15.159:0/3940593121 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:15.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f77392ee640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77340b66e0 0x7f77341557d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f7739aef640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77340721e0 0x7f77341585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f773a2f0640 1 -- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77340721e0 msgr2=0x7f77341585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.572 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f773a2f0640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77340721e0 0x7f77341585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f773a2f0640 1 -- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77340b66e0 msgr2=0x7f77341557d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f773a2f0640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77340b66e0 0x7f77341557d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f773a2f0640 1 -- 172.21.15.159:0/3940593121 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7734157540 con 0x7f77340d0fc0 2024-07-24T16:39:15.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f773a2f0640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340d0fc0 0x7f7734143000 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f772c00c770 tx=0x7f772c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:15.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f77267fc640 1 -- 172.21.15.159:0/3940593121 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c003da0 con 0x7f77340d0fc0 2024-07-24T16:39:15.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f77267fc640 1 -- 172.21.15.159:0/3940593121 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f772c005070 con 0x7f77340d0fc0 2024-07-24T16:39:15.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f773bd53640 1 -- 172.21.15.159:0/3940593121 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7734157820 con 0x7f77340d0fc0 2024-07-24T16:39:15.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f77267fc640 1 -- 172.21.15.159:0/3940593121 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f772c005500 con 0x7f77340d0fc0 2024-07-24T16:39:15.573 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.567+0000 7f773bd53640 1 -- 172.21.15.159:0/3940593121 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7734157de0 con 0x7f77340d0fc0 2024-07-24T16:39:15.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.568+0000 7f773bd53640 1 -- 172.21.15.159:0/3940593121 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7734071ca0 con 0x7f77340d0fc0 2024-07-24T16:39:15.574 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.569+0000 7f77267fc640 1 -- 172.21.15.159:0/3940593121 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f772c0056a0 con 0x7f77340d0fc0 2024-07-24T16:39:15.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.570+0000 7f77267fc640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7718077010 0x7f77180794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.570+0000 7f77267fc640 1 -- 172.21.15.159:0/3940593121 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f772c098940 con 0x7f77340d0fc0 2024-07-24T16:39:15.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.570+0000 7f7739aef640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7718077010 0x7f77180794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.575 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.570+0000 7f7739aef640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7718077010 0x7f77180794d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7730000f60 tx=0x7f7730009040 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:15.576 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.574+0000 7f77267fc640 1 -- 172.21.15.159:0/3940593121 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f772c061290 con 0x7f77340d0fc0 2024-07-24T16:39:15.764 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.762+0000 7f773bd53640 1 -- 172.21.15.159:0/3940593121 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f77340b0d70 con 0x7f7718077010 2024-07-24T16:39:15.765 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.762+0000 7f77267fc640 1 -- 172.21.15.159:0/3940593121 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f77340b0d70 con 0x7f7718077010 2024-07-24T16:39:15.765 INFO:teuthology.orchestra.run.smithi159.stderr:instructed osd(s) 3 to deep-scrub 2024-07-24T16:39:15.767 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.765+0000 7f773bd53640 1 -- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7718077010 msgr2=0x7f77180794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.765+0000 7f773bd53640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7718077010 0x7f77180794d0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7730000f60 tx=0x7f7730009040 comp rx=0 tx=0).stop 2024-07-24T16:39:15.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.765+0000 7f773bd53640 1 -- 172.21.15.159:0/3940593121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340d0fc0 msgr2=0x7f7734143000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.765+0000 7f773bd53640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340d0fc0 0x7f7734143000 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f772c00c770 tx=0x7f772c00cc30 comp rx=0 tx=0).stop 2024-07-24T16:39:15.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.765+0000 7f773bd53640 1 -- 172.21.15.159:0/3940593121 shutdown_connections 2024-07-24T16:39:15.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.765+0000 7f773bd53640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f7718077010 0x7f77180794d0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.768 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.765+0000 7f773bd53640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f77340d0fc0 0x7f7734143000 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.765+0000 7f773bd53640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f77340b66e0 0x7f77341557d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.765+0000 7f773bd53640 1 --2- 172.21.15.159:0/3940593121 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f77340721e0 0x7f77341585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.765+0000 7f773bd53640 1 -- 172.21.15.159:0/3940593121 >> 172.21.15.159:0/3940593121 conn(0x7f77340b33c0 msgr2=0x7f773415a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:15.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.765+0000 7f773bd53640 1 -- 172.21.15.159:0/3940593121 shutdown_connections 2024-07-24T16:39:15.769 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.765+0000 7f773bd53640 1 -- 172.21.15.159:0/3940593121 wait complete. 2024-07-24T16:39:15.778 INFO:tasks.ceph:Scrubbing osd.4 2024-07-24T16:39:15.779 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-07-24T16:39:15.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.884+0000 7fd733411640 1 -- 172.21.15.159:0/3460998032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0ae5b0 msgr2=0x7fd72c0aea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.884+0000 7fd733411640 1 --2- 172.21.15.159:0/3460998032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0ae5b0 0x7fd72c0aea40 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fd72c074520 tx=0x7fd72002a5f0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.884+0000 7fd733411640 1 -- 172.21.15.159:0/3460998032 shutdown_connections 2024-07-24T16:39:15.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.884+0000 7fd733411640 1 --2- 172.21.15.159:0/3460998032 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0ae5b0 0x7fd72c0aea40 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.887 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.884+0000 7fd733411640 1 --2- 172.21.15.159:0/3460998032 >> v2:172.21.15.193:3300/0 conn(0x7fd72c161980 0x7fd72c161d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.884+0000 7fd733411640 1 -- 172.21.15.159:0/3460998032 >> 172.21.15.159:0/3460998032 conn(0x7fd72c06da90 msgr2=0x7fd72c06dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:15.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.884+0000 7fd733411640 1 -- 172.21.15.159:0/3460998032 shutdown_connections 2024-07-24T16:39:15.888 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.884+0000 7fd733411640 1 -- 172.21.15.159:0/3460998032 wait complete. 2024-07-24T16:39:15.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.885+0000 7fd733411640 1 Processor -- start 2024-07-24T16:39:15.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.885+0000 7fd733411640 1 -- start start 2024-07-24T16:39:15.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd733411640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd72c072f70 0x7fd72c14e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd733411640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0ae5b0 0x7fd72c157a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.890 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd733411640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd72c161980 0x7fd72c158da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd733411640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c073790 con 0x7fd72c0ae5b0 2024-07-24T16:39:15.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd733411640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd72c073610 con 0x7fd72c072f70 2024-07-24T16:39:15.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd733411640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd72c157f80 con 0x7fd72c161980 2024-07-24T16:39:15.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd7309ac640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0ae5b0 0x7fd72c157a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd7309ac640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0ae5b0 0x7fd72c157a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49946/0 (socket says 172.21.15.159:49946) 2024-07-24T16:39:15.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd7309ac640 1 -- 172.21.15.159:0/1445940794 learned_addr learned my addr 172.21.15.159:0/1445940794 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:15.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd7311ad640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd72c072f70 0x7fd72c14e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.891 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd7319ae640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd72c161980 0x7fd72c158da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd7309ac640 1 -- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd72c161980 msgr2=0x7fd72c158da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd7309ac640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd72c161980 0x7fd72c158da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd7309ac640 1 -- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd72c072f70 msgr2=0x7fd72c14e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.886+0000 7fd7309ac640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd72c072f70 0x7fd72c14e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.887+0000 7fd7309ac640 1 -- 172.21.15.159:0/1445940794 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd72c1592e0 con 0x7fd72c0ae5b0 2024-07-24T16:39:15.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.887+0000 7fd7309ac640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0ae5b0 0x7fd72c157a40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd720009850 tx=0x7fd720003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:15.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.887+0000 7fd729ffb640 1 -- 172.21.15.159:0/1445940794 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72003f070 con 0x7fd72c0ae5b0 2024-07-24T16:39:15.892 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.887+0000 7fd729ffb640 1 -- 172.21.15.159:0/1445940794 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7200047a0 con 0x7fd72c0ae5b0 2024-07-24T16:39:15.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.887+0000 7fd729ffb640 1 -- 172.21.15.159:0/1445940794 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720035030 con 0x7fd72c0ae5b0 2024-07-24T16:39:15.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.887+0000 7fd733411640 1 -- 172.21.15.159:0/1445940794 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd72c15ef30 con 0x7fd72c0ae5b0 2024-07-24T16:39:15.893 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.887+0000 7fd733411640 1 -- 172.21.15.159:0/1445940794 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd72c15f4f0 con 0x7fd72c0ae5b0 2024-07-24T16:39:15.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.888+0000 7fd733411640 1 -- 172.21.15.159:0/1445940794 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd72c15b600 con 0x7fd72c0ae5b0 2024-07-24T16:39:15.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.889+0000 7fd729ffb640 1 -- 172.21.15.159:0/1445940794 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fd720042070 con 0x7fd72c0ae5b0 2024-07-24T16:39:15.894 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.889+0000 7fd729ffb640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fd718077010 0x7fd7180794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.889+0000 7fd729ffb640 1 -- 172.21.15.159:0/1445940794 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7fd7200b9e30 con 0x7fd72c0ae5b0 2024-07-24T16:39:15.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.889+0000 7fd7311ad640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fd718077010 0x7fd7180794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.889+0000 7fd729ffb640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] conn(0x7fd71807fd40 0x7fd718082190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:15.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.889+0000 7fd729ffb640 1 -- 172.21.15.159:0/1445940794 --> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd7180827c0 con 0x7fd71807fd40 2024-07-24T16:39:15.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.889+0000 7fd729ffb640 1 -- 172.21.15.159:0/1445940794 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fd7200ba1e0 con 0x7fd72c0ae5b0 2024-07-24T16:39:15.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.890+0000 7fd7319ae640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] conn(0x7fd71807fd40 0x7fd718082190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:15.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.890+0000 7fd7311ad640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fd718077010 0x7fd7180794d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd71c005fd0 tx=0x7fd71c009500 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:15.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.890+0000 7fd7319ae640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] conn(0x7fd71807fd40 0x7fd718082190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:15.895 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.891+0000 7fd729ffb640 1 -- 172.21.15.159:0/1445940794 <== osd.4 v2:172.21.15.193:6824/2092166389 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd7180827c0 con 0x7fd71807fd40 2024-07-24T16:39:15.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.903+0000 7fd733411640 1 -- 172.21.15.159:0/1445940794 --> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd72c0aea40 con 0x7fd71807fd40 2024-07-24T16:39:15.906 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.904+0000 7fd729ffb640 1 -- 172.21.15.159:0/1445940794 <== osd.4 v2:172.21.15.193:6824/2092166389 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd72c0aea40 con 0x7fd71807fd40 2024-07-24T16:39:15.907 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:39:15.907 INFO:teuthology.orchestra.run.smithi159.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-24T16:39:15.907 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:39:15.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.904+0000 7fd733411640 1 -- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] conn(0x7fd71807fd40 msgr2=0x7fd718082190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.904+0000 7fd733411640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:6824/2092166389,v1:172.21.15.193:6825/2092166389] conn(0x7fd71807fd40 0x7fd718082190 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:15.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.904+0000 7fd733411640 1 -- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fd718077010 msgr2=0x7fd7180794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.904+0000 7fd733411640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fd718077010 0x7fd7180794d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd71c005fd0 tx=0x7fd71c009500 comp rx=0 tx=0).stop 2024-07-24T16:39:15.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.904+0000 7fd733411640 1 -- 172.21.15.159:0/1445940794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0ae5b0 msgr2=0x7fd72c157a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:15.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.904+0000 7fd733411640 1 --2- 172.21.15.159:0/1445940794 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd72c0ae5b0 0x7fd72c157a40 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fd720009850 tx=0x7fd720003820 comp rx=0 tx=0).stop 2024-07-24T16:39:15.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.904+0000 7fd7319ae640 1 -- 172.21.15.159:0/1445940794 reap_dead start 2024-07-24T16:39:15.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.904+0000 7fd733411640 1 -- 172.21.15.159:0/1445940794 shutdown_connections 2024-07-24T16:39:15.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.904+0000 7fd733411640 1 -- 172.21.15.159:0/1445940794 >> 172.21.15.159:0/1445940794 conn(0x7fd72c06da90 msgr2=0x7fd72c06de70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:15.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.905+0000 7fd733411640 1 -- 172.21.15.159:0/1445940794 shutdown_connections 2024-07-24T16:39:15.909 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:15.905+0000 7fd733411640 1 -- 172.21.15.159:0/1445940794 wait complete. 2024-07-24T16:39:15.917 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-07-24T16:39:16.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.019+0000 7f5c56ed4640 1 -- 172.21.15.159:0/2483881373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c500cf770 msgr2=0x7f5c5015b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.019+0000 7f5c56ed4640 1 --2- 172.21.15.159:0/2483881373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c500cf770 0x7f5c5015b4b0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f5c40005fd0 tx=0x7f5c4002a580 comp rx=0 tx=0).stop 2024-07-24T16:39:16.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.019+0000 7f5c56ed4640 1 -- 172.21.15.159:0/2483881373 shutdown_connections 2024-07-24T16:39:16.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.019+0000 7f5c56ed4640 1 --2- 172.21.15.159:0/2483881373 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c500cfb50 0x7f5c500cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.019+0000 7f5c56ed4640 1 --2- 172.21.15.159:0/2483881373 >> v2:172.21.15.193:3300/0 conn(0x7f5c5006dba0 0x7f5c500cb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.019+0000 7f5c56ed4640 1 --2- 172.21.15.159:0/2483881373 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c500cf770 0x7f5c5015b4b0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.022 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.019+0000 7f5c56ed4640 1 -- 172.21.15.159:0/2483881373 >> 172.21.15.159:0/2483881373 conn(0x7f5c5006c560 msgr2=0x7f5c5006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:16.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.019+0000 7f5c56ed4640 1 -- 172.21.15.159:0/2483881373 shutdown_connections 2024-07-24T16:39:16.023 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.019+0000 7f5c56ed4640 1 -- 172.21.15.159:0/2483881373 wait complete. 2024-07-24T16:39:16.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.020+0000 7f5c56ed4640 1 Processor -- start 2024-07-24T16:39:16.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.020+0000 7f5c56ed4640 1 -- start start 2024-07-24T16:39:16.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c56ed4640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c5006dba0 0x7f5c50140e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c56ed4640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c500cf770 0x7f5c500b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c56ed4640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c500cfb50 0x7f5c50152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c56ed4640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f5c500ae860 con 0x7f5c500cf770 2024-07-24T16:39:16.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c56ed4640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f5c500ae6e0 con 0x7f5c500cfb50 2024-07-24T16:39:16.025 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c56ed4640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f5c500ae9e0 con 0x7f5c5006dba0 2024-07-24T16:39:16.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c4ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c500cf770 0x7f5c500b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c4ffff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c500cf770 0x7f5c500b1bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49968/0 (socket says 172.21.15.159:49968) 2024-07-24T16:39:16.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c4ffff640 1 -- 172.21.15.159:0/4200805353 learned_addr learned my addr 172.21.15.159:0/4200805353 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:16.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c54c70640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c5006dba0 0x7f5c50140e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c55471640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c500cfb50 0x7f5c50152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c4ffff640 1 -- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c5006dba0 msgr2=0x7f5c50140e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.026 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c4ffff640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c5006dba0 0x7f5c50140e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c4ffff640 1 -- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c500cfb50 msgr2=0x7f5c50152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c4ffff640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c500cfb50 0x7f5c50152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.021+0000 7f5c4ffff640 1 -- 172.21.15.159:0/4200805353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c500b0b10 con 0x7f5c500cf770 2024-07-24T16:39:16.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.022+0000 7f5c4ffff640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c500cf770 0x7f5c500b1bb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400d770 tx=0x7f5c4400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:16.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.022+0000 7f5c4d7fa640 1 -- 172.21.15.159:0/4200805353 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c44017070 con 0x7f5c500cf770 2024-07-24T16:39:16.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.022+0000 7f5c4d7fa640 1 -- 172.21.15.159:0/4200805353 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c44009d20 con 0x7f5c500cf770 2024-07-24T16:39:16.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.022+0000 7f5c56ed4640 1 -- 172.21.15.159:0/4200805353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c500b0df0 con 0x7f5c500cf770 2024-07-24T16:39:16.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.022+0000 7f5c4d7fa640 1 -- 172.21.15.159:0/4200805353 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c440106c0 con 0x7f5c500cf770 2024-07-24T16:39:16.027 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.022+0000 7f5c56ed4640 1 -- 172.21.15.159:0/4200805353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c500b13b0 con 0x7f5c500cf770 2024-07-24T16:39:16.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.023+0000 7f5c56ed4640 1 -- 172.21.15.159:0/4200805353 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c50075740 con 0x7f5c500cf770 2024-07-24T16:39:16.028 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.024+0000 7f5c4d7fa640 1 -- 172.21.15.159:0/4200805353 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f5c4401a070 con 0x7f5c500cf770 2024-07-24T16:39:16.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.024+0000 7f5c4d7fa640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f5c3c077010 0x7f5c3c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.024+0000 7f5c4d7fa640 1 -- 172.21.15.159:0/4200805353 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f5c44098c60 con 0x7f5c500cf770 2024-07-24T16:39:16.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.024+0000 7f5c54c70640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f5c3c077010 0x7f5c3c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.029 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.025+0000 7f5c54c70640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f5c3c077010 0x7f5c3c0794d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5c40033000 tx=0x7f5c40004730 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:16.030 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.028+0000 7f5c4d7fa640 1 -- 172.21.15.159:0/4200805353 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f5c440615b0 con 0x7f5c500cf770 2024-07-24T16:39:16.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.215+0000 7f5c56ed4640 1 -- 172.21.15.159:0/4200805353 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f5c500ce390 con 0x7f5c3c077010 2024-07-24T16:39:16.218 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.215+0000 7f5c4d7fa640 1 -- 172.21.15.159:0/4200805353 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5c500ce390 con 0x7f5c3c077010 2024-07-24T16:39:16.218 INFO:teuthology.orchestra.run.smithi159.stderr:instructed osd(s) 4 to deep-scrub 2024-07-24T16:39:16.220 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.217+0000 7f5c56ed4640 1 -- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f5c3c077010 msgr2=0x7f5c3c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.217+0000 7f5c56ed4640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f5c3c077010 0x7f5c3c0794d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5c40033000 tx=0x7f5c40004730 comp rx=0 tx=0).stop 2024-07-24T16:39:16.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.217+0000 7f5c56ed4640 1 -- 172.21.15.159:0/4200805353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c500cf770 msgr2=0x7f5c500b1bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.217+0000 7f5c56ed4640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c500cf770 0x7f5c500b1bb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400d770 tx=0x7f5c4400dc30 comp rx=0 tx=0).stop 2024-07-24T16:39:16.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.218+0000 7f5c56ed4640 1 -- 172.21.15.159:0/4200805353 shutdown_connections 2024-07-24T16:39:16.221 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.218+0000 7f5c56ed4640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f5c500cfb50 0x7f5c50152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.218+0000 7f5c56ed4640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f5c3c077010 0x7f5c3c0794d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.218+0000 7f5c56ed4640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f5c500cf770 0x7f5c500b1bb0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.218+0000 7f5c56ed4640 1 --2- 172.21.15.159:0/4200805353 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f5c5006dba0 0x7f5c50140e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.218+0000 7f5c56ed4640 1 -- 172.21.15.159:0/4200805353 >> 172.21.15.159:0/4200805353 conn(0x7f5c5006c560 msgr2=0x7f5c500cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.218+0000 7f5c56ed4640 1 -- 172.21.15.159:0/4200805353 shutdown_connections 2024-07-24T16:39:16.222 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.218+0000 7f5c56ed4640 1 -- 172.21.15.159:0/4200805353 wait complete. 2024-07-24T16:39:16.231 INFO:tasks.ceph:Scrubbing osd.5 2024-07-24T16:39:16.231 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-07-24T16:39:16.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.336+0000 7fcdfa78a640 1 -- 172.21.15.159:0/2655176529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdf415b310 msgr2=0x7fcdf40b0cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.336+0000 7fcdfa78a640 1 --2- 172.21.15.159:0/2655176529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdf415b310 0x7fcdf40b0cf0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009830 tx=0x7fcde402a510 comp rx=0 tx=0).stop 2024-07-24T16:39:16.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.336+0000 7fcdfa78a640 1 -- 172.21.15.159:0/2655176529 shutdown_connections 2024-07-24T16:39:16.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.336+0000 7fcdfa78a640 1 --2- 172.21.15.159:0/2655176529 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcdf40b07a0 0x7fcdf406fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.336+0000 7fcdfa78a640 1 --2- 172.21.15.159:0/2655176529 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdf415b310 0x7fcdf40b0cf0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.339 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.336+0000 7fcdfa78a640 1 -- 172.21.15.159:0/2655176529 >> 172.21.15.159:0/2655176529 conn(0x7fcdf4073c80 msgr2=0x7fcdf4074090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:16.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.336+0000 7fcdfa78a640 1 -- 172.21.15.159:0/2655176529 shutdown_connections 2024-07-24T16:39:16.340 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.336+0000 7fcdfa78a640 1 -- 172.21.15.159:0/2655176529 wait complete. 2024-07-24T16:39:16.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.337+0000 7fcdfa78a640 1 Processor -- start 2024-07-24T16:39:16.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.337+0000 7fcdfa78a640 1 -- start start 2024-07-24T16:39:16.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.338+0000 7fcdfa78a640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdf40b07a0 0x7fcdf41469c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.342 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.338+0000 7fcdfa78a640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdf415b310 0x7fcdf40aeee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.338+0000 7fcdfa78a640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcdf415b6f0 0x7fcdf41f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.338+0000 7fcdfa78a640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf40cf540 con 0x7fcdf40b07a0 2024-07-24T16:39:16.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.338+0000 7fcdfa78a640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fcdf40cf3c0 con 0x7fcdf415b310 2024-07-24T16:39:16.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.338+0000 7fcdfa78a640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fcdf40cf6c0 con 0x7fcdf415b6f0 2024-07-24T16:39:16.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.338+0000 7fcdf3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdf40b07a0 0x7fcdf41469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.338+0000 7fcdf3fff640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdf40b07a0 0x7fcdf41469c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49970/0 (socket says 172.21.15.159:49970) 2024-07-24T16:39:16.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.338+0000 7fcdf3fff640 1 -- 172.21.15.159:0/3034220490 learned_addr learned my addr 172.21.15.159:0/3034220490 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:16.343 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.338+0000 7fcdf8d27640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcdf415b6f0 0x7fcdf41f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.338+0000 7fcdf37fe640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdf415b310 0x7fcdf40aeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.339+0000 7fcdf3fff640 1 -- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcdf415b6f0 msgr2=0x7fcdf41f5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.339+0000 7fcdf3fff640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fcdf415b6f0 0x7fcdf41f5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.339+0000 7fcdf3fff640 1 -- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdf415b310 msgr2=0x7fcdf40aeee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.339+0000 7fcdf3fff640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fcdf415b310 0x7fcdf40aeee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.339+0000 7fcdf3fff640 1 -- 172.21.15.159:0/3034220490 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf41f6210 con 0x7fcdf40b07a0 2024-07-24T16:39:16.344 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.339+0000 7fcdf3fff640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdf40b07a0 0x7fcdf41469c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009950 tx=0x7fcde4032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:16.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.339+0000 7fcdf0ff9640 1 -- 172.21.15.159:0/3034220490 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde4040070 con 0x7fcdf40b07a0 2024-07-24T16:39:16.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.339+0000 7fcdf0ff9640 1 -- 172.21.15.159:0/3034220490 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcde4005310 con 0x7fcdf40b07a0 2024-07-24T16:39:16.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.339+0000 7fcdfa78a640 1 -- 172.21.15.159:0/3034220490 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf4149210 con 0x7fcdf40b07a0 2024-07-24T16:39:16.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.339+0000 7fcdf0ff9640 1 -- 172.21.15.159:0/3034220490 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde4005c90 con 0x7fcdf40b07a0 2024-07-24T16:39:16.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.339+0000 7fcdfa78a640 1 -- 172.21.15.159:0/3034220490 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdf4149790 con 0x7fcdf40b07a0 2024-07-24T16:39:16.345 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.340+0000 7fcdfa78a640 1 -- 172.21.15.159:0/3034220490 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcdf40af420 con 0x7fcdf40b07a0 2024-07-24T16:39:16.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.341+0000 7fcdf0ff9640 1 -- 172.21.15.159:0/3034220490 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fcde4039040 con 0x7fcdf40b07a0 2024-07-24T16:39:16.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.341+0000 7fcdf0ff9640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fcde0077040 0x7fcde0079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.341+0000 7fcdf0ff9640 1 -- 172.21.15.159:0/3034220490 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7fcde40b9a10 con 0x7fcdf40b07a0 2024-07-24T16:39:16.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.341+0000 7fcdf37fe640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fcde0077040 0x7fcde0079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.341+0000 7fcdf0ff9640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] conn(0x7fcde007fcf0 0x7fcde0082140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.347 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.341+0000 7fcdf0ff9640 1 -- 172.21.15.159:0/3034220490 --> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcde402dec0 con 0x7fcde007fcf0 2024-07-24T16:39:16.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.341+0000 7fcdf0ff9640 1 -- 172.21.15.159:0/3034220490 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fcde40bc320 con 0x7fcdf40b07a0 2024-07-24T16:39:16.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.341+0000 7fcdf8d27640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] conn(0x7fcde007fcf0 0x7fcde0082140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.342+0000 7fcdf37fe640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fcde0077040 0x7fcde0079500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcde8007fd0 tx=0x7fcde8001370 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:16.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.342+0000 7fcdf8d27640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] conn(0x7fcde007fcf0 0x7fcde0082140 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:16.348 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.342+0000 7fcdf0ff9640 1 -- 172.21.15.159:0/3034220490 <== osd.5 v2:172.21.15.193:6800/262722874 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcde402dec0 con 0x7fcde007fcf0 2024-07-24T16:39:16.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.355+0000 7fcdfa78a640 1 -- 172.21.15.159:0/3034220490 --> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcdf40cfbe0 con 0x7fcde007fcf0 2024-07-24T16:39:16.358 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.356+0000 7fcdf0ff9640 1 -- 172.21.15.159:0/3034220490 <== osd.5 v2:172.21.15.193:6800/262722874 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcdf40cfbe0 con 0x7fcde007fcf0 2024-07-24T16:39:16.359 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:39:16.359 INFO:teuthology.orchestra.run.smithi159.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-24T16:39:16.359 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:39:16.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.356+0000 7fcdfa78a640 1 -- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] conn(0x7fcde007fcf0 msgr2=0x7fcde0082140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.356+0000 7fcdfa78a640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:6800/262722874,v1:172.21.15.193:6801/262722874] conn(0x7fcde007fcf0 0x7fcde0082140 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.356+0000 7fcdfa78a640 1 -- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fcde0077040 msgr2=0x7fcde0079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.356+0000 7fcdfa78a640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fcde0077040 0x7fcde0079500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fcde8007fd0 tx=0x7fcde8001370 comp rx=0 tx=0).stop 2024-07-24T16:39:16.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.356+0000 7fcdfa78a640 1 -- 172.21.15.159:0/3034220490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdf40b07a0 msgr2=0x7fcdf41469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.356+0000 7fcdfa78a640 1 --2- 172.21.15.159:0/3034220490 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fcdf40b07a0 0x7fcdf41469c0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fcde4009950 tx=0x7fcde4032c10 comp rx=0 tx=0).stop 2024-07-24T16:39:16.360 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.356+0000 7fcdf8d27640 1 -- 172.21.15.159:0/3034220490 reap_dead start 2024-07-24T16:39:16.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.356+0000 7fcdfa78a640 1 -- 172.21.15.159:0/3034220490 shutdown_connections 2024-07-24T16:39:16.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.356+0000 7fcdfa78a640 1 -- 172.21.15.159:0/3034220490 >> 172.21.15.159:0/3034220490 conn(0x7fcdf4073c80 msgr2=0x7fcdf40b6130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:16.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.356+0000 7fcdfa78a640 1 -- 172.21.15.159:0/3034220490 shutdown_connections 2024-07-24T16:39:16.361 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.356+0000 7fcdfa78a640 1 -- 172.21.15.159:0/3034220490 wait complete. 2024-07-24T16:39:16.369 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-07-24T16:39:16.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.470+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2816459036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c4072a80 msgr2=0x7f57c406c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.470+0000 7f57cb9b0640 1 --2- 172.21.15.159:0/2816459036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c4072a80 0x7f57c406c560 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f57b4005fd0 tx=0x7f57b402a5d0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.473 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.470+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2816459036 shutdown_connections 2024-07-24T16:39:16.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.470+0000 7f57cb9b0640 1 --2- 172.21.15.159:0/2816459036 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c4072a80 0x7f57c406c560 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.470+0000 7f57cb9b0640 1 --2- 172.21.15.159:0/2816459036 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f57c415b3e0 0x7f57c415f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.470+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2816459036 >> 172.21.15.159:0/2816459036 conn(0x7f57c4071140 msgr2=0x7f57c406d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:16.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.470+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2816459036 shutdown_connections 2024-07-24T16:39:16.474 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.470+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2816459036 wait complete. 2024-07-24T16:39:16.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.471+0000 7f57cb9b0640 1 Processor -- start 2024-07-24T16:39:16.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.472+0000 7f57cb9b0640 1 -- start start 2024-07-24T16:39:16.476 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.472+0000 7f57cb9b0640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c406caa0 0x7f57c40b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.472+0000 7f57cb9b0640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57c415b3e0 0x7f57c40b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.472+0000 7f57cb9b0640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f57c41ee650 0x7f57c41f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.472+0000 7f57cb9b0640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f57c40b5fb0 con 0x7f57c406caa0 2024-07-24T16:39:16.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.472+0000 7f57cb9b0640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f57c406fdc0 con 0x7f57c415b3e0 2024-07-24T16:39:16.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.472+0000 7f57cb9b0640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f57c40b6130 con 0x7f57c41ee650 2024-07-24T16:39:16.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.472+0000 7f57c974c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c406caa0 0x7f57c40b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.472+0000 7f57c974c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c406caa0 0x7f57c40b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49988/0 (socket says 172.21.15.159:49988) 2024-07-24T16:39:16.477 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.472+0000 7f57c974c640 1 -- 172.21.15.159:0/2501583515 learned_addr learned my addr 172.21.15.159:0/2501583515 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:16.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.473+0000 7f57c9f4d640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f57c41ee650 0x7f57c41f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.473+0000 7f57c8f4b640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57c415b3e0 0x7f57c40b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.473+0000 7f57c974c640 1 -- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f57c41ee650 msgr2=0x7f57c41f7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.473+0000 7f57c974c640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f57c41ee650 0x7f57c41f7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.473+0000 7f57c974c640 1 -- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57c415b3e0 msgr2=0x7f57c40b2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.473+0000 7f57c974c640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57c415b3e0 0x7f57c40b2df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.473+0000 7f57c974c640 1 -- 172.21.15.159:0/2501583515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c41546e0 con 0x7f57c406caa0 2024-07-24T16:39:16.478 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.473+0000 7f57c974c640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c406caa0 0x7f57c40b28b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f57c000d7a0 tx=0x7f57c000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:16.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.473+0000 7f57b9ffb640 1 -- 172.21.15.159:0/2501583515 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0017070 con 0x7f57c406caa0 2024-07-24T16:39:16.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.473+0000 7f57b9ffb640 1 -- 172.21.15.159:0/2501583515 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f57c0009d20 con 0x7f57c406caa0 2024-07-24T16:39:16.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.473+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2501583515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57c41549c0 con 0x7f57c406caa0 2024-07-24T16:39:16.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.473+0000 7f57b9ffb640 1 -- 172.21.15.159:0/2501583515 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57c0004280 con 0x7f57c406caa0 2024-07-24T16:39:16.479 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.473+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2501583515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57c41f7ff0 con 0x7f57c406caa0 2024-07-24T16:39:16.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.474+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2501583515 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57c4154ee0 con 0x7f57c406caa0 2024-07-24T16:39:16.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.475+0000 7f57b9ffb640 1 -- 172.21.15.159:0/2501583515 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f57c0005020 con 0x7f57c406caa0 2024-07-24T16:39:16.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.475+0000 7f57b9ffb640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f57a8077010 0x7f57a80794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.475+0000 7f57c8f4b640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f57a8077010 0x7f57a80794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.480 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.475+0000 7f57b9ffb640 1 -- 172.21.15.159:0/2501583515 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f57c0098f20 con 0x7f57c406caa0 2024-07-24T16:39:16.481 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.476+0000 7f57c8f4b640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f57a8077010 0x7f57a80794d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f57b4033000 tx=0x7f57b4004730 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:16.482 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.479+0000 7f57b9ffb640 1 -- 172.21.15.159:0/2501583515 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f57c4154ee0 con 0x7f57c406caa0 2024-07-24T16:39:16.666 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.663+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2501583515 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f57c40b65e0 con 0x7f57a8077010 2024-07-24T16:39:16.667 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.664+0000 7f57b9ffb640 1 -- 172.21.15.159:0/2501583515 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f57c40b65e0 con 0x7f57a8077010 2024-07-24T16:39:16.667 INFO:teuthology.orchestra.run.smithi159.stderr:instructed osd(s) 5 to deep-scrub 2024-07-24T16:39:16.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.667+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f57a8077010 msgr2=0x7f57a80794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.667+0000 7f57cb9b0640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f57a8077010 0x7f57a80794d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f57b4033000 tx=0x7f57b4004730 comp rx=0 tx=0).stop 2024-07-24T16:39:16.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.667+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2501583515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c406caa0 msgr2=0x7f57c40b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.667+0000 7f57cb9b0640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c406caa0 0x7f57c40b28b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f57c000d7a0 tx=0x7f57c000dc60 comp rx=0 tx=0).stop 2024-07-24T16:39:16.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.667+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2501583515 shutdown_connections 2024-07-24T16:39:16.670 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.667+0000 7f57cb9b0640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f57c41ee650 0x7f57c41f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.667+0000 7f57cb9b0640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f57c415b3e0 0x7f57c40b2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.667+0000 7f57cb9b0640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f57a8077010 0x7f57a80794d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.667+0000 7f57cb9b0640 1 --2- 172.21.15.159:0/2501583515 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f57c406caa0 0x7f57c40b28b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.667+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2501583515 >> 172.21.15.159:0/2501583515 conn(0x7f57c4071140 msgr2=0x7f57c4158ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:16.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.667+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2501583515 shutdown_connections 2024-07-24T16:39:16.671 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.667+0000 7f57cb9b0640 1 -- 172.21.15.159:0/2501583515 wait complete. 2024-07-24T16:39:16.680 INFO:tasks.ceph:Scrubbing osd.6 2024-07-24T16:39:16.680 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-07-24T16:39:16.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.785+0000 7fd6ba772640 1 -- 172.21.15.159:0/3402957537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b406e3e0 msgr2=0x7fd6b415e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.785+0000 7fd6ba772640 1 --2- 172.21.15.159:0/3402957537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b406e3e0 0x7fd6b415e2f0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac005fd0 tx=0x7fd6ac02aae0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.785+0000 7fd6ba772640 1 -- 172.21.15.159:0/3402957537 shutdown_connections 2024-07-24T16:39:16.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.785+0000 7fd6ba772640 1 --2- 172.21.15.159:0/3402957537 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b406e3e0 0x7fd6b415e2f0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.785+0000 7fd6ba772640 1 --2- 172.21.15.159:0/3402957537 >> v2:172.21.15.193:3300/0 conn(0x7fd6b40cf230 0x7fd6b415b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.785+0000 7fd6ba772640 1 -- 172.21.15.159:0/3402957537 >> 172.21.15.159:0/3402957537 conn(0x7fd6b406ccd0 msgr2=0x7fd6b40b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:16.788 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.785+0000 7fd6ba772640 1 -- 172.21.15.159:0/3402957537 shutdown_connections 2024-07-24T16:39:16.789 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.785+0000 7fd6ba772640 1 -- 172.21.15.159:0/3402957537 wait complete. 2024-07-24T16:39:16.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.786+0000 7fd6ba772640 1 Processor -- start 2024-07-24T16:39:16.791 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.786+0000 7fd6ba772640 1 -- start start 2024-07-24T16:39:16.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6ba772640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6b406e3e0 0x7fd6b4144710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6ba772640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd6b40cf230 0x7fd6b41f4060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6ba772640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b415de60 0x7fd6b41f45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6ba772640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b406f9f0 con 0x7fd6b415de60 2024-07-24T16:39:16.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6ba772640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b406f870 con 0x7fd6b406e3e0 2024-07-24T16:39:16.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6ba772640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fd6b406fb70 con 0x7fd6b40cf230 2024-07-24T16:39:16.792 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6b8d0f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b415de60 0x7fd6b41f45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6b8d0f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b415de60 0x7fd6b41f45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:49994/0 (socket says 172.21.15.159:49994) 2024-07-24T16:39:16.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6b8d0f640 1 -- 172.21.15.159:0/3971219454 learned_addr learned my addr 172.21.15.159:0/3971219454 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:16.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6b3fff640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6b406e3e0 0x7fd6b4144710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6b37fe640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd6b40cf230 0x7fd6b41f4060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6b8d0f640 1 -- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd6b40cf230 msgr2=0x7fd6b41f4060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6b8d0f640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd6b40cf230 0x7fd6b41f4060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6b8d0f640 1 -- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6b406e3e0 msgr2=0x7fd6b4144710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.793 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6b8d0f640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fd6b406e3e0 0x7fd6b4144710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6b8d0f640 1 -- 172.21.15.159:0/3971219454 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b41585b0 con 0x7fd6b415de60 2024-07-24T16:39:16.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.787+0000 7fd6b37fe640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fd6b40cf230 0x7fd6b41f4060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:39:16.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.788+0000 7fd6b8d0f640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b415de60 0x7fd6b41f45a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac006010 tx=0x7fd6ac009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:16.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.788+0000 7fd6b0ff9640 1 -- 172.21.15.159:0/3971219454 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac043070 con 0x7fd6b415de60 2024-07-24T16:39:16.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.788+0000 7fd6b0ff9640 1 -- 172.21.15.159:0/3971219454 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6ac004330 con 0x7fd6b415de60 2024-07-24T16:39:16.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.788+0000 7fd6ba772640 1 -- 172.21.15.159:0/3971219454 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b4158890 con 0x7fd6b415de60 2024-07-24T16:39:16.794 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.788+0000 7fd6b0ff9640 1 -- 172.21.15.159:0/3971219454 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6ac004740 con 0x7fd6b415de60 2024-07-24T16:39:16.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.788+0000 7fd6ba772640 1 -- 172.21.15.159:0/3971219454 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b4158e50 con 0x7fd6b415de60 2024-07-24T16:39:16.795 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.789+0000 7fd6ba772640 1 -- 172.21.15.159:0/3971219454 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6b4070090 con 0x7fd6b415de60 2024-07-24T16:39:16.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.789+0000 7fd6b0ff9640 1 -- 172.21.15.159:0/3971219454 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fd6ac046070 con 0x7fd6b415de60 2024-07-24T16:39:16.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.790+0000 7fd6b0ff9640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fd6a0077010 0x7fd6a00794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.790+0000 7fd6b0ff9640 1 -- 172.21.15.159:0/3971219454 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7fd6ac0bcad0 con 0x7fd6b415de60 2024-07-24T16:39:16.796 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.790+0000 7fd6b3fff640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fd6a0077010 0x7fd6a00794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.790+0000 7fd6b0ff9640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] conn(0x7fd6a007fcc0 0x7fd6a0082110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.790+0000 7fd6b0ff9640 1 -- 172.21.15.159:0/3971219454 --> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6a0082740 con 0x7fd6a007fcc0 2024-07-24T16:39:16.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.790+0000 7fd6b0ff9640 1 -- 172.21.15.159:0/3971219454 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fd6ac0bcf60 con 0x7fd6b415de60 2024-07-24T16:39:16.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.790+0000 7fd6b37fe640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] conn(0x7fd6a007fcc0 0x7fd6a0082110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.790+0000 7fd6b3fff640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fd6a0077010 0x7fd6a00794d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009bd0 tx=0x7fd6a4005f90 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:16.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.791+0000 7fd6b37fe640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] conn(0x7fd6a007fcc0 0x7fd6a0082110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:16.797 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.791+0000 7fd6b0ff9640 1 -- 172.21.15.159:0/3971219454 <== osd.6 v2:172.21.15.193:6812/2474946218 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6a0082740 con 0x7fd6a007fcc0 2024-07-24T16:39:16.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.805+0000 7fd6ba772640 1 -- 172.21.15.159:0/3971219454 --> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd6b415e500 con 0x7fd6a007fcc0 2024-07-24T16:39:16.808 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.806+0000 7fd6b0ff9640 1 -- 172.21.15.159:0/3971219454 <== osd.6 v2:172.21.15.193:6812/2474946218 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd6b415e500 con 0x7fd6a007fcc0 2024-07-24T16:39:16.809 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:39:16.809 INFO:teuthology.orchestra.run.smithi159.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-24T16:39:16.809 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:39:16.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.806+0000 7fd6ba772640 1 -- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] conn(0x7fd6a007fcc0 msgr2=0x7fd6a0082110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.806+0000 7fd6ba772640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:6812/2474946218,v1:172.21.15.193:6813/2474946218] conn(0x7fd6a007fcc0 0x7fd6a0082110 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.810 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.807+0000 7fd6ba772640 1 -- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fd6a0077010 msgr2=0x7fd6a00794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.807+0000 7fd6ba772640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fd6a0077010 0x7fd6a00794d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009bd0 tx=0x7fd6a4005f90 comp rx=0 tx=0).stop 2024-07-24T16:39:16.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.807+0000 7fd6ba772640 1 -- 172.21.15.159:0/3971219454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b415de60 msgr2=0x7fd6b41f45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.807+0000 7fd6ba772640 1 --2- 172.21.15.159:0/3971219454 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fd6b415de60 0x7fd6b41f45a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac006010 tx=0x7fd6ac009880 comp rx=0 tx=0).stop 2024-07-24T16:39:16.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.807+0000 7fd6b8d0f640 1 -- 172.21.15.159:0/3971219454 reap_dead start 2024-07-24T16:39:16.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.807+0000 7fd6ba772640 1 -- 172.21.15.159:0/3971219454 shutdown_connections 2024-07-24T16:39:16.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.807+0000 7fd6ba772640 1 -- 172.21.15.159:0/3971219454 >> 172.21.15.159:0/3971219454 conn(0x7fd6b406ccd0 msgr2=0x7fd6b4154420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:16.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.807+0000 7fd6ba772640 1 -- 172.21.15.159:0/3971219454 shutdown_connections 2024-07-24T16:39:16.811 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.807+0000 7fd6ba772640 1 -- 172.21.15.159:0/3971219454 wait complete. 2024-07-24T16:39:16.819 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-07-24T16:39:16.923 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.920+0000 7f6ea868d640 1 -- 172.21.15.159:0/3238748966 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea0070500 msgr2=0x7f6ea00cf410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.920+0000 7f6ea868d640 1 --2- 172.21.15.159:0/3238748966 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea0070500 0x7f6ea00cf410 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f6ea015a940 tx=0x7f6e9402a5f0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.921+0000 7f6ea868d640 1 -- 172.21.15.159:0/3238748966 shutdown_connections 2024-07-24T16:39:16.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.921+0000 7f6ea868d640 1 --2- 172.21.15.159:0/3238748966 >> v2:172.21.15.193:3300/0 conn(0x7f6ea006f1c0 0x7f6ea015b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.921+0000 7f6ea868d640 1 --2- 172.21.15.159:0/3238748966 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea0070500 0x7f6ea00cf410 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.921+0000 7f6ea868d640 1 -- 172.21.15.159:0/3238748966 >> 172.21.15.159:0/3238748966 conn(0x7f6ea006d450 msgr2=0x7f6ea006d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:16.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.921+0000 7f6ea868d640 1 -- 172.21.15.159:0/3238748966 shutdown_connections 2024-07-24T16:39:16.924 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.921+0000 7f6ea868d640 1 -- 172.21.15.159:0/3238748966 wait complete. 2024-07-24T16:39:16.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.922+0000 7f6ea868d640 1 Processor -- start 2024-07-24T16:39:16.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.922+0000 7f6ea868d640 1 -- start start 2024-07-24T16:39:16.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea868d640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea006f1c0 0x7f6ea01595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea868d640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea0070500 0x7f6ea01475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea868d640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ea0157d50 0x7f6ea00b0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea868d640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea00cdea0 con 0x7f6ea006f1c0 2024-07-24T16:39:16.927 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea868d640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea00cdd20 con 0x7f6ea0157d50 2024-07-24T16:39:16.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea868d640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea00ce020 con 0x7f6ea0070500 2024-07-24T16:39:16.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea6429640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea006f1c0 0x7f6ea01595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea6429640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea006f1c0 0x7f6ea01595c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50002/0 (socket says 172.21.15.159:50002) 2024-07-24T16:39:16.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea6429640 1 -- 172.21.15.159:0/3643087363 learned_addr learned my addr 172.21.15.159:0/3643087363 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:16.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea5c28640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea0070500 0x7f6ea01475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea6c2a640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ea0157d50 0x7f6ea00b0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.928 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea6429640 1 -- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea0070500 msgr2=0x7f6ea01475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea6429640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea0070500 0x7f6ea01475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea6429640 1 -- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ea0157d50 msgr2=0x7f6ea00b0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:16.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea6429640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ea0157d50 0x7f6ea00b0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:16.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea6429640 1 -- 172.21.15.159:0/3643087363 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea0158520 con 0x7f6ea006f1c0 2024-07-24T16:39:16.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea6c2a640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ea0157d50 0x7f6ea00b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:39:16.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea5c28640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea0070500 0x7f6ea01475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:39:16.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea6429640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea006f1c0 0x7f6ea01595c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800c3a0 tx=0x7f6e9800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:16.929 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6e9effd640 1 -- 172.21.15.159:0/3643087363 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e98017070 con 0x7f6ea006f1c0 2024-07-24T16:39:16.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6e9effd640 1 -- 172.21.15.159:0/3643087363 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6e980053c0 con 0x7f6ea006f1c0 2024-07-24T16:39:16.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6e9effd640 1 -- 172.21.15.159:0/3643087363 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e98003850 con 0x7f6ea006f1c0 2024-07-24T16:39:16.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea868d640 1 -- 172.21.15.159:0/3643087363 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea0158800 con 0x7f6ea006f1c0 2024-07-24T16:39:16.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.923+0000 7f6ea868d640 1 -- 172.21.15.159:0/3643087363 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea0158dc0 con 0x7f6ea006f1c0 2024-07-24T16:39:16.930 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.924+0000 7f6ea868d640 1 -- 172.21.15.159:0/3643087363 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea015b3c0 con 0x7f6ea006f1c0 2024-07-24T16:39:16.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.925+0000 7f6e9effd640 1 -- 172.21.15.159:0/3643087363 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f6e9801a070 con 0x7f6ea006f1c0 2024-07-24T16:39:16.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.926+0000 7f6e9effd640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f6e8c077010 0x7f6e8c0794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:16.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.926+0000 7f6e9effd640 1 -- 172.21.15.159:0/3643087363 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f6e98098050 con 0x7f6ea006f1c0 2024-07-24T16:39:16.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.926+0000 7f6ea5c28640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f6e8c077010 0x7f6e8c0794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:16.931 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.926+0000 7f6ea5c28640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f6e8c077010 0x7f6e8c0794d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6e94033000 tx=0x7f6e94004730 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:16.932 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:16.930+0000 7f6e9effd640 1 -- 172.21.15.159:0/3643087363 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f6e98060f70 con 0x7f6ea006f1c0 2024-07-24T16:39:17.115 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.113+0000 7f6ea868d640 1 -- 172.21.15.159:0/3643087363 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f6ea0147b20 con 0x7f6e8c077010 2024-07-24T16:39:17.116 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.113+0000 7f6e9effd640 1 -- 172.21.15.159:0/3643087363 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6ea0147b20 con 0x7f6e8c077010 2024-07-24T16:39:17.116 INFO:teuthology.orchestra.run.smithi159.stderr:instructed osd(s) 6 to deep-scrub 2024-07-24T16:39:17.118 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.115+0000 7f6ea868d640 1 -- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f6e8c077010 msgr2=0x7f6e8c0794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.116+0000 7f6ea868d640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f6e8c077010 0x7f6e8c0794d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6e94033000 tx=0x7f6e94004730 comp rx=0 tx=0).stop 2024-07-24T16:39:17.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.116+0000 7f6ea868d640 1 -- 172.21.15.159:0/3643087363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea006f1c0 msgr2=0x7f6ea01595c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.116+0000 7f6ea868d640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea006f1c0 0x7f6ea01595c0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800c3a0 tx=0x7f6e9800c860 comp rx=0 tx=0).stop 2024-07-24T16:39:17.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.116+0000 7f6ea868d640 1 -- 172.21.15.159:0/3643087363 shutdown_connections 2024-07-24T16:39:17.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.116+0000 7f6ea868d640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f6ea0157d50 0x7f6ea00b0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.116+0000 7f6ea868d640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f6ea0070500 0x7f6ea01475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.119 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.116+0000 7f6ea868d640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f6e8c077010 0x7f6e8c0794d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.116+0000 7f6ea868d640 1 --2- 172.21.15.159:0/3643087363 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f6ea006f1c0 0x7f6ea01595c0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.116+0000 7f6ea868d640 1 -- 172.21.15.159:0/3643087363 >> 172.21.15.159:0/3643087363 conn(0x7f6ea006d450 msgr2=0x7f6ea00ce4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:17.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.116+0000 7f6ea868d640 1 -- 172.21.15.159:0/3643087363 shutdown_connections 2024-07-24T16:39:17.120 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.116+0000 7f6ea868d640 1 -- 172.21.15.159:0/3643087363 wait complete. 2024-07-24T16:39:17.129 INFO:tasks.ceph:Scrubbing osd.7 2024-07-24T16:39:17.129 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-07-24T16:39:17.237 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.234+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/1766634311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e780ce610 msgr2=0x7f4e780ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.234+0000 7f4e7dbc6640 1 --2- 172.21.15.159:0/1766634311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e780ce610 0x7f4e780ceac0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f4e78073da0 tx=0x7f4e7002aa30 comp rx=0 tx=0).stop 2024-07-24T16:39:17.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.234+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/1766634311 shutdown_connections 2024-07-24T16:39:17.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.234+0000 7f4e7dbc6640 1 --2- 172.21.15.159:0/1766634311 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e780ce610 0x7f4e780ceac0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.234+0000 7f4e7dbc6640 1 --2- 172.21.15.159:0/1766634311 >> v2:172.21.15.193:3300/0 conn(0x7f4e7806f8b0 0x7f4e7815fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.234+0000 7f4e7dbc6640 1 --2- 172.21.15.159:0/1766634311 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e7815b460 0x7f4e7815c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.234+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/1766634311 >> 172.21.15.159:0/1766634311 conn(0x7f4e7806c560 msgr2=0x7f4e7806c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:17.285 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.234+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/1766634311 shutdown_connections 2024-07-24T16:39:17.286 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.234+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/1766634311 wait complete. 2024-07-24T16:39:17.293 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.235+0000 7f4e7dbc6640 1 Processor -- start 2024-07-24T16:39:17.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.235+0000 7f4e7dbc6640 1 -- start start 2024-07-24T16:39:17.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e7dbc6640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e7806f8b0 0x7f4e781f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:17.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e7dbc6640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e780ce610 0x7f4e781f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:17.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e7dbc6640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e7815b460 0x7f4e780cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:17.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e7dbc6640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780b2840 con 0x7f4e7806f8b0 2024-07-24T16:39:17.294 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e7dbc6640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f4e780b26c0 con 0x7f4e7815b460 2024-07-24T16:39:17.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e7dbc6640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4e780b29c0 con 0x7f4e780ce610 2024-07-24T16:39:17.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e777fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e7806f8b0 0x7f4e781f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:17.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e777fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e7806f8b0 0x7f4e781f7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50018/0 (socket says 172.21.15.159:50018) 2024-07-24T16:39:17.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e777fe640 1 -- 172.21.15.159:0/2690249177 learned_addr learned my addr 172.21.15.159:0/2690249177 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:17.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e6ffff640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e780ce610 0x7f4e781f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:17.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e77fff640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e7815b460 0x7f4e780cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:17.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e777fe640 1 -- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e780ce610 msgr2=0x7f4e781f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.295 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e777fe640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f4e780ce610 0x7f4e781f3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e777fe640 1 -- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e7815b460 msgr2=0x7f4e780cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e777fe640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e7815b460 0x7f4e780cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e777fe640 1 -- 172.21.15.159:0/2690249177 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e781419b0 con 0x7f4e7806f8b0 2024-07-24T16:39:17.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e77fff640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f4e7815b460 0x7f4e780cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-07-24T16:39:17.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e777fe640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e7806f8b0 0x7f4e781f7f20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800c970 tx=0x7f4e6800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:17.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e74ff9640 1 -- 172.21.15.159:0/2690249177 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68007bb0 con 0x7f4e7806f8b0 2024-07-24T16:39:17.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e74ff9640 1 -- 172.21.15.159:0/2690249177 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e68005020 con 0x7f4e7806f8b0 2024-07-24T16:39:17.296 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/2690249177 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e781f43f0 con 0x7f4e7806f8b0 2024-07-24T16:39:17.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.236+0000 7f4e74ff9640 1 -- 172.21.15.159:0/2690249177 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68007e60 con 0x7f4e7806f8b0 2024-07-24T16:39:17.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.237+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/2690249177 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e781f49a0 con 0x7f4e7806f8b0 2024-07-24T16:39:17.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.237+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/2690249177 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4e780ceac0 con 0x7f4e7806f8b0 2024-07-24T16:39:17.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.238+0000 7f4e74ff9640 1 -- 172.21.15.159:0/2690249177 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f4e68005470 con 0x7f4e7806f8b0 2024-07-24T16:39:17.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.239+0000 7f4e74ff9640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4e58077010 0x7f4e580794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:17.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.239+0000 7f4e74ff9640 1 -- 172.21.15.159:0/2690249177 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f4e680995e0 con 0x7f4e7806f8b0 2024-07-24T16:39:17.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.239+0000 7f4e6ffff640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4e58077010 0x7f4e580794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:17.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.239+0000 7f4e74ff9640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] conn(0x7f4e5807fd40 0x7f4e58082190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:17.297 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.239+0000 7f4e74ff9640 1 -- 172.21.15.159:0/2690249177 --> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4e68017e70 con 0x7f4e5807fd40 2024-07-24T16:39:17.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.239+0000 7f4e74ff9640 1 -- 172.21.15.159:0/2690249177 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7f4e68099a70 con 0x7f4e7806f8b0 2024-07-24T16:39:17.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.239+0000 7f4e77fff640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] conn(0x7f4e5807fd40 0x7f4e58082190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:17.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.239+0000 7f4e6ffff640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4e58077010 0x7f4e580794d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4e7814d8c0 tx=0x7f4e60005be0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:17.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.239+0000 7f4e77fff640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] conn(0x7f4e5807fd40 0x7f4e58082190 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:17.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.240+0000 7f4e74ff9640 1 -- 172.21.15.159:0/2690249177 <== osd.7 v2:172.21.15.193:6808/745996008 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4e68017e70 con 0x7f4e5807fd40 2024-07-24T16:39:17.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.253+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/2690249177 --> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f4e7815dbc0 con 0x7f4e5807fd40 2024-07-24T16:39:17.298 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.254+0000 7f4e74ff9640 1 -- 172.21.15.159:0/2690249177 <== osd.7 v2:172.21.15.193:6808/745996008 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f4e7815dbc0 con 0x7f4e5807fd40 2024-07-24T16:39:17.299 INFO:teuthology.orchestra.run.smithi159.stdout:{ 2024-07-24T16:39:17.299 INFO:teuthology.orchestra.run.smithi159.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-07-24T16:39:17.299 INFO:teuthology.orchestra.run.smithi159.stdout:} 2024-07-24T16:39:17.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.254+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] conn(0x7f4e5807fd40 msgr2=0x7f4e58082190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.300 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.254+0000 7f4e7dbc6640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:6808/745996008,v1:172.21.15.193:6809/745996008] conn(0x7f4e5807fd40 0x7f4e58082190 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.254+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4e58077010 msgr2=0x7f4e580794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.254+0000 7f4e7dbc6640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4e58077010 0x7f4e580794d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f4e7814d8c0 tx=0x7f4e60005be0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.254+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/2690249177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e7806f8b0 msgr2=0x7f4e781f7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.254+0000 7f4e7dbc6640 1 --2- 172.21.15.159:0/2690249177 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f4e7806f8b0 0x7f4e781f7f20 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800c970 tx=0x7f4e6800ce30 comp rx=0 tx=0).stop 2024-07-24T16:39:17.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.254+0000 7f4e77fff640 1 -- 172.21.15.159:0/2690249177 reap_dead start 2024-07-24T16:39:17.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.254+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/2690249177 shutdown_connections 2024-07-24T16:39:17.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.254+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/2690249177 >> 172.21.15.159:0/2690249177 conn(0x7f4e7806c560 msgr2=0x7f4e7815e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:17.301 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.254+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/2690249177 shutdown_connections 2024-07-24T16:39:17.302 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.254+0000 7f4e7dbc6640 1 -- 172.21.15.159:0/2690249177 wait complete. 2024-07-24T16:39:17.302 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-07-24T16:39:17.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.404+0000 7fdc4726c640 1 -- 172.21.15.159:0/3729857659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc4015a330 msgr2=0x7fdc400cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.404+0000 7fdc4726c640 1 --2- 172.21.15.159:0/3729857659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc4015a330 0x7fdc400cfed0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdc400cd170 tx=0x7fdc3c02a580 comp rx=0 tx=0).stop 2024-07-24T16:39:17.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.404+0000 7fdc4726c640 1 -- 172.21.15.159:0/3729857659 shutdown_connections 2024-07-24T16:39:17.407 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.404+0000 7fdc4726c640 1 --2- 172.21.15.159:0/3729857659 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdc40072b50 0x7fdc40072fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.404+0000 7fdc4726c640 1 --2- 172.21.15.159:0/3729857659 >> v2:172.21.15.193:3300/0 conn(0x7fdc400b4e70 0x7fdc40070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.404+0000 7fdc4726c640 1 --2- 172.21.15.159:0/3729857659 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc4015a330 0x7fdc400cfed0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.404+0000 7fdc4726c640 1 -- 172.21.15.159:0/3729857659 >> 172.21.15.159:0/3729857659 conn(0x7fdc400b2230 msgr2=0x7fdc400b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:17.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.404+0000 7fdc4726c640 1 -- 172.21.15.159:0/3729857659 shutdown_connections 2024-07-24T16:39:17.408 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.404+0000 7fdc4726c640 1 -- 172.21.15.159:0/3729857659 wait complete. 2024-07-24T16:39:17.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.405+0000 7fdc4726c640 1 Processor -- start 2024-07-24T16:39:17.410 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.405+0000 7fdc4726c640 1 -- start start 2024-07-24T16:39:17.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.406+0000 7fdc4726c640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc40072b50 0x7fdc4015d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:17.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.406+0000 7fdc4726c640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdc400b4e70 0x7fdc4015b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:17.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.406+0000 7fdc4726c640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc4015a330 0x7fdc4014f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:17.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.406+0000 7fdc4726c640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fdc400cd5b0 con 0x7fdc40072b50 2024-07-24T16:39:17.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.406+0000 7fdc4726c640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fdc400cd430 con 0x7fdc4015a330 2024-07-24T16:39:17.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.406+0000 7fdc4726c640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fdc400cd730 con 0x7fdc400b4e70 2024-07-24T16:39:17.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.406+0000 7fdc45008640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc40072b50 0x7fdc4015d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:17.411 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.406+0000 7fdc45008640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc40072b50 0x7fdc4015d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50034/0 (socket says 172.21.15.159:50034) 2024-07-24T16:39:17.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.406+0000 7fdc45008640 1 -- 172.21.15.159:0/1843934331 learned_addr learned my addr 172.21.15.159:0/1843934331 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:17.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.406+0000 7fdc45809640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc4015a330 0x7fdc4014f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:17.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.406+0000 7fdc44807640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdc400b4e70 0x7fdc4015b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:17.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.407+0000 7fdc45008640 1 -- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdc400b4e70 msgr2=0x7fdc4015b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.407+0000 7fdc45008640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdc400b4e70 0x7fdc4015b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.407+0000 7fdc45008640 1 -- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc4015a330 msgr2=0x7fdc4014f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.407+0000 7fdc45008640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc4015a330 0x7fdc4014f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.407+0000 7fdc45008640 1 -- 172.21.15.159:0/1843934331 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc40153120 con 0x7fdc40072b50 2024-07-24T16:39:17.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.407+0000 7fdc45809640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc4015a330 0x7fdc4014f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:39:17.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.407+0000 7fdc45008640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc40072b50 0x7fdc4015d120 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c000c00 tx=0x7fdc3c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:17.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.407+0000 7fdc35ffb640 1 -- 172.21.15.159:0/1843934331 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c03e030 con 0x7fdc40072b50 2024-07-24T16:39:17.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.407+0000 7fdc35ffb640 1 -- 172.21.15.159:0/1843934331 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc3c003e60 con 0x7fdc40072b50 2024-07-24T16:39:17.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.407+0000 7fdc35ffb640 1 -- 172.21.15.159:0/1843934331 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c035040 con 0x7fdc40072b50 2024-07-24T16:39:17.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.407+0000 7fdc4726c640 1 -- 172.21.15.159:0/1843934331 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc40153400 con 0x7fdc40072b50 2024-07-24T16:39:17.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.407+0000 7fdc4726c640 1 -- 172.21.15.159:0/1843934331 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc401539c0 con 0x7fdc40072b50 2024-07-24T16:39:17.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.408+0000 7fdc4726c640 1 -- 172.21.15.159:0/1843934331 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc40070070 con 0x7fdc40072b50 2024-07-24T16:39:17.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.409+0000 7fdc35ffb640 1 -- 172.21.15.159:0/1843934331 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fdc3c041030 con 0x7fdc40072b50 2024-07-24T16:39:17.414 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.409+0000 7fdc35ffb640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fdc24077010 0x7fdc240794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:17.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.409+0000 7fdc35ffb640 1 -- 172.21.15.159:0/1843934331 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7fdc3c0b9200 con 0x7fdc40072b50 2024-07-24T16:39:17.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.409+0000 7fdc44807640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fdc24077010 0x7fdc240794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:17.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.410+0000 7fdc44807640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fdc24077010 0x7fdc240794d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc40157260 tx=0x7fdc3000a4c0 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:17.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.414+0000 7fdc35ffb640 1 -- 172.21.15.159:0/1843934331 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fdc3c082230 con 0x7fdc40072b50 2024-07-24T16:39:17.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.593+0000 7fdc4726c640 1 -- 172.21.15.159:0/1843934331 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fdc400b4310 con 0x7fdc24077010 2024-07-24T16:39:17.596 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.594+0000 7fdc35ffb640 1 -- 172.21.15.159:0/1843934331 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdc400b4310 con 0x7fdc24077010 2024-07-24T16:39:17.596 INFO:teuthology.orchestra.run.smithi159.stderr:instructed osd(s) 7 to deep-scrub 2024-07-24T16:39:17.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.596+0000 7fdc4726c640 1 -- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fdc24077010 msgr2=0x7fdc240794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.596+0000 7fdc4726c640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fdc24077010 0x7fdc240794d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fdc40157260 tx=0x7fdc3000a4c0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.596+0000 7fdc4726c640 1 -- 172.21.15.159:0/1843934331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc40072b50 msgr2=0x7fdc4015d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.596+0000 7fdc4726c640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc40072b50 0x7fdc4015d120 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c000c00 tx=0x7fdc3c003970 comp rx=0 tx=0).stop 2024-07-24T16:39:17.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.596+0000 7fdc4726c640 1 -- 172.21.15.159:0/1843934331 shutdown_connections 2024-07-24T16:39:17.599 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.596+0000 7fdc4726c640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fdc4015a330 0x7fdc4014f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.596+0000 7fdc4726c640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fdc400b4e70 0x7fdc4015b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.596+0000 7fdc4726c640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fdc24077010 0x7fdc240794d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.596+0000 7fdc4726c640 1 --2- 172.21.15.159:0/1843934331 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fdc40072b50 0x7fdc4015d120 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.596+0000 7fdc4726c640 1 -- 172.21.15.159:0/1843934331 >> 172.21.15.159:0/1843934331 conn(0x7fdc400b2230 msgr2=0x7fdc4006eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:17.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.596+0000 7fdc4726c640 1 -- 172.21.15.159:0/1843934331 shutdown_connections 2024-07-24T16:39:17.600 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.596+0000 7fdc4726c640 1 -- 172.21.15.159:0/1843934331 wait complete. 2024-07-24T16:39:17.610 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:39:17.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.711+0000 7fa6e147f640 1 -- 172.21.15.159:0/4053968536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6c4003a30 msgr2=0x7fa6c4003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.711+0000 7fa6e147f640 1 --2- 172.21.15.159:0/4053968536 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6c4003a30 0x7fa6c4003e50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009b50 tx=0x7fa6c4005830 comp rx=0 tx=0).stop 2024-07-24T16:39:17.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.711+0000 7fa6db7fe640 1 -- 172.21.15.159:0/4053968536 reap_dead start 2024-07-24T16:39:17.714 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.711+0000 7fa6e147f640 1 -- 172.21.15.159:0/4053968536 shutdown_connections 2024-07-24T16:39:17.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.711+0000 7fa6e147f640 1 -- 172.21.15.159:0/4053968536 >> 172.21.15.159:0/4053968536 conn(0x7fa6dc09cd30 msgr2=0x7fa6dc0d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:17.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.711+0000 7fa6e147f640 1 -- 172.21.15.159:0/4053968536 shutdown_connections 2024-07-24T16:39:17.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.711+0000 7fa6e147f640 1 -- 172.21.15.159:0/4053968536 wait complete. 2024-07-24T16:39:17.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.713+0000 7fa6e147f640 1 Processor -- start 2024-07-24T16:39:17.715 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.713+0000 7fa6e147f640 1 -- start start 2024-07-24T16:39:17.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.713+0000 7fa6e147f640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6c4003a30 0x7fa6dc1f4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:17.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.713+0000 7fa6e147f640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6dc0d1c00 0x7fa6dc0cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:17.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.713+0000 7fa6e147f640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0d2080 0x7fa6dc0cda10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:17.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.713+0000 7fa6e147f640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc0d0b70 con 0x7fa6dc0d2080 2024-07-24T16:39:17.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.713+0000 7fa6e147f640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fa6dc0d09f0 con 0x7fa6c4003a30 2024-07-24T16:39:17.718 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.713+0000 7fa6e147f640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fa6dc161f20 con 0x7fa6dc0d1c00 2024-07-24T16:39:17.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6db7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0d2080 0x7fa6dc0cda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:17.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6db7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0d2080 0x7fa6dc0cda10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:50046/0 (socket says 172.21.15.159:50046) 2024-07-24T16:39:17.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6db7fe640 1 -- 172.21.15.159:0/3844824392 learned_addr learned my addr 172.21.15.159:0/3844824392 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:17.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6daffd640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6c4003a30 0x7fa6dc1f4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:17.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6da7fc640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6dc0d1c00 0x7fa6dc0cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:17.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6db7fe640 1 -- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6dc0d1c00 msgr2=0x7fa6dc0cd4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.719 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6db7fe640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6dc0d1c00 0x7fa6dc0cd4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6db7fe640 1 -- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6c4003a30 msgr2=0x7fa6dc1f4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6db7fe640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6c4003a30 0x7fa6dc1f4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6db7fe640 1 -- 172.21.15.159:0/3844824392 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6dc0ccaa0 con 0x7fa6dc0d2080 2024-07-24T16:39:17.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6db7fe640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0d2080 0x7fa6dc0cda10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc08d530 tx=0x7fa6d40019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:17.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6c37fe640 1 -- 172.21.15.159:0/3844824392 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4015020 con 0x7fa6dc0d2080 2024-07-24T16:39:17.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6c37fe640 1 -- 172.21.15.159:0/3844824392 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6d4011960 con 0x7fa6dc0d2080 2024-07-24T16:39:17.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6e147f640 1 -- 172.21.15.159:0/3844824392 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6dc0cbbb0 con 0x7fa6dc0d2080 2024-07-24T16:39:17.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6c37fe640 1 -- 172.21.15.159:0/3844824392 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6d4011db0 con 0x7fa6dc0d2080 2024-07-24T16:39:17.720 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.714+0000 7fa6e147f640 1 -- 172.21.15.159:0/3844824392 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6dc0cc170 con 0x7fa6dc0d2080 2024-07-24T16:39:17.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.715+0000 7fa6e147f640 1 -- 172.21.15.159:0/3844824392 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6dc0cfc20 con 0x7fa6dc0d2080 2024-07-24T16:39:17.721 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.716+0000 7fa6c37fe640 1 -- 172.21.15.159:0/3844824392 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fa6d4018020 con 0x7fa6dc0d2080 2024-07-24T16:39:17.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.716+0000 7fa6c37fe640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa6c8077010 0x7fa6c80794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:17.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.717+0000 7fa6c37fe640 1 -- 172.21.15.159:0/3844824392 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7fa6d40990b0 con 0x7fa6dc0d2080 2024-07-24T16:39:17.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.717+0000 7fa6daffd640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa6c8077010 0x7fa6c80794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:17.722 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.717+0000 7fa6daffd640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa6c8077010 0x7fa6c80794d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc035000 tx=0x7fa6cc02d040 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:17.723 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.721+0000 7fa6c37fe640 1 -- 172.21.15.159:0/3844824392 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fa6d401f030 con 0x7fa6dc0d2080 2024-07-24T16:39:17.904 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.901+0000 7fa6e147f640 1 -- 172.21.15.159:0/3844824392 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6dc1f7a30 con 0x7fa6c8077010 2024-07-24T16:39:17.908 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.906+0000 7fa6c37fe640 1 -- 172.21.15.159:0/3844824392 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250544 (secure 0 0 0) 0x7fa6dc1f7a30 con 0x7fa6c8077010 2024-07-24T16:39:17.911 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:39:17.912 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:39:17.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.909+0000 7fa6e147f640 1 -- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa6c8077010 msgr2=0x7fa6c80794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.909+0000 7fa6e147f640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa6c8077010 0x7fa6c80794d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc035000 tx=0x7fa6cc02d040 comp rx=0 tx=0).stop 2024-07-24T16:39:17.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.909+0000 7fa6e147f640 1 -- 172.21.15.159:0/3844824392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0d2080 msgr2=0x7fa6dc0cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:17.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.909+0000 7fa6e147f640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0d2080 0x7fa6dc0cda10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc08d530 tx=0x7fa6d40019b0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.914 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.909+0000 7fa6e147f640 1 -- 172.21.15.159:0/3844824392 shutdown_connections 2024-07-24T16:39:17.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.909+0000 7fa6e147f640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fa6c8077010 0x7fa6c80794d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.909+0000 7fa6e147f640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fa6dc0d2080 0x7fa6dc0cda10 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.909+0000 7fa6e147f640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fa6dc0d1c00 0x7fa6dc0cd4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.909+0000 7fa6e147f640 1 --2- 172.21.15.159:0/3844824392 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fa6c4003a30 0x7fa6dc1f4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:17.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.909+0000 7fa6e147f640 1 -- 172.21.15.159:0/3844824392 >> 172.21.15.159:0/3844824392 conn(0x7fa6dc09cd30 msgr2=0x7fa6dc06d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:17.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.909+0000 7fa6e147f640 1 -- 172.21.15.159:0/3844824392 shutdown_connections 2024-07-24T16:39:17.915 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:17.909+0000 7fa6e147f640 1 -- 172.21.15.159:0/3844824392 wait complete. 2024-07-24T16:39:17.922 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2024-07-24T16:39:16.575653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594162,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":178,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319192,"kb_used_data":7304,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754655528,"statfs":{"total":773094113280,"available":772767260672,"internally_reserved":0,"allocated":7479296,"data_stored":4285980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002365"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:10.552776+0000","last_change":"2024-07-24T16:37:04.000283+0000","last_active":"2024-07-24T16:39:10.552776+0000","last_peered":"2024-07-24T16:39:10.552776+0000","last_clean":"2024-07-24T16:39:10.552776+0000","last_became_active":"2024-07-24T16:37:04.000007+0000","last_became_peered":"2024-07-24T16:37:04.000007+0000","last_unstale":"2024-07-24T16:39:10.552776+0000","last_undegraded":"2024-07-24T16:39:10.552776+0000","last_fullsized":"2024-07-24T16:39:10.552776+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075097+0000","last_change":"2024-07-24T16:37:04.011891+0000","last_active":"2024-07-24T16:37:46.075097+0000","last_peered":"2024-07-24T16:37:46.075097+0000","last_clean":"2024-07-24T16:37:46.075097+0000","last_became_active":"2024-07-24T16:37:04.011627+0000","last_became_peered":"2024-07-24T16:37:04.011627+0000","last_unstale":"2024-07-24T16:37:46.075097+0000","last_undegraded":"2024-07-24T16:37:46.075097+0000","last_fullsized":"2024-07-24T16:37:46.075097+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:06.176465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:10.559307+0000","last_change":"2024-07-24T16:37:04.014901+0000","last_active":"2024-07-24T16:39:10.559307+0000","last_peered":"2024-07-24T16:39:10.559307+0000","last_clean":"2024-07-24T16:39:10.559307+0000","last_became_active":"2024-07-24T16:37:04.014649+0000","last_became_peered":"2024-07-24T16:37:04.014649+0000","last_unstale":"2024-07-24T16:39:10.559307+0000","last_undegraded":"2024-07-24T16:39:10.559307+0000","last_fullsized":"2024-07-24T16:39:10.559307+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075295+0000","last_change":"2024-07-24T16:37:04.011677+0000","last_active":"2024-07-24T16:37:46.075295+0000","last_peered":"2024-07-24T16:37:46.075295+0000","last_clean":"2024-07-24T16:37:46.075295+0000","last_became_active":"2024-07-24T16:37:04.011002+0000","last_became_peered":"2024-07-24T16:37:04.011002+0000","last_unstale":"2024-07-24T16:37:46.075295+0000","last_undegraded":"2024-07-24T16:37:46.075295+0000","last_fullsized":"2024-07-24T16:37:46.075295+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:11:36.298799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075070+0000","last_change":"2024-07-24T16:37:04.005188+0000","last_active":"2024-07-24T16:37:46.075070+0000","last_peered":"2024-07-24T16:37:46.075070+0000","last_clean":"2024-07-24T16:37:46.075070+0000","last_became_active":"2024-07-24T16:37:04.004895+0000","last_became_peered":"2024-07-24T16:37:04.004895+0000","last_unstale":"2024-07-24T16:37:46.075070+0000","last_undegraded":"2024-07-24T16:37:46.075070+0000","last_fullsized":"2024-07-24T16:37:46.075070+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:22:29.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668360+0000","last_change":"2024-07-24T16:37:04.009148+0000","last_active":"2024-07-24T16:37:45.668360+0000","last_peered":"2024-07-24T16:37:45.668360+0000","last_clean":"2024-07-24T16:37:45.668360+0000","last_became_active":"2024-07-24T16:37:04.008866+0000","last_became_peered":"2024-07-24T16:37:04.008866+0000","last_unstale":"2024-07-24T16:37:45.668360+0000","last_undegraded":"2024-07-24T16:37:45.668360+0000","last_fullsized":"2024-07-24T16:37:45.668360+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666826+0000","last_change":"2024-07-24T16:37:04.020944+0000","last_active":"2024-07-24T16:37:45.666826+0000","last_peered":"2024-07-24T16:37:45.666826+0000","last_clean":"2024-07-24T16:37:45.666826+0000","last_became_active":"2024-07-24T16:37:04.019103+0000","last_became_peered":"2024-07-24T16:37:04.019103+0000","last_unstale":"2024-07-24T16:37:45.666826+0000","last_undegraded":"2024-07-24T16:37:45.666826+0000","last_fullsized":"2024-07-24T16:37:45.666826+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":23,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.671500+0000","last_change":"2024-07-24T16:37:45.671415+0000","last_active":"2024-07-24T16:37:45.671500+0000","last_peered":"2024-07-24T16:37:45.671500+0000","last_clean":"2024-07-24T16:37:45.671500+0000","last_became_active":"2024-07-24T16:37:45.671060+0000","last_became_peered":"2024-07-24T16:37:45.671060+0000","last_unstale":"2024-07-24T16:37:45.671500+0000","last_undegraded":"2024-07-24T16:37:45.671500+0000","last_fullsized":"2024-07-24T16:37:45.671500+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:54:47.659029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669317+0000","last_change":"2024-07-24T16:37:04.024211+0000","last_active":"2024-07-24T16:37:45.669317+0000","last_peered":"2024-07-24T16:37:45.669317+0000","last_clean":"2024-07-24T16:37:45.669317+0000","last_became_active":"2024-07-24T16:37:04.023933+0000","last_became_peered":"2024-07-24T16:37:04.023933+0000","last_unstale":"2024-07-24T16:37:45.669317+0000","last_undegraded":"2024-07-24T16:37:45.669317+0000","last_fullsized":"2024-07-24T16:37:45.669317+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:08:35.396786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668200+0000","last_change":"2024-07-24T16:37:03.998622+0000","last_active":"2024-07-24T16:37:45.668200+0000","last_peered":"2024-07-24T16:37:45.668200+0000","last_clean":"2024-07-24T16:37:45.668200+0000","last_became_active":"2024-07-24T16:37:03.997985+0000","last_became_peered":"2024-07-24T16:37:03.997985+0000","last_unstale":"2024-07-24T16:37:45.668200+0000","last_undegraded":"2024-07-24T16:37:45.668200+0000","last_fullsized":"2024-07-24T16:37:45.668200+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074710+0000","last_change":"2024-07-24T16:37:04.008205+0000","last_active":"2024-07-24T16:37:46.074710+0000","last_peered":"2024-07-24T16:37:46.074710+0000","last_clean":"2024-07-24T16:37:46.074710+0000","last_became_active":"2024-07-24T16:37:04.006298+0000","last_became_peered":"2024-07-24T16:37:04.006298+0000","last_unstale":"2024-07-24T16:37:46.074710+0000","last_undegraded":"2024-07-24T16:37:46.074710+0000","last_fullsized":"2024-07-24T16:37:46.074710+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669526+0000","last_change":"2024-07-24T16:37:04.006667+0000","last_active":"2024-07-24T16:37:45.669526+0000","last_peered":"2024-07-24T16:37:45.669526+0000","last_clean":"2024-07-24T16:37:45.669526+0000","last_became_active":"2024-07-24T16:37:04.005908+0000","last_became_peered":"2024-07-24T16:37:04.005908+0000","last_unstale":"2024-07-24T16:37:45.669526+0000","last_undegraded":"2024-07-24T16:37:45.669526+0000","last_fullsized":"2024-07-24T16:37:45.669526+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:17.192204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668174+0000","last_change":"2024-07-24T16:37:04.002494+0000","last_active":"2024-07-24T16:37:45.668174+0000","last_peered":"2024-07-24T16:37:45.668174+0000","last_clean":"2024-07-24T16:37:45.668174+0000","last_became_active":"2024-07-24T16:37:04.001872+0000","last_became_peered":"2024-07-24T16:37:04.001872+0000","last_unstale":"2024-07-24T16:37:45.668174+0000","last_undegraded":"2024-07-24T16:37:45.668174+0000","last_fullsized":"2024-07-24T16:37:45.668174+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667102+0000","last_change":"2024-07-24T16:37:04.018574+0000","last_active":"2024-07-24T16:37:45.667102+0000","last_peered":"2024-07-24T16:37:45.667102+0000","last_clean":"2024-07-24T16:37:45.667102+0000","last_became_active":"2024-07-24T16:37:04.018314+0000","last_became_peered":"2024-07-24T16:37:04.018314+0000","last_unstale":"2024-07-24T16:37:45.667102+0000","last_undegraded":"2024-07-24T16:37:45.667102+0000","last_fullsized":"2024-07-24T16:37:45.667102+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074761+0000","last_change":"2024-07-24T16:37:04.009736+0000","last_active":"2024-07-24T16:37:46.074761+0000","last_peered":"2024-07-24T16:37:46.074761+0000","last_clean":"2024-07-24T16:37:46.074761+0000","last_became_active":"2024-07-24T16:37:04.009473+0000","last_became_peered":"2024-07-24T16:37:04.009473+0000","last_unstale":"2024-07-24T16:37:46.074761+0000","last_undegraded":"2024-07-24T16:37:46.074761+0000","last_fullsized":"2024-07-24T16:37:46.074761+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:05:05.128427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668077+0000","last_change":"2024-07-24T16:37:04.001780+0000","last_active":"2024-07-24T16:37:45.668077+0000","last_peered":"2024-07-24T16:37:45.668077+0000","last_clean":"2024-07-24T16:37:45.668077+0000","last_became_active":"2024-07-24T16:37:04.001535+0000","last_became_peered":"2024-07-24T16:37:04.001535+0000","last_unstale":"2024-07-24T16:37:45.668077+0000","last_undegraded":"2024-07-24T16:37:45.668077+0000","last_fullsized":"2024-07-24T16:37:45.668077+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668814+0000","last_change":"2024-07-24T16:37:45.668749+0000","last_active":"2024-07-24T16:37:45.668814+0000","last_peered":"2024-07-24T16:37:45.668814+0000","last_clean":"2024-07-24T16:37:45.668814+0000","last_became_active":"2024-07-24T16:37:45.668460+0000","last_became_peered":"2024-07-24T16:37:45.668460+0000","last_unstale":"2024-07-24T16:37:45.668814+0000","last_undegraded":"2024-07-24T16:37:45.668814+0000","last_fullsized":"2024-07-24T16:37:45.668814+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:08:12.604308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075161+0000","last_change":"2024-07-24T16:37:04.011422+0000","last_active":"2024-07-24T16:37:46.075161+0000","last_peered":"2024-07-24T16:37:46.075161+0000","last_clean":"2024-07-24T16:37:46.075161+0000","last_became_active":"2024-07-24T16:37:04.011166+0000","last_became_peered":"2024-07-24T16:37:04.011166+0000","last_unstale":"2024-07-24T16:37:46.075161+0000","last_undegraded":"2024-07-24T16:37:46.075161+0000","last_fullsized":"2024-07-24T16:37:46.075161+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:34.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667465+0000","last_change":"2024-07-24T16:37:04.008292+0000","last_active":"2024-07-24T16:37:45.667465+0000","last_peered":"2024-07-24T16:37:45.667465+0000","last_clean":"2024-07-24T16:37:45.667465+0000","last_became_active":"2024-07-24T16:37:04.008030+0000","last_became_peered":"2024-07-24T16:37:04.008030+0000","last_unstale":"2024-07-24T16:37:45.667465+0000","last_undegraded":"2024-07-24T16:37:45.667465+0000","last_fullsized":"2024-07-24T16:37:45.667465+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667556+0000","last_change":"2024-07-24T16:37:04.007961+0000","last_active":"2024-07-24T16:37:45.667556+0000","last_peered":"2024-07-24T16:37:45.667556+0000","last_clean":"2024-07-24T16:37:45.667556+0000","last_became_active":"2024-07-24T16:37:04.007154+0000","last_became_peered":"2024-07-24T16:37:04.007154+0000","last_unstale":"2024-07-24T16:37:45.667556+0000","last_undegraded":"2024-07-24T16:37:45.667556+0000","last_fullsized":"2024-07-24T16:37:45.667556+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:45.075854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667469+0000","last_change":"2024-07-24T16:37:04.007037+0000","last_active":"2024-07-24T16:37:45.667469+0000","last_peered":"2024-07-24T16:37:45.667469+0000","last_clean":"2024-07-24T16:37:45.667469+0000","last_became_active":"2024-07-24T16:37:04.006749+0000","last_became_peered":"2024-07-24T16:37:04.006749+0000","last_unstale":"2024-07-24T16:37:45.667469+0000","last_undegraded":"2024-07-24T16:37:45.667469+0000","last_fullsized":"2024-07-24T16:37:45.667469+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:20.158902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668852+0000","last_change":"2024-07-24T16:37:04.020205+0000","last_active":"2024-07-24T16:37:45.668852+0000","last_peered":"2024-07-24T16:37:45.668852+0000","last_clean":"2024-07-24T16:37:45.668852+0000","last_became_active":"2024-07-24T16:37:04.019931+0000","last_became_peered":"2024-07-24T16:37:04.019931+0000","last_unstale":"2024-07-24T16:37:45.668852+0000","last_undegraded":"2024-07-24T16:37:45.668852+0000","last_fullsized":"2024-07-24T16:37:45.668852+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:38:56.986337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074466+0000","last_change":"2024-07-24T16:37:04.003751+0000","last_active":"2024-07-24T16:37:46.074466+0000","last_peered":"2024-07-24T16:37:46.074466+0000","last_clean":"2024-07-24T16:37:46.074466+0000","last_became_active":"2024-07-24T16:37:04.003501+0000","last_became_peered":"2024-07-24T16:37:04.003501+0000","last_unstale":"2024-07-24T16:37:46.074466+0000","last_undegraded":"2024-07-24T16:37:46.074466+0000","last_fullsized":"2024-07-24T16:37:46.074466+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:14.393254+0000","last_change":"2024-07-24T16:37:04.023076+0000","last_active":"2024-07-24T16:39:14.393254+0000","last_peered":"2024-07-24T16:39:14.393254+0000","last_clean":"2024-07-24T16:39:14.393254+0000","last_became_active":"2024-07-24T16:37:04.021397+0000","last_became_peered":"2024-07-24T16:37:04.021397+0000","last_unstale":"2024-07-24T16:39:14.393254+0000","last_undegraded":"2024-07-24T16:39:14.393254+0000","last_fullsized":"2024-07-24T16:39:14.393254+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:14.393274+0000","last_change":"2024-07-24T16:37:04.021808+0000","last_active":"2024-07-24T16:39:14.393274+0000","last_peered":"2024-07-24T16:39:14.393274+0000","last_clean":"2024-07-24T16:39:14.393274+0000","last_became_active":"2024-07-24T16:37:04.021195+0000","last_became_peered":"2024-07-24T16:37:04.021195+0000","last_unstale":"2024-07-24T16:39:14.393274+0000","last_undegraded":"2024-07-24T16:39:14.393274+0000","last_fullsized":"2024-07-24T16:39:14.393274+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669157+0000","last_change":"2024-07-24T16:37:04.005510+0000","last_active":"2024-07-24T16:37:45.669157+0000","last_peered":"2024-07-24T16:37:45.669157+0000","last_clean":"2024-07-24T16:37:45.669157+0000","last_became_active":"2024-07-24T16:37:04.004807+0000","last_became_peered":"2024-07-24T16:37:04.004807+0000","last_unstale":"2024-07-24T16:37:45.669157+0000","last_undegraded":"2024-07-24T16:37:45.669157+0000","last_fullsized":"2024-07-24T16:37:45.669157+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:02:47.950208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:14.857015+0000","last_change":"2024-07-24T16:37:04.016153+0000","last_active":"2024-07-24T16:39:14.857015+0000","last_peered":"2024-07-24T16:39:14.857015+0000","last_clean":"2024-07-24T16:39:14.857015+0000","last_became_active":"2024-07-24T16:37:04.015860+0000","last_became_peered":"2024-07-24T16:37:04.015860+0000","last_unstale":"2024-07-24T16:39:14.857015+0000","last_undegraded":"2024-07-24T16:39:14.857015+0000","last_fullsized":"2024-07-24T16:39:14.857015+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667623+0000","last_change":"2024-07-24T16:37:04.006057+0000","last_active":"2024-07-24T16:37:45.667623+0000","last_peered":"2024-07-24T16:37:45.667623+0000","last_clean":"2024-07-24T16:37:45.667623+0000","last_became_active":"2024-07-24T16:37:04.005597+0000","last_became_peered":"2024-07-24T16:37:04.005597+0000","last_unstale":"2024-07-24T16:37:45.667623+0000","last_undegraded":"2024-07-24T16:37:45.667623+0000","last_fullsized":"2024-07-24T16:37:45.667623+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:24.848336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:10.559286+0000","last_change":"2024-07-24T16:37:04.015925+0000","last_active":"2024-07-24T16:39:10.559286+0000","last_peered":"2024-07-24T16:39:10.559286+0000","last_clean":"2024-07-24T16:39:10.559286+0000","last_became_active":"2024-07-24T16:37:04.015678+0000","last_became_peered":"2024-07-24T16:37:04.015678+0000","last_unstale":"2024-07-24T16:39:10.559286+0000","last_undegraded":"2024-07-24T16:39:10.559286+0000","last_fullsized":"2024-07-24T16:39:10.559286+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075009+0000","last_change":"2024-07-24T16:37:04.014588+0000","last_active":"2024-07-24T16:37:46.075009+0000","last_peered":"2024-07-24T16:37:46.075009+0000","last_clean":"2024-07-24T16:37:46.075009+0000","last_became_active":"2024-07-24T16:37:04.014310+0000","last_became_peered":"2024-07-24T16:37:04.014310+0000","last_unstale":"2024-07-24T16:37:46.075009+0000","last_undegraded":"2024-07-24T16:37:46.075009+0000","last_fullsized":"2024-07-24T16:37:46.075009+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:58:11.471962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:10.559268+0000","last_change":"2024-07-24T16:37:04.007655+0000","last_active":"2024-07-24T16:39:10.559268+0000","last_peered":"2024-07-24T16:39:10.559268+0000","last_clean":"2024-07-24T16:39:10.559268+0000","last_became_active":"2024-07-24T16:37:04.007367+0000","last_became_peered":"2024-07-24T16:37:04.007367+0000","last_unstale":"2024-07-24T16:39:10.559268+0000","last_undegraded":"2024-07-24T16:39:10.559268+0000","last_fullsized":"2024-07-24T16:39:10.559268+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665643+0000","last_change":"2024-07-24T16:37:04.011681+0000","last_active":"2024-07-24T16:37:45.665643+0000","last_peered":"2024-07-24T16:37:45.665643+0000","last_clean":"2024-07-24T16:37:45.665643+0000","last_became_active":"2024-07-24T16:37:04.011439+0000","last_became_peered":"2024-07-24T16:37:04.011439+0000","last_unstale":"2024-07-24T16:37:45.665643+0000","last_undegraded":"2024-07-24T16:37:45.665643+0000","last_fullsized":"2024-07-24T16:37:45.665643+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:06.176465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074554+0000","last_change":"2024-07-24T16:37:04.008494+0000","last_active":"2024-07-24T16:37:46.074554+0000","last_peered":"2024-07-24T16:37:46.074554+0000","last_clean":"2024-07-24T16:37:46.074554+0000","last_became_active":"2024-07-24T16:37:04.008128+0000","last_became_peered":"2024-07-24T16:37:04.008128+0000","last_unstale":"2024-07-24T16:37:46.074554+0000","last_undegraded":"2024-07-24T16:37:46.074554+0000","last_fullsized":"2024-07-24T16:37:46.074554+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:30:30.117383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"62'4","reported_seq":24,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667797+0000","last_change":"2024-07-24T16:37:03.003544+0000","last_active":"2024-07-24T16:37:45.667797+0000","last_peered":"2024-07-24T16:37:45.667797+0000","last_clean":"2024-07-24T16:37:45.667797+0000","last_became_active":"2024-07-24T16:37:03.003212+0000","last_became_peered":"2024-07-24T16:37:03.003212+0000","last_unstale":"2024-07-24T16:37:45.667797+0000","last_undegraded":"2024-07-24T16:37:45.667797+0000","last_fullsized":"2024-07-24T16:37:45.667797+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:10.767177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665478+0000","last_change":"2024-07-24T16:37:04.007097+0000","last_active":"2024-07-24T16:37:45.665478+0000","last_peered":"2024-07-24T16:37:45.665478+0000","last_clean":"2024-07-24T16:37:45.665478+0000","last_became_active":"2024-07-24T16:37:04.006833+0000","last_became_peered":"2024-07-24T16:37:04.006833+0000","last_unstale":"2024-07-24T16:37:45.665478+0000","last_undegraded":"2024-07-24T16:37:45.665478+0000","last_fullsized":"2024-07-24T16:37:45.665478+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:30:23.341481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"62'1","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:05.552343+0000","last_change":"2024-07-24T16:37:03.008723+0000","last_active":"2024-07-24T16:39:05.552343+0000","last_peered":"2024-07-24T16:39:05.552343+0000","last_clean":"2024-07-24T16:39:05.552343+0000","last_became_active":"2024-07-24T16:37:03.008450+0000","last_became_peered":"2024-07-24T16:37:03.008450+0000","last_unstale":"2024-07-24T16:39:05.552343+0000","last_undegraded":"2024-07-24T16:39:05.552343+0000","last_fullsized":"2024-07-24T16:39:05.552343+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667472+0000","last_change":"2024-07-24T16:37:04.009602+0000","last_active":"2024-07-24T16:37:45.667472+0000","last_peered":"2024-07-24T16:37:45.667472+0000","last_clean":"2024-07-24T16:37:45.667472+0000","last_became_active":"2024-07-24T16:37:04.009341+0000","last_became_peered":"2024-07-24T16:37:04.009341+0000","last_unstale":"2024-07-24T16:37:45.667472+0000","last_undegraded":"2024-07-24T16:37:45.667472+0000","last_fullsized":"2024-07-24T16:37:45.667472+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:40.906131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"65'3","reported_seq":31,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:15.050899+0000","last_change":"2024-07-24T16:39:15.050942+0000","last_active":"2024-07-24T16:39:15.050899+0000","last_peered":"2024-07-24T16:39:15.050899+0000","last_clean":"2024-07-24T16:39:15.050899+0000","last_became_active":"2024-07-24T16:37:02.999177+0000","last_became_peered":"2024-07-24T16:37:02.999177+0000","last_unstale":"2024-07-24T16:39:15.050899+0000","last_undegraded":"2024-07-24T16:39:15.050899+0000","last_fullsized":"2024-07-24T16:39:15.050899+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'3","last_scrub_stamp":"2024-07-24T16:39:15.050826+0000","last_deep_scrub":"65'3","last_deep_scrub_stamp":"2024-07-24T16:39:15.050826+0000","last_clean_scrub_stamp":"2024-07-24T16:39:15.050826+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:25:08.617394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668584+0000","last_change":"2024-07-24T16:37:04.005041+0000","last_active":"2024-07-24T16:37:45.668584+0000","last_peered":"2024-07-24T16:37:45.668584+0000","last_clean":"2024-07-24T16:37:45.668584+0000","last_became_active":"2024-07-24T16:37:04.004752+0000","last_became_peered":"2024-07-24T16:37:04.004752+0000","last_unstale":"2024-07-24T16:37:45.668584+0000","last_undegraded":"2024-07-24T16:37:45.668584+0000","last_fullsized":"2024-07-24T16:37:45.668584+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:28:48.788361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"62'2","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665668+0000","last_change":"2024-07-24T16:37:03.013833+0000","last_active":"2024-07-24T16:37:45.665668+0000","last_peered":"2024-07-24T16:37:45.665668+0000","last_clean":"2024-07-24T16:37:45.665668+0000","last_became_active":"2024-07-24T16:37:03.013501+0000","last_became_peered":"2024-07-24T16:37:03.013501+0000","last_unstale":"2024-07-24T16:37:45.665668+0000","last_undegraded":"2024-07-24T16:37:45.665668+0000","last_fullsized":"2024-07-24T16:37:45.665668+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:22:55.536686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075387+0000","last_change":"2024-07-24T16:37:04.008541+0000","last_active":"2024-07-24T16:37:46.075387+0000","last_peered":"2024-07-24T16:37:46.075387+0000","last_clean":"2024-07-24T16:37:46.075387+0000","last_became_active":"2024-07-24T16:37:04.008251+0000","last_became_peered":"2024-07-24T16:37:04.008251+0000","last_unstale":"2024-07-24T16:37:46.075387+0000","last_undegraded":"2024-07-24T16:37:46.075387+0000","last_fullsized":"2024-07-24T16:37:46.075387+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:23:03.807268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"62'1","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667279+0000","last_change":"2024-07-24T16:37:03.000053+0000","last_active":"2024-07-24T16:37:45.667279+0000","last_peered":"2024-07-24T16:37:45.667279+0000","last_clean":"2024-07-24T16:37:45.667279+0000","last_became_active":"2024-07-24T16:37:02.999733+0000","last_became_peered":"2024-07-24T16:37:02.999733+0000","last_unstale":"2024-07-24T16:37:45.667279+0000","last_undegraded":"2024-07-24T16:37:45.667279+0000","last_fullsized":"2024-07-24T16:37:45.667279+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075007+0000","last_change":"2024-07-24T16:37:04.008622+0000","last_active":"2024-07-24T16:37:46.075007+0000","last_peered":"2024-07-24T16:37:46.075007+0000","last_clean":"2024-07-24T16:37:46.075007+0000","last_became_active":"2024-07-24T16:37:04.008293+0000","last_became_peered":"2024-07-24T16:37:04.008293+0000","last_unstale":"2024-07-24T16:37:46.075007+0000","last_undegraded":"2024-07-24T16:37:46.075007+0000","last_fullsized":"2024-07-24T16:37:46.075007+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:45:10.486075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074858+0000","last_change":"2024-07-24T16:37:03.005837+0000","last_active":"2024-07-24T16:37:46.074858+0000","last_peered":"2024-07-24T16:37:46.074858+0000","last_clean":"2024-07-24T16:37:46.074858+0000","last_became_active":"2024-07-24T16:37:03.005494+0000","last_became_peered":"2024-07-24T16:37:03.005494+0000","last_unstale":"2024-07-24T16:37:46.074858+0000","last_undegraded":"2024-07-24T16:37:46.074858+0000","last_fullsized":"2024-07-24T16:37:46.074858+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:43:19.152923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669257+0000","last_change":"2024-07-24T16:37:04.001679+0000","last_active":"2024-07-24T16:37:45.669257+0000","last_peered":"2024-07-24T16:37:45.669257+0000","last_clean":"2024-07-24T16:37:45.669257+0000","last_became_active":"2024-07-24T16:37:04.001396+0000","last_became_peered":"2024-07-24T16:37:04.001396+0000","last_unstale":"2024-07-24T16:37:45.669257+0000","last_undegraded":"2024-07-24T16:37:45.669257+0000","last_fullsized":"2024-07-24T16:37:45.669257+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:52:48.147517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667397+0000","last_change":"2024-07-24T16:37:03.003994+0000","last_active":"2024-07-24T16:37:45.667397+0000","last_peered":"2024-07-24T16:37:45.667397+0000","last_clean":"2024-07-24T16:37:45.667397+0000","last_became_active":"2024-07-24T16:37:03.003689+0000","last_became_peered":"2024-07-24T16:37:03.003689+0000","last_unstale":"2024-07-24T16:37:45.667397+0000","last_undegraded":"2024-07-24T16:37:45.667397+0000","last_fullsized":"2024-07-24T16:37:45.667397+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:17:37.057978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074994+0000","last_change":"2024-07-24T16:37:04.024282+0000","last_active":"2024-07-24T16:37:46.074994+0000","last_peered":"2024-07-24T16:37:46.074994+0000","last_clean":"2024-07-24T16:37:46.074994+0000","last_became_active":"2024-07-24T16:37:04.024040+0000","last_became_peered":"2024-07-24T16:37:04.024040+0000","last_unstale":"2024-07-24T16:37:46.074994+0000","last_undegraded":"2024-07-24T16:37:46.074994+0000","last_fullsized":"2024-07-24T16:37:46.074994+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:55.570490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.666894+0000","last_change":"2024-07-24T16:37:02.999879+0000","last_active":"2024-07-24T16:37:45.666894+0000","last_peered":"2024-07-24T16:37:45.666894+0000","last_clean":"2024-07-24T16:37:45.666894+0000","last_became_active":"2024-07-24T16:37:02.999554+0000","last_became_peered":"2024-07-24T16:37:02.999554+0000","last_unstale":"2024-07-24T16:37:45.666894+0000","last_undegraded":"2024-07-24T16:37:45.666894+0000","last_fullsized":"2024-07-24T16:37:45.666894+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074597+0000","last_change":"2024-07-24T16:37:04.012481+0000","last_active":"2024-07-24T16:37:46.074597+0000","last_peered":"2024-07-24T16:37:46.074597+0000","last_clean":"2024-07-24T16:37:46.074597+0000","last_became_active":"2024-07-24T16:37:04.012217+0000","last_became_peered":"2024-07-24T16:37:04.012217+0000","last_unstale":"2024-07-24T16:37:46.074597+0000","last_undegraded":"2024-07-24T16:37:46.074597+0000","last_fullsized":"2024-07-24T16:37:46.074597+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:10:47.439606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075111+0000","last_change":"2024-07-24T16:37:03.005534+0000","last_active":"2024-07-24T16:37:46.075111+0000","last_peered":"2024-07-24T16:37:46.075111+0000","last_clean":"2024-07-24T16:37:46.075111+0000","last_became_active":"2024-07-24T16:37:03.005232+0000","last_became_peered":"2024-07-24T16:37:03.005232+0000","last_unstale":"2024-07-24T16:37:46.075111+0000","last_undegraded":"2024-07-24T16:37:46.075111+0000","last_fullsized":"2024-07-24T16:37:46.075111+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:18:00.748831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665427+0000","last_change":"2024-07-24T16:37:03.995253+0000","last_active":"2024-07-24T16:37:45.665427+0000","last_peered":"2024-07-24T16:37:45.665427+0000","last_clean":"2024-07-24T16:37:45.665427+0000","last_became_active":"2024-07-24T16:37:03.994904+0000","last_became_peered":"2024-07-24T16:37:03.994904+0000","last_unstale":"2024-07-24T16:37:45.665427+0000","last_undegraded":"2024-07-24T16:37:45.665427+0000","last_fullsized":"2024-07-24T16:37:45.665427+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:55.570490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075316+0000","last_change":"2024-07-24T16:37:03.004109+0000","last_active":"2024-07-24T16:37:46.075316+0000","last_peered":"2024-07-24T16:37:46.075316+0000","last_clean":"2024-07-24T16:37:46.075316+0000","last_became_active":"2024-07-24T16:37:03.003813+0000","last_became_peered":"2024-07-24T16:37:03.003813+0000","last_unstale":"2024-07-24T16:37:46.075316+0000","last_undegraded":"2024-07-24T16:37:46.075316+0000","last_fullsized":"2024-07-24T16:37:46.075316+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:43:44.069876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667194+0000","last_change":"2024-07-24T16:37:04.015827+0000","last_active":"2024-07-24T16:37:45.667194+0000","last_peered":"2024-07-24T16:37:45.667194+0000","last_clean":"2024-07-24T16:37:45.667194+0000","last_became_active":"2024-07-24T16:37:04.015577+0000","last_became_peered":"2024-07-24T16:37:04.015577+0000","last_unstale":"2024-07-24T16:37:45.667194+0000","last_undegraded":"2024-07-24T16:37:45.667194+0000","last_fullsized":"2024-07-24T16:37:45.667194+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"62'3","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075330+0000","last_change":"2024-07-24T16:37:03.002358+0000","last_active":"2024-07-24T16:37:46.075330+0000","last_peered":"2024-07-24T16:37:46.075330+0000","last_clean":"2024-07-24T16:37:46.075330+0000","last_became_active":"2024-07-24T16:37:03.001970+0000","last_became_peered":"2024-07-24T16:37:03.001970+0000","last_unstale":"2024-07-24T16:37:46.075330+0000","last_undegraded":"2024-07-24T16:37:46.075330+0000","last_fullsized":"2024-07-24T16:37:46.075330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:18:18.548923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075114+0000","last_change":"2024-07-24T16:37:03.996498+0000","last_active":"2024-07-24T16:37:46.075114+0000","last_peered":"2024-07-24T16:37:46.075114+0000","last_clean":"2024-07-24T16:37:46.075114+0000","last_became_active":"2024-07-24T16:37:03.996235+0000","last_became_peered":"2024-07-24T16:37:03.996235+0000","last_unstale":"2024-07-24T16:37:46.075114+0000","last_undegraded":"2024-07-24T16:37:46.075114+0000","last_fullsized":"2024-07-24T16:37:46.075114+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:50:22.080512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"65'10","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:10.654421+0000","last_change":"2024-07-24T16:37:03.008087+0000","last_active":"2024-07-24T16:39:10.654421+0000","last_peered":"2024-07-24T16:39:10.654421+0000","last_clean":"2024-07-24T16:39:10.654421+0000","last_became_active":"2024-07-24T16:37:03.007813+0000","last_became_peered":"2024-07-24T16:37:03.007813+0000","last_unstale":"2024-07-24T16:39:10.654421+0000","last_undegraded":"2024-07-24T16:39:10.654421+0000","last_fullsized":"2024-07-24T16:39:10.654421+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:45:09.480096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665800+0000","last_change":"2024-07-24T16:37:04.007864+0000","last_active":"2024-07-24T16:37:45.665800+0000","last_peered":"2024-07-24T16:37:45.665800+0000","last_clean":"2024-07-24T16:37:45.665800+0000","last_became_active":"2024-07-24T16:37:04.007559+0000","last_became_peered":"2024-07-24T16:37:04.007559+0000","last_unstale":"2024-07-24T16:37:45.665800+0000","last_undegraded":"2024-07-24T16:37:45.665800+0000","last_fullsized":"2024-07-24T16:37:45.665800+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:40:36.400835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"62'2","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667323+0000","last_change":"2024-07-24T16:37:03.003657+0000","last_active":"2024-07-24T16:37:45.667323+0000","last_peered":"2024-07-24T16:37:45.667323+0000","last_clean":"2024-07-24T16:37:45.667323+0000","last_became_active":"2024-07-24T16:37:03.003386+0000","last_became_peered":"2024-07-24T16:37:03.003386+0000","last_unstale":"2024-07-24T16:37:45.667323+0000","last_undegraded":"2024-07-24T16:37:45.667323+0000","last_fullsized":"2024-07-24T16:37:45.667323+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667563+0000","last_change":"2024-07-24T16:37:04.019133+0000","last_active":"2024-07-24T16:37:45.667563+0000","last_peered":"2024-07-24T16:37:45.667563+0000","last_clean":"2024-07-24T16:37:45.667563+0000","last_became_active":"2024-07-24T16:37:04.018826+0000","last_became_peered":"2024-07-24T16:37:04.018826+0000","last_unstale":"2024-07-24T16:37:45.667563+0000","last_undegraded":"2024-07-24T16:37:45.667563+0000","last_fullsized":"2024-07-24T16:37:45.667563+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667503+0000","last_change":"2024-07-24T16:37:03.003836+0000","last_active":"2024-07-24T16:37:45.667503+0000","last_peered":"2024-07-24T16:37:45.667503+0000","last_clean":"2024-07-24T16:37:45.667503+0000","last_became_active":"2024-07-24T16:37:03.003542+0000","last_became_peered":"2024-07-24T16:37:03.003542+0000","last_unstale":"2024-07-24T16:37:45.667503+0000","last_undegraded":"2024-07-24T16:37:45.667503+0000","last_fullsized":"2024-07-24T16:37:45.667503+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:40:08.258903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669476+0000","last_change":"2024-07-24T16:37:04.011095+0000","last_active":"2024-07-24T16:37:45.669476+0000","last_peered":"2024-07-24T16:37:45.669476+0000","last_clean":"2024-07-24T16:37:45.669476+0000","last_became_active":"2024-07-24T16:37:04.010791+0000","last_became_peered":"2024-07-24T16:37:04.010791+0000","last_unstale":"2024-07-24T16:37:45.669476+0000","last_undegraded":"2024-07-24T16:37:45.669476+0000","last_fullsized":"2024-07-24T16:37:45.669476+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:53:23.625615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074790+0000","last_change":"2024-07-24T16:37:03.010829+0000","last_active":"2024-07-24T16:37:46.074790+0000","last_peered":"2024-07-24T16:37:46.074790+0000","last_clean":"2024-07-24T16:37:46.074790+0000","last_became_active":"2024-07-24T16:37:03.010566+0000","last_became_peered":"2024-07-24T16:37:03.010566+0000","last_unstale":"2024-07-24T16:37:46.074790+0000","last_undegraded":"2024-07-24T16:37:46.074790+0000","last_fullsized":"2024-07-24T16:37:46.074790+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:58:26.392478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:10.559321+0000","last_change":"2024-07-24T16:37:04.023416+0000","last_active":"2024-07-24T16:39:10.559321+0000","last_peered":"2024-07-24T16:39:10.559321+0000","last_clean":"2024-07-24T16:39:10.559321+0000","last_became_active":"2024-07-24T16:37:04.020968+0000","last_became_peered":"2024-07-24T16:37:04.020968+0000","last_unstale":"2024-07-24T16:39:10.559321+0000","last_undegraded":"2024-07-24T16:39:10.559321+0000","last_fullsized":"2024-07-24T16:39:10.559321+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"62'8","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668973+0000","last_change":"2024-07-24T16:37:03.006180+0000","last_active":"2024-07-24T16:37:45.668973+0000","last_peered":"2024-07-24T16:37:45.668973+0000","last_clean":"2024-07-24T16:37:45.668973+0000","last_became_active":"2024-07-24T16:37:03.005719+0000","last_became_peered":"2024-07-24T16:37:03.005719+0000","last_unstale":"2024-07-24T16:37:45.668973+0000","last_undegraded":"2024-07-24T16:37:45.668973+0000","last_fullsized":"2024-07-24T16:37:45.668973+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:05:05.170486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669046+0000","last_change":"2024-07-24T16:37:04.005089+0000","last_active":"2024-07-24T16:37:45.669046+0000","last_peered":"2024-07-24T16:37:45.669046+0000","last_clean":"2024-07-24T16:37:45.669046+0000","last_became_active":"2024-07-24T16:37:04.004750+0000","last_became_peered":"2024-07-24T16:37:04.004750+0000","last_unstale":"2024-07-24T16:37:45.669046+0000","last_undegraded":"2024-07-24T16:37:45.669046+0000","last_fullsized":"2024-07-24T16:37:45.669046+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:34:37.325695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"62'1","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667976+0000","last_change":"2024-07-24T16:37:03.013805+0000","last_active":"2024-07-24T16:37:45.667976+0000","last_peered":"2024-07-24T16:37:45.667976+0000","last_clean":"2024-07-24T16:37:45.667976+0000","last_became_active":"2024-07-24T16:37:03.013485+0000","last_became_peered":"2024-07-24T16:37:03.013485+0000","last_unstale":"2024-07-24T16:37:45.667976+0000","last_undegraded":"2024-07-24T16:37:45.667976+0000","last_fullsized":"2024-07-24T16:37:45.667976+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:10.552736+0000","last_change":"2024-07-24T16:37:04.019820+0000","last_active":"2024-07-24T16:39:10.552736+0000","last_peered":"2024-07-24T16:39:10.552736+0000","last_clean":"2024-07-24T16:39:10.552736+0000","last_became_active":"2024-07-24T16:37:04.019539+0000","last_became_peered":"2024-07-24T16:37:04.019539+0000","last_unstale":"2024-07-24T16:39:10.552736+0000","last_undegraded":"2024-07-24T16:39:10.552736+0000","last_fullsized":"2024-07-24T16:39:10.552736+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"62'2","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074758+0000","last_change":"2024-07-24T16:37:02.998295+0000","last_active":"2024-07-24T16:37:46.074758+0000","last_peered":"2024-07-24T16:37:46.074758+0000","last_clean":"2024-07-24T16:37:46.074758+0000","last_became_active":"2024-07-24T16:37:02.998007+0000","last_became_peered":"2024-07-24T16:37:02.998007+0000","last_unstale":"2024-07-24T16:37:46.074758+0000","last_undegraded":"2024-07-24T16:37:46.074758+0000","last_fullsized":"2024-07-24T16:37:46.074758+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074828+0000","last_change":"2024-07-24T16:37:04.022338+0000","last_active":"2024-07-24T16:37:46.074828+0000","last_peered":"2024-07-24T16:37:46.074828+0000","last_clean":"2024-07-24T16:37:46.074828+0000","last_became_active":"2024-07-24T16:37:04.022113+0000","last_became_peered":"2024-07-24T16:37:04.022113+0000","last_unstale":"2024-07-24T16:37:46.074828+0000","last_undegraded":"2024-07-24T16:37:46.074828+0000","last_fullsized":"2024-07-24T16:37:46.074828+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:26:46.966508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"62'1","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667700+0000","last_change":"2024-07-24T16:37:03.001292+0000","last_active":"2024-07-24T16:37:45.667700+0000","last_peered":"2024-07-24T16:37:45.667700+0000","last_clean":"2024-07-24T16:37:45.667700+0000","last_became_active":"2024-07-24T16:37:03.001003+0000","last_became_peered":"2024-07-24T16:37:03.001003+0000","last_unstale":"2024-07-24T16:37:45.667700+0000","last_undegraded":"2024-07-24T16:37:45.667700+0000","last_fullsized":"2024-07-24T16:37:45.667700+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:51:36.249129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:10.552760+0000","last_change":"2024-07-24T16:37:03.999104+0000","last_active":"2024-07-24T16:39:10.552760+0000","last_peered":"2024-07-24T16:39:10.552760+0000","last_clean":"2024-07-24T16:39:10.552760+0000","last_became_active":"2024-07-24T16:37:03.998825+0000","last_became_peered":"2024-07-24T16:37:03.998825+0000","last_unstale":"2024-07-24T16:39:10.552760+0000","last_undegraded":"2024-07-24T16:39:10.552760+0000","last_fullsized":"2024-07-24T16:39:10.552760+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667674+0000","last_change":"2024-07-24T16:37:03.013889+0000","last_active":"2024-07-24T16:37:45.667674+0000","last_peered":"2024-07-24T16:37:45.667674+0000","last_clean":"2024-07-24T16:37:45.667674+0000","last_became_active":"2024-07-24T16:37:03.013550+0000","last_became_peered":"2024-07-24T16:37:03.013550+0000","last_unstale":"2024-07-24T16:37:45.667674+0000","last_undegraded":"2024-07-24T16:37:45.667674+0000","last_fullsized":"2024-07-24T16:37:45.667674+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:44:32.419679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665609+0000","last_change":"2024-07-24T16:37:04.000366+0000","last_active":"2024-07-24T16:37:45.665609+0000","last_peered":"2024-07-24T16:37:45.665609+0000","last_clean":"2024-07-24T16:37:45.665609+0000","last_became_active":"2024-07-24T16:37:04.000074+0000","last_became_peered":"2024-07-24T16:37:04.000074+0000","last_unstale":"2024-07-24T16:37:45.665609+0000","last_undegraded":"2024-07-24T16:37:45.665609+0000","last_fullsized":"2024-07-24T16:37:45.665609+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:13:56.585430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"62'2","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.668373+0000","last_change":"2024-07-24T16:37:02.995822+0000","last_active":"2024-07-24T16:37:45.668373+0000","last_peered":"2024-07-24T16:37:45.668373+0000","last_clean":"2024-07-24T16:37:45.668373+0000","last_became_active":"2024-07-24T16:37:02.995536+0000","last_became_peered":"2024-07-24T16:37:02.995536+0000","last_unstale":"2024-07-24T16:37:45.668373+0000","last_undegraded":"2024-07-24T16:37:45.668373+0000","last_fullsized":"2024-07-24T16:37:45.668373+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667752+0000","last_change":"2024-07-24T16:37:04.004492+0000","last_active":"2024-07-24T16:37:45.667752+0000","last_peered":"2024-07-24T16:37:45.667752+0000","last_clean":"2024-07-24T16:37:45.667752+0000","last_became_active":"2024-07-24T16:37:04.004210+0000","last_became_peered":"2024-07-24T16:37:04.004210+0000","last_unstale":"2024-07-24T16:37:45.667752+0000","last_undegraded":"2024-07-24T16:37:45.667752+0000","last_fullsized":"2024-07-24T16:37:45.667752+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:28:19.279886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669044+0000","last_change":"2024-07-24T16:37:03.007200+0000","last_active":"2024-07-24T16:37:45.669044+0000","last_peered":"2024-07-24T16:37:45.669044+0000","last_clean":"2024-07-24T16:37:45.669044+0000","last_became_active":"2024-07-24T16:37:03.006461+0000","last_became_peered":"2024-07-24T16:37:03.006461+0000","last_unstale":"2024-07-24T16:37:45.669044+0000","last_undegraded":"2024-07-24T16:37:45.669044+0000","last_fullsized":"2024-07-24T16:37:45.669044+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:58:10.465983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:14.393047+0000","last_change":"2024-07-24T16:37:04.011548+0000","last_active":"2024-07-24T16:39:14.393047+0000","last_peered":"2024-07-24T16:39:14.393047+0000","last_clean":"2024-07-24T16:39:14.393047+0000","last_became_active":"2024-07-24T16:37:04.011301+0000","last_became_peered":"2024-07-24T16:37:04.011301+0000","last_unstale":"2024-07-24T16:39:14.393047+0000","last_undegraded":"2024-07-24T16:39:14.393047+0000","last_fullsized":"2024-07-24T16:39:14.393047+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":21,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:14.392896+0000","last_change":"2024-07-24T16:37:03.000155+0000","last_active":"2024-07-24T16:39:14.392896+0000","last_peered":"2024-07-24T16:39:14.392896+0000","last_clean":"2024-07-24T16:39:14.392896+0000","last_became_active":"2024-07-24T16:37:02.999863+0000","last_became_peered":"2024-07-24T16:37:02.999863+0000","last_unstale":"2024-07-24T16:39:14.392896+0000","last_undegraded":"2024-07-24T16:39:14.392896+0000","last_fullsized":"2024-07-24T16:39:14.392896+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:14.856978+0000","last_change":"2024-07-24T16:37:04.009717+0000","last_active":"2024-07-24T16:39:14.856978+0000","last_peered":"2024-07-24T16:39:14.856978+0000","last_clean":"2024-07-24T16:39:14.856978+0000","last_became_active":"2024-07-24T16:37:04.009453+0000","last_became_peered":"2024-07-24T16:37:04.009453+0000","last_unstale":"2024-07-24T16:39:14.856978+0000","last_undegraded":"2024-07-24T16:39:14.856978+0000","last_fullsized":"2024-07-24T16:39:14.856978+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:15.427689+0000","last_change":"2024-07-24T16:39:15.427689+0000","last_active":"2024-07-24T16:39:15.427689+0000","last_peered":"2024-07-24T16:39:15.427689+0000","last_clean":"2024-07-24T16:39:15.427689+0000","last_became_active":"2024-07-24T16:37:03.000630+0000","last_became_peered":"2024-07-24T16:37:03.000630+0000","last_unstale":"2024-07-24T16:39:15.427689+0000","last_undegraded":"2024-07-24T16:39:15.427689+0000","last_fullsized":"2024-07-24T16:39:15.427689+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:15.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:15.427597+0000","last_clean_scrub_stamp":"2024-07-24T16:39:15.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:31:58.010677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665495+0000","last_change":"2024-07-24T16:37:04.001385+0000","last_active":"2024-07-24T16:37:45.665495+0000","last_peered":"2024-07-24T16:37:45.665495+0000","last_clean":"2024-07-24T16:37:45.665495+0000","last_became_active":"2024-07-24T16:37:04.001124+0000","last_became_peered":"2024-07-24T16:37:04.001124+0000","last_unstale":"2024-07-24T16:37:45.665495+0000","last_undegraded":"2024-07-24T16:37:45.665495+0000","last_fullsized":"2024-07-24T16:37:45.665495+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:34.307347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"62'2","reported_seq":22,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667873+0000","last_change":"2024-07-24T16:37:03.003668+0000","last_active":"2024-07-24T16:37:45.667873+0000","last_peered":"2024-07-24T16:37:45.667873+0000","last_clean":"2024-07-24T16:37:45.667873+0000","last_became_active":"2024-07-24T16:37:03.003387+0000","last_became_peered":"2024-07-24T16:37:03.003387+0000","last_unstale":"2024-07-24T16:37:45.667873+0000","last_undegraded":"2024-07-24T16:37:45.667873+0000","last_fullsized":"2024-07-24T16:37:45.667873+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:50:35.318606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:14.856913+0000","last_change":"2024-07-24T16:37:04.000123+0000","last_active":"2024-07-24T16:39:14.856913+0000","last_peered":"2024-07-24T16:39:14.856913+0000","last_clean":"2024-07-24T16:39:14.856913+0000","last_became_active":"2024-07-24T16:37:03.999841+0000","last_became_peered":"2024-07-24T16:37:03.999841+0000","last_unstale":"2024-07-24T16:39:14.856913+0000","last_undegraded":"2024-07-24T16:39:14.856913+0000","last_fullsized":"2024-07-24T16:39:14.856913+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075276+0000","last_change":"2024-07-24T16:37:03.003110+0000","last_active":"2024-07-24T16:37:46.075276+0000","last_peered":"2024-07-24T16:37:46.075276+0000","last_clean":"2024-07-24T16:37:46.075276+0000","last_became_active":"2024-07-24T16:37:03.002819+0000","last_became_peered":"2024-07-24T16:37:03.002819+0000","last_unstale":"2024-07-24T16:37:46.075276+0000","last_undegraded":"2024-07-24T16:37:46.075276+0000","last_fullsized":"2024-07-24T16:37:46.075276+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:32:42.309475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669126+0000","last_change":"2024-07-24T16:37:04.007895+0000","last_active":"2024-07-24T16:37:45.669126+0000","last_peered":"2024-07-24T16:37:45.669126+0000","last_clean":"2024-07-24T16:37:45.669126+0000","last_became_active":"2024-07-24T16:37:04.007614+0000","last_became_peered":"2024-07-24T16:37:04.007614+0000","last_unstale":"2024-07-24T16:37:45.669126+0000","last_undegraded":"2024-07-24T16:37:45.669126+0000","last_fullsized":"2024-07-24T16:37:45.669126+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:36:32.427250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:14.741236+0000","last_change":"2024-07-24T16:39:14.741258+0000","last_active":"2024-07-24T16:39:14.741236+0000","last_peered":"2024-07-24T16:39:14.741236+0000","last_clean":"2024-07-24T16:39:14.741236+0000","last_became_active":"2024-07-24T16:37:03.002219+0000","last_became_peered":"2024-07-24T16:37:03.002219+0000","last_unstale":"2024-07-24T16:39:14.741236+0000","last_undegraded":"2024-07-24T16:39:14.741236+0000","last_fullsized":"2024-07-24T16:39:14.741236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:14.741148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:14.741148+0000","last_clean_scrub_stamp":"2024-07-24T16:39:14.741148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:55:15.727581+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667508+0000","last_change":"2024-07-24T16:37:04.021367+0000","last_active":"2024-07-24T16:37:45.667508+0000","last_peered":"2024-07-24T16:37:45.667508+0000","last_clean":"2024-07-24T16:37:45.667508+0000","last_became_active":"2024-07-24T16:37:04.021059+0000","last_became_peered":"2024-07-24T16:37:04.021059+0000","last_unstale":"2024-07-24T16:37:45.667508+0000","last_undegraded":"2024-07-24T16:37:45.667508+0000","last_fullsized":"2024-07-24T16:37:45.667508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669294+0000","last_change":"2024-07-24T16:37:03.009702+0000","last_active":"2024-07-24T16:37:45.669294+0000","last_peered":"2024-07-24T16:37:45.669294+0000","last_clean":"2024-07-24T16:37:45.669294+0000","last_became_active":"2024-07-24T16:37:03.009216+0000","last_became_peered":"2024-07-24T16:37:03.009216+0000","last_unstale":"2024-07-24T16:37:45.669294+0000","last_undegraded":"2024-07-24T16:37:45.669294+0000","last_fullsized":"2024-07-24T16:37:45.669294+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:33.301368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665544+0000","last_change":"2024-07-24T16:37:04.007332+0000","last_active":"2024-07-24T16:37:45.665544+0000","last_peered":"2024-07-24T16:37:45.665544+0000","last_clean":"2024-07-24T16:37:45.665544+0000","last_became_active":"2024-07-24T16:37:04.007096+0000","last_became_peered":"2024-07-24T16:37:04.007096+0000","last_unstale":"2024-07-24T16:37:45.665544+0000","last_undegraded":"2024-07-24T16:37:45.665544+0000","last_fullsized":"2024-07-24T16:37:45.665544+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:23:03.806832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669021+0000","last_change":"2024-07-24T16:37:03.008273+0000","last_active":"2024-07-24T16:37:45.669021+0000","last_peered":"2024-07-24T16:37:45.669021+0000","last_clean":"2024-07-24T16:37:45.669021+0000","last_became_active":"2024-07-24T16:37:03.008025+0000","last_became_peered":"2024-07-24T16:37:03.008025+0000","last_unstale":"2024-07-24T16:37:45.669021+0000","last_undegraded":"2024-07-24T16:37:45.669021+0000","last_fullsized":"2024-07-24T16:37:45.669021+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:17:54.564511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667656+0000","last_change":"2024-07-24T16:37:04.018001+0000","last_active":"2024-07-24T16:37:45.667656+0000","last_peered":"2024-07-24T16:37:45.667656+0000","last_clean":"2024-07-24T16:37:45.667656+0000","last_became_active":"2024-07-24T16:37:04.017748+0000","last_became_peered":"2024-07-24T16:37:04.017748+0000","last_unstale":"2024-07-24T16:37:45.667656+0000","last_undegraded":"2024-07-24T16:37:45.667656+0000","last_fullsized":"2024-07-24T16:37:45.667656+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.075393+0000","last_change":"2024-07-24T16:37:03.008246+0000","last_active":"2024-07-24T16:37:46.075393+0000","last_peered":"2024-07-24T16:37:46.075393+0000","last_clean":"2024-07-24T16:37:46.075393+0000","last_became_active":"2024-07-24T16:37:03.008010+0000","last_became_peered":"2024-07-24T16:37:03.008010+0000","last_unstale":"2024-07-24T16:37:46.075393+0000","last_undegraded":"2024-07-24T16:37:46.075393+0000","last_fullsized":"2024-07-24T16:37:46.075393+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:23:23.842357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.669435+0000","last_change":"2024-07-24T16:37:04.004696+0000","last_active":"2024-07-24T16:37:45.669435+0000","last_peered":"2024-07-24T16:37:45.669435+0000","last_clean":"2024-07-24T16:37:45.669435+0000","last_became_active":"2024-07-24T16:37:04.004446+0000","last_became_peered":"2024-07-24T16:37:04.004446+0000","last_unstale":"2024-07-24T16:37:45.669435+0000","last_undegraded":"2024-07-24T16:37:45.669435+0000","last_fullsized":"2024-07-24T16:37:45.669435+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:33:56.086626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.665618+0000","last_change":"2024-07-24T16:37:02.997130+0000","last_active":"2024-07-24T16:37:45.665618+0000","last_peered":"2024-07-24T16:37:45.665618+0000","last_clean":"2024-07-24T16:37:45.665618+0000","last_became_active":"2024-07-24T16:37:02.996841+0000","last_became_peered":"2024-07-24T16:37:02.996841+0000","last_unstale":"2024-07-24T16:37:45.665618+0000","last_undegraded":"2024-07-24T16:37:45.665618+0000","last_fullsized":"2024-07-24T16:37:45.665618+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:27:02.167426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":18,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:45.667508+0000","last_change":"2024-07-24T16:37:04.005886+0000","last_active":"2024-07-24T16:37:45.667508+0000","last_peered":"2024-07-24T16:37:45.667508+0000","last_clean":"2024-07-24T16:37:45.667508+0000","last_became_active":"2024-07-24T16:37:04.005578+0000","last_became_peered":"2024-07-24T16:37:04.005578+0000","last_unstale":"2024-07-24T16:37:45.667508+0000","last_undegraded":"2024-07-24T16:37:45.667508+0000","last_fullsized":"2024-07-24T16:37:45.667508+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:02.976095+0000","last_clean_scrub_stamp":"2024-07-24T16:37:02.976095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:32:24.649601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"65'3","reported_seq":24,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:14.392822+0000","last_change":"2024-07-24T16:37:03.002115+0000","last_active":"2024-07-24T16:39:14.392822+0000","last_peered":"2024-07-24T16:39:14.392822+0000","last_clean":"2024-07-24T16:39:14.392822+0000","last_became_active":"2024-07-24T16:37:03.001758+0000","last_became_peered":"2024-07-24T16:37:03.001758+0000","last_unstale":"2024-07-24T16:39:14.392822+0000","last_undegraded":"2024-07-24T16:39:14.392822+0000","last_fullsized":"2024-07-24T16:39:14.392822+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:37:01.970117+0000","last_clean_scrub_stamp":"2024-07-24T16:37:01.970117+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"53'86","reported_seq":249,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:37:46.074704+0000","last_change":"2024-07-24T16:24:00.730616+0000","last_active":"2024-07-24T16:37:46.074704+0000","last_peered":"2024-07-24T16:37:46.074704+0000","last_clean":"2024-07-24T16:37:46.074704+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:37:46.074704+0000","last_undegraded":"2024-07-24T16:37:46.074704+0000","last_fullsized":"2024-07-24T16:37:46.074704+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:23:59.298275+0000","last_clean_scrub_stamp":"2024-07-24T16:23:59.298275+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:43:16.738682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":3794,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":86,"ondisk_log_size":86,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575033,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54732,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317108,"statfs":{"total":96636764160,"available":96580718592,"internally_reserved":0,"allocated":1380352,"data_stored":977699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575033,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":786432,"data_stored":387859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575033,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49988,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321852,"statfs":{"total":96636764160,"available":96585576448,"internally_reserved":0,"allocated":778240,"data_stored":387207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575034,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":387789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575034,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":794624,"data_stored":390225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575034,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54156,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317684,"statfs":{"total":96636764160,"available":96581308416,"internally_reserved":0,"allocated":790528,"data_stored":390203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575033,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":786432,"data_stored":387367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575034,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1380352,"data_stored":977631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:39:17.929 INFO:tasks.ceph:pgid 8.3f last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.929 INFO:tasks.ceph:pgid 8.3e last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.929 INFO:tasks.ceph:pgid 8.3d last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.929 INFO:tasks.ceph:pgid 8.3c last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.929 INFO:tasks.ceph:pgid 8.3b last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.930 INFO:tasks.ceph:pgid 8.3a last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.930 INFO:tasks.ceph:pgid 8.39 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.930 INFO:tasks.ceph:pgid 8.38 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.930 INFO:tasks.ceph:pgid 8.37 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.930 INFO:tasks.ceph:pgid 8.36 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.930 INFO:tasks.ceph:pgid 8.35 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.931 INFO:tasks.ceph:pgid 8.34 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.931 INFO:tasks.ceph:pgid 8.33 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.931 INFO:tasks.ceph:pgid 8.32 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.931 INFO:tasks.ceph:pgid 8.31 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.931 INFO:tasks.ceph:pgid 8.30 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.931 INFO:tasks.ceph:pgid 8.2f last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.932 INFO:tasks.ceph:pgid 8.2e last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.932 INFO:tasks.ceph:pgid 8.2d last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.932 INFO:tasks.ceph:pgid 8.2c last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.932 INFO:tasks.ceph:pgid 8.2b last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.932 INFO:tasks.ceph:pgid 8.2a last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.932 INFO:tasks.ceph:pgid 8.29 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.932 INFO:tasks.ceph:pgid 8.28 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.933 INFO:tasks.ceph:pgid 8.27 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.933 INFO:tasks.ceph:pgid 8.26 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.933 INFO:tasks.ceph:pgid 8.25 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.933 INFO:tasks.ceph:pgid 8.24 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.933 INFO:tasks.ceph:pgid 8.23 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.933 INFO:tasks.ceph:pgid 8.22 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.933 INFO:tasks.ceph:pgid 8.21 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.934 INFO:tasks.ceph:pgid 8.20 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.934 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.934 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.934 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.934 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.934 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.935 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.935 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.935 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.935 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.935 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.935 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.935 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.936 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.936 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.936 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.936 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.936 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.936 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.937 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.937 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.937 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.937 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.937 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.937 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.937 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.938 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.938 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.938 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.938 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.938 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.938 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.939 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.939 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.939 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.939 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.939 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.939 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.940 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.940 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.940 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.940 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.940 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.941 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.941 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.941 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.941 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.941 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.941 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.942 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.942 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.942 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.942 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.942 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.942 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.943 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.943 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.943 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.943 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.943 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.943 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-07-24T16:37:02.976095+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=2, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.944 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-07-24T16:37:01.970117+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=37, tm_sec=1, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.944 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-07-24T16:23:59.298275+0000 time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=23, tm_sec=59, tm_wday=2, tm_yday=206, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=7, tm_mday=24, tm_hour=16, tm_min=39, tm_sec=12, tm_wday=2, tm_yday=206, tm_isdst=0) 2024-07-24T16:39:17.944 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-07-24T16:39:37.945 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-07-24T16:39:38.060 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.058+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/2637575549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b98005080 msgr2=0x7f0b98005910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.058+0000 7f0bb5aa9640 1 --2- 172.21.15.159:0/2637575549 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0b98005080 0x7f0b98005910 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0ba400c260 tx=0x7f0b98006940 comp rx=0 tx=0).stop 2024-07-24T16:39:38.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.058+0000 7f0baffff640 1 -- 172.21.15.159:0/2637575549 reap_dead start 2024-07-24T16:39:38.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.058+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/2637575549 shutdown_connections 2024-07-24T16:39:38.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.058+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/2637575549 >> 172.21.15.159:0/2637575549 conn(0x7f0bb006c560 msgr2=0x7f0bb006c970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:38.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.058+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/2637575549 shutdown_connections 2024-07-24T16:39:38.061 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.058+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/2637575549 wait complete. 2024-07-24T16:39:38.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.059+0000 7f0bb5aa9640 1 Processor -- start 2024-07-24T16:39:38.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.059+0000 7f0bb5aa9640 1 -- start start 2024-07-24T16:39:38.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0bb5aa9640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b98005080 0x7f0bb0151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:38.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0bb5aa9640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bb01502a0 0x7f0bb0144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:38.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0bb5aa9640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bb0152dc0 0x7f0bb0153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:38.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0bb5aa9640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb0072110 con 0x7f0bb01502a0 2024-07-24T16:39:38.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0bb5aa9640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f0bb015b150 con 0x7f0bb0152dc0 2024-07-24T16:39:38.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0bb5aa9640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f0bb0072290 con 0x7f0b98005080 2024-07-24T16:39:38.064 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0baeffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bb01502a0 0x7f0bb0144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0baeffd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bb01502a0 0x7f0bb0144de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60174/0 (socket says 172.21.15.159:60174) 2024-07-24T16:39:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0baeffd640 1 -- 172.21.15.159:0/10041646 learned_addr learned my addr 172.21.15.159:0/10041646 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0baf7fe640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b98005080 0x7f0bb0151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0baffff640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bb0152dc0 0x7f0bb0153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0baeffd640 1 -- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b98005080 msgr2=0x7f0bb0151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0baeffd640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b98005080 0x7f0bb0151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0baeffd640 1 -- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bb0152dc0 msgr2=0x7f0bb0153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0baeffd640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bb0152dc0 0x7f0bb0153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.065 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0baeffd640 1 -- 172.21.15.159:0/10041646 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bb0145320 con 0x7f0bb01502a0 2024-07-24T16:39:38.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.060+0000 7f0baffff640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bb0152dc0 0x7f0bb0153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:39:38.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.061+0000 7f0baeffd640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bb01502a0 0x7f0bb0144de0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0ba402b0d0 tx=0x7f0ba4006cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:38.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.061+0000 7f0b97fff640 1 -- 172.21.15.159:0/10041646 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4031040 con 0x7f0bb01502a0 2024-07-24T16:39:38.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.061+0000 7f0b97fff640 1 -- 172.21.15.159:0/10041646 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0ba40035f0 con 0x7f0bb01502a0 2024-07-24T16:39:38.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.061+0000 7f0b97fff640 1 -- 172.21.15.159:0/10041646 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4003a40 con 0x7f0bb01502a0 2024-07-24T16:39:38.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.061+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/10041646 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bb0150070 con 0x7f0bb01502a0 2024-07-24T16:39:38.066 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.061+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/10041646 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bb0151c00 con 0x7f0bb01502a0 2024-07-24T16:39:38.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.062+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/10041646 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bb006db00 con 0x7f0bb01502a0 2024-07-24T16:39:38.067 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.062+0000 7f0b97fff640 1 -- 172.21.15.159:0/10041646 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f0ba4034070 con 0x7f0bb01502a0 2024-07-24T16:39:38.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.063+0000 7f0b97fff640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f0b9c077040 0x7f0b9c079500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:38.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.063+0000 7f0b97fff640 1 -- 172.21.15.159:0/10041646 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f0ba40b86e0 con 0x7f0bb01502a0 2024-07-24T16:39:38.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.063+0000 7f0baf7fe640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f0b9c077040 0x7f0b9c079500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:38.068 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.064+0000 7f0baf7fe640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f0b9c077040 0x7f0b9c079500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0005fd0 tx=0x7f0ba0009500 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:38.069 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.067+0000 7f0b97fff640 1 -- 172.21.15.159:0/10041646 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f0bb0145320 con 0x7f0bb01502a0 2024-07-24T16:39:38.249 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.246+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/10041646 --> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0bb00b0050 con 0x7f0b9c077040 2024-07-24T16:39:38.253 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.251+0000 7f0b97fff640 1 -- 172.21.15.159:0/10041646 <== mgr.5335 v2:172.21.15.193:6832/968221167 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251891 (secure 0 0 0) 0x7f0ba005e810 con 0x7f0b9c077040 2024-07-24T16:39:38.256 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:39:38.257 INFO:teuthology.orchestra.run.smithi159.stderr:dumped all 2024-07-24T16:39:38.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.254+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f0b9c077040 msgr2=0x7f0b9c079500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.254+0000 7f0bb5aa9640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f0b9c077040 0x7f0b9c079500 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0ba0005fd0 tx=0x7f0ba0009500 comp rx=0 tx=0).stop 2024-07-24T16:39:38.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.254+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/10041646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bb01502a0 msgr2=0x7f0bb0144de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.254+0000 7f0bb5aa9640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bb01502a0 0x7f0bb0144de0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0ba402b0d0 tx=0x7f0ba4006cc0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.254+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/10041646 shutdown_connections 2024-07-24T16:39:38.259 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.254+0000 7f0bb5aa9640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f0bb0152dc0 0x7f0bb0153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.254+0000 7f0bb5aa9640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f0b9c077040 0x7f0b9c079500 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.254+0000 7f0bb5aa9640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f0bb01502a0 0x7f0bb0144de0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.254+0000 7f0bb5aa9640 1 --2- 172.21.15.159:0/10041646 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f0b98005080 0x7f0bb0151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.254+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/10041646 >> 172.21.15.159:0/10041646 conn(0x7f0bb006c560 msgr2=0x7f0bb015b720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:38.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.254+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/10041646 shutdown_connections 2024-07-24T16:39:38.260 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.254+0000 7f0bb5aa9640 1 -- 172.21.15.159:0/10041646 wait complete. 2024-07-24T16:39:38.268 INFO:teuthology.orchestra.run.smithi159.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2024-07-24T16:39:36.580378+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":594162,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":178,"num_write_kb":1647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":319176,"kb_used_data":7304,"kb_used_omap":12,"kb_used_meta":311795,"kb_avail":754655544,"statfs":{"total":773094113280,"available":772767277056,"internally_reserved":0,"allocated":7479296,"data_stored":4285980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":319278641},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003056"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:23.981901+0000","last_change":"2024-07-24T16:39:23.981936+0000","last_active":"2024-07-24T16:39:23.981901+0000","last_peered":"2024-07-24T16:39:23.981901+0000","last_clean":"2024-07-24T16:39:23.981901+0000","last_became_active":"2024-07-24T16:37:04.000007+0000","last_became_peered":"2024-07-24T16:37:04.000007+0000","last_unstale":"2024-07-24T16:39:23.981901+0000","last_undegraded":"2024-07-24T16:39:23.981901+0000","last_fullsized":"2024-07-24T16:39:23.981901+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:23.981822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:23.981822+0000","last_clean_scrub_stamp":"2024-07-24T16:39:23.981822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:07:27.182192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:29.480819+0000","last_change":"2024-07-24T16:39:29.480867+0000","last_active":"2024-07-24T16:39:29.480819+0000","last_peered":"2024-07-24T16:39:29.480819+0000","last_clean":"2024-07-24T16:39:29.480819+0000","last_became_active":"2024-07-24T16:37:04.011627+0000","last_became_peered":"2024-07-24T16:37:04.011627+0000","last_unstale":"2024-07-24T16:39:29.480819+0000","last_undegraded":"2024-07-24T16:39:29.480819+0000","last_fullsized":"2024-07-24T16:39:29.480819+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:29.480711+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:29.480711+0000","last_clean_scrub_stamp":"2024-07-24T16:39:29.480711+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:26:26.648542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:33.863537+0000","last_change":"2024-07-24T16:39:33.863562+0000","last_active":"2024-07-24T16:39:33.863537+0000","last_peered":"2024-07-24T16:39:33.863537+0000","last_clean":"2024-07-24T16:39:33.863537+0000","last_became_active":"2024-07-24T16:37:04.014649+0000","last_became_peered":"2024-07-24T16:37:04.014649+0000","last_unstale":"2024-07-24T16:39:33.863537+0000","last_undegraded":"2024-07-24T16:39:33.863537+0000","last_fullsized":"2024-07-24T16:39:33.863537+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:33.863442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:33.863442+0000","last_clean_scrub_stamp":"2024-07-24T16:39:33.863442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:40:42.289488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:30.452846+0000","last_change":"2024-07-24T16:39:30.452896+0000","last_active":"2024-07-24T16:39:30.452846+0000","last_peered":"2024-07-24T16:39:30.452846+0000","last_clean":"2024-07-24T16:39:30.452846+0000","last_became_active":"2024-07-24T16:37:04.011002+0000","last_became_peered":"2024-07-24T16:37:04.011002+0000","last_unstale":"2024-07-24T16:39:30.452846+0000","last_undegraded":"2024-07-24T16:39:30.452846+0000","last_fullsized":"2024-07-24T16:39:30.452846+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:30.452731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:30.452731+0000","last_clean_scrub_stamp":"2024-07-24T16:39:30.452731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:38:11.448851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:22.513326+0000","last_change":"2024-07-24T16:39:22.513326+0000","last_active":"2024-07-24T16:39:22.513326+0000","last_peered":"2024-07-24T16:39:22.513326+0000","last_clean":"2024-07-24T16:39:22.513326+0000","last_became_active":"2024-07-24T16:37:04.004895+0000","last_became_peered":"2024-07-24T16:37:04.004895+0000","last_unstale":"2024-07-24T16:39:22.513326+0000","last_undegraded":"2024-07-24T16:39:22.513326+0000","last_fullsized":"2024-07-24T16:39:22.513326+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:22.513177+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:22.513177+0000","last_clean_scrub_stamp":"2024-07-24T16:39:22.513177+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:13:55.835881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:24.963878+0000","last_change":"2024-07-24T16:39:24.963878+0000","last_active":"2024-07-24T16:39:24.963878+0000","last_peered":"2024-07-24T16:39:24.963878+0000","last_clean":"2024-07-24T16:39:24.963878+0000","last_became_active":"2024-07-24T16:37:04.008866+0000","last_became_peered":"2024-07-24T16:37:04.008866+0000","last_unstale":"2024-07-24T16:39:24.963878+0000","last_undegraded":"2024-07-24T16:39:24.963878+0000","last_fullsized":"2024-07-24T16:39:24.963878+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:24.963741+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:24.963741+0000","last_clean_scrub_stamp":"2024-07-24T16:39:24.963741+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:32:45.329127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:34.836093+0000","last_change":"2024-07-24T16:39:34.836093+0000","last_active":"2024-07-24T16:39:34.836093+0000","last_peered":"2024-07-24T16:39:34.836093+0000","last_clean":"2024-07-24T16:39:34.836093+0000","last_became_active":"2024-07-24T16:37:04.019103+0000","last_became_peered":"2024-07-24T16:37:04.019103+0000","last_unstale":"2024-07-24T16:39:34.836093+0000","last_undegraded":"2024-07-24T16:39:34.836093+0000","last_fullsized":"2024-07-24T16:39:34.836093+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:34.835959+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:34.835959+0000","last_clean_scrub_stamp":"2024-07-24T16:39:34.835959+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:25:40.254106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":33,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:30.974724+0000","last_change":"2024-07-24T16:39:30.974724+0000","last_active":"2024-07-24T16:39:30.974724+0000","last_peered":"2024-07-24T16:39:30.974724+0000","last_clean":"2024-07-24T16:39:30.974724+0000","last_became_active":"2024-07-24T16:37:45.671060+0000","last_became_peered":"2024-07-24T16:37:45.671060+0000","last_unstale":"2024-07-24T16:39:30.974724+0000","last_undegraded":"2024-07-24T16:39:30.974724+0000","last_fullsized":"2024-07-24T16:39:30.974724+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:30.974616+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:30.974616+0000","last_clean_scrub_stamp":"2024-07-24T16:39:30.974616+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:22:28.050805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:29.978167+0000","last_change":"2024-07-24T16:39:29.978167+0000","last_active":"2024-07-24T16:39:29.978167+0000","last_peered":"2024-07-24T16:39:29.978167+0000","last_clean":"2024-07-24T16:39:29.978167+0000","last_became_active":"2024-07-24T16:37:04.023933+0000","last_became_peered":"2024-07-24T16:37:04.023933+0000","last_unstale":"2024-07-24T16:39:29.978167+0000","last_undegraded":"2024-07-24T16:39:29.978167+0000","last_fullsized":"2024-07-24T16:39:29.978167+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:29.978030+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:29.978030+0000","last_clean_scrub_stamp":"2024-07-24T16:39:29.978030+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:38:51.305507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:25.960213+0000","last_change":"2024-07-24T16:39:25.960213+0000","last_active":"2024-07-24T16:39:25.960213+0000","last_peered":"2024-07-24T16:39:25.960213+0000","last_clean":"2024-07-24T16:39:25.960213+0000","last_became_active":"2024-07-24T16:37:03.997985+0000","last_became_peered":"2024-07-24T16:37:03.997985+0000","last_unstale":"2024-07-24T16:39:25.960213+0000","last_undegraded":"2024-07-24T16:39:25.960213+0000","last_fullsized":"2024-07-24T16:39:25.960213+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:25.960113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:25.960113+0000","last_clean_scrub_stamp":"2024-07-24T16:39:25.960113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:42:59.384852+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:18.340315+0000","last_change":"2024-07-24T16:39:18.340315+0000","last_active":"2024-07-24T16:39:18.340315+0000","last_peered":"2024-07-24T16:39:18.340315+0000","last_clean":"2024-07-24T16:39:18.340315+0000","last_became_active":"2024-07-24T16:37:04.006298+0000","last_became_peered":"2024-07-24T16:37:04.006298+0000","last_unstale":"2024-07-24T16:39:18.340315+0000","last_undegraded":"2024-07-24T16:39:18.340315+0000","last_fullsized":"2024-07-24T16:39:18.340315+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:18.340222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:18.340222+0000","last_clean_scrub_stamp":"2024-07-24T16:39:18.340222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:03:54.066187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:28.992845+0000","last_change":"2024-07-24T16:39:28.992845+0000","last_active":"2024-07-24T16:39:28.992845+0000","last_peered":"2024-07-24T16:39:28.992845+0000","last_clean":"2024-07-24T16:39:28.992845+0000","last_became_active":"2024-07-24T16:37:04.005908+0000","last_became_peered":"2024-07-24T16:37:04.005908+0000","last_unstale":"2024-07-24T16:39:28.992845+0000","last_undegraded":"2024-07-24T16:39:28.992845+0000","last_fullsized":"2024-07-24T16:39:28.992845+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:28.992674+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:28.992674+0000","last_clean_scrub_stamp":"2024-07-24T16:39:28.992674+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:24:55.311360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:26.993920+0000","last_change":"2024-07-24T16:39:26.993920+0000","last_active":"2024-07-24T16:39:26.993920+0000","last_peered":"2024-07-24T16:39:26.993920+0000","last_clean":"2024-07-24T16:39:26.993920+0000","last_became_active":"2024-07-24T16:37:04.001872+0000","last_became_peered":"2024-07-24T16:37:04.001872+0000","last_unstale":"2024-07-24T16:39:26.993920+0000","last_undegraded":"2024-07-24T16:39:26.993920+0000","last_fullsized":"2024-07-24T16:39:26.993920+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:26.993811+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:26.993811+0000","last_clean_scrub_stamp":"2024-07-24T16:39:26.993811+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:25:27.824547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:29.768478+0000","last_change":"2024-07-24T16:39:29.768506+0000","last_active":"2024-07-24T16:39:29.768478+0000","last_peered":"2024-07-24T16:39:29.768478+0000","last_clean":"2024-07-24T16:39:29.768478+0000","last_became_active":"2024-07-24T16:37:04.018314+0000","last_became_peered":"2024-07-24T16:37:04.018314+0000","last_unstale":"2024-07-24T16:39:29.768478+0000","last_undegraded":"2024-07-24T16:39:29.768478+0000","last_fullsized":"2024-07-24T16:39:29.768478+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:29.768393+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:29.768393+0000","last_clean_scrub_stamp":"2024-07-24T16:39:29.768393+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:40:18.878399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:28.471274+0000","last_change":"2024-07-24T16:39:28.471301+0000","last_active":"2024-07-24T16:39:28.471274+0000","last_peered":"2024-07-24T16:39:28.471274+0000","last_clean":"2024-07-24T16:39:28.471274+0000","last_became_active":"2024-07-24T16:37:04.009473+0000","last_became_peered":"2024-07-24T16:37:04.009473+0000","last_unstale":"2024-07-24T16:39:28.471274+0000","last_undegraded":"2024-07-24T16:39:28.471274+0000","last_fullsized":"2024-07-24T16:39:28.471274+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:28.471183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:28.471183+0000","last_clean_scrub_stamp":"2024-07-24T16:39:28.471183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:22.455591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:22.981887+0000","last_change":"2024-07-24T16:39:22.981887+0000","last_active":"2024-07-24T16:39:22.981887+0000","last_peered":"2024-07-24T16:39:22.981887+0000","last_clean":"2024-07-24T16:39:22.981887+0000","last_became_active":"2024-07-24T16:37:04.001535+0000","last_became_peered":"2024-07-24T16:37:04.001535+0000","last_unstale":"2024-07-24T16:39:22.981887+0000","last_undegraded":"2024-07-24T16:39:22.981887+0000","last_fullsized":"2024-07-24T16:39:22.981887+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:22.981756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:22.981756+0000","last_clean_scrub_stamp":"2024-07-24T16:39:22.981756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:20:15.576150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":20,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:30.087996+0000","last_change":"2024-07-24T16:39:30.088021+0000","last_active":"2024-07-24T16:39:30.087996+0000","last_peered":"2024-07-24T16:39:30.087996+0000","last_clean":"2024-07-24T16:39:30.087996+0000","last_became_active":"2024-07-24T16:37:45.668460+0000","last_became_peered":"2024-07-24T16:37:45.668460+0000","last_unstale":"2024-07-24T16:39:30.087996+0000","last_undegraded":"2024-07-24T16:39:30.087996+0000","last_fullsized":"2024-07-24T16:39:30.087996+0000","mapping_epoch":64,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":65,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:30.087891+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:30.087891+0000","last_clean_scrub_stamp":"2024-07-24T16:39:30.087891+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:00:38.583757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:27.455039+0000","last_change":"2024-07-24T16:39:27.455084+0000","last_active":"2024-07-24T16:39:27.455039+0000","last_peered":"2024-07-24T16:39:27.455039+0000","last_clean":"2024-07-24T16:39:27.455039+0000","last_became_active":"2024-07-24T16:37:04.011166+0000","last_became_peered":"2024-07-24T16:37:04.011166+0000","last_unstale":"2024-07-24T16:39:27.455039+0000","last_undegraded":"2024-07-24T16:39:27.455039+0000","last_fullsized":"2024-07-24T16:39:27.455039+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:27.454949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:27.454949+0000","last_clean_scrub_stamp":"2024-07-24T16:39:27.454949+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:03:55.996183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:31.837890+0000","last_change":"2024-07-24T16:39:31.837917+0000","last_active":"2024-07-24T16:39:31.837890+0000","last_peered":"2024-07-24T16:39:31.837890+0000","last_clean":"2024-07-24T16:39:31.837890+0000","last_became_active":"2024-07-24T16:37:04.008030+0000","last_became_peered":"2024-07-24T16:37:04.008030+0000","last_unstale":"2024-07-24T16:39:31.837890+0000","last_undegraded":"2024-07-24T16:39:31.837890+0000","last_fullsized":"2024-07-24T16:39:31.837890+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:31.837804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:31.837804+0000","last_clean_scrub_stamp":"2024-07-24T16:39:31.837804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:26:29.005635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:26.000071+0000","last_change":"2024-07-24T16:39:26.000098+0000","last_active":"2024-07-24T16:39:26.000071+0000","last_peered":"2024-07-24T16:39:26.000071+0000","last_clean":"2024-07-24T16:39:26.000071+0000","last_became_active":"2024-07-24T16:37:04.007154+0000","last_became_peered":"2024-07-24T16:37:04.007154+0000","last_unstale":"2024-07-24T16:39:26.000071+0000","last_undegraded":"2024-07-24T16:39:26.000071+0000","last_fullsized":"2024-07-24T16:39:26.000071+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:25.999994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:25.999994+0000","last_clean_scrub_stamp":"2024-07-24T16:39:25.999994+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:25:19.566563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:29.073880+0000","last_change":"2024-07-24T16:39:29.073920+0000","last_active":"2024-07-24T16:39:29.073880+0000","last_peered":"2024-07-24T16:39:29.073880+0000","last_clean":"2024-07-24T16:39:29.073880+0000","last_became_active":"2024-07-24T16:37:04.006749+0000","last_became_peered":"2024-07-24T16:37:04.006749+0000","last_unstale":"2024-07-24T16:39:29.073880+0000","last_undegraded":"2024-07-24T16:39:29.073880+0000","last_fullsized":"2024-07-24T16:39:29.073880+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:29.073787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:29.073787+0000","last_clean_scrub_stamp":"2024-07-24T16:39:29.073787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:07:31.226118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:27.049863+0000","last_change":"2024-07-24T16:39:27.049903+0000","last_active":"2024-07-24T16:39:27.049863+0000","last_peered":"2024-07-24T16:39:27.049863+0000","last_clean":"2024-07-24T16:39:27.049863+0000","last_became_active":"2024-07-24T16:37:04.019931+0000","last_became_peered":"2024-07-24T16:37:04.019931+0000","last_unstale":"2024-07-24T16:39:27.049863+0000","last_undegraded":"2024-07-24T16:39:27.049863+0000","last_fullsized":"2024-07-24T16:39:27.049863+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:27.049751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:27.049751+0000","last_clean_scrub_stamp":"2024-07-24T16:39:27.049751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:22:13.200616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:17.335347+0000","last_change":"2024-07-24T16:39:17.335347+0000","last_active":"2024-07-24T16:39:17.335347+0000","last_peered":"2024-07-24T16:39:17.335347+0000","last_clean":"2024-07-24T16:39:17.335347+0000","last_became_active":"2024-07-24T16:37:04.003501+0000","last_became_peered":"2024-07-24T16:37:04.003501+0000","last_unstale":"2024-07-24T16:39:17.335347+0000","last_undegraded":"2024-07-24T16:39:17.335347+0000","last_fullsized":"2024-07-24T16:39:17.335347+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:17.335250+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:17.335250+0000","last_clean_scrub_stamp":"2024-07-24T16:39:17.335250+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:55:18.370712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:30.794683+0000","last_change":"2024-07-24T16:39:30.794708+0000","last_active":"2024-07-24T16:39:30.794683+0000","last_peered":"2024-07-24T16:39:30.794683+0000","last_clean":"2024-07-24T16:39:30.794683+0000","last_became_active":"2024-07-24T16:37:04.021397+0000","last_became_peered":"2024-07-24T16:37:04.021397+0000","last_unstale":"2024-07-24T16:39:30.794683+0000","last_undegraded":"2024-07-24T16:39:30.794683+0000","last_fullsized":"2024-07-24T16:39:30.794683+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:30.794591+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:30.794591+0000","last_clean_scrub_stamp":"2024-07-24T16:39:30.794591+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:52:24.778999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:32.820009+0000","last_change":"2024-07-24T16:39:32.820052+0000","last_active":"2024-07-24T16:39:32.820009+0000","last_peered":"2024-07-24T16:39:32.820009+0000","last_clean":"2024-07-24T16:39:32.820009+0000","last_became_active":"2024-07-24T16:37:04.021195+0000","last_became_peered":"2024-07-24T16:37:04.021195+0000","last_unstale":"2024-07-24T16:39:32.820009+0000","last_undegraded":"2024-07-24T16:39:32.820009+0000","last_fullsized":"2024-07-24T16:39:32.820009+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:32.819902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:32.819902+0000","last_clean_scrub_stamp":"2024-07-24T16:39:32.819902+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:38:13.816022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:28.005161+0000","last_change":"2024-07-24T16:39:28.005186+0000","last_active":"2024-07-24T16:39:28.005161+0000","last_peered":"2024-07-24T16:39:28.005161+0000","last_clean":"2024-07-24T16:39:28.005161+0000","last_became_active":"2024-07-24T16:37:04.004807+0000","last_became_peered":"2024-07-24T16:37:04.004807+0000","last_unstale":"2024-07-24T16:39:28.005161+0000","last_undegraded":"2024-07-24T16:39:28.005161+0000","last_fullsized":"2024-07-24T16:39:28.005161+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:28.005068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:28.005068+0000","last_clean_scrub_stamp":"2024-07-24T16:39:28.005068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:01:10.860151+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:21.964116+0000","last_change":"2024-07-24T16:39:21.964160+0000","last_active":"2024-07-24T16:39:21.964116+0000","last_peered":"2024-07-24T16:39:21.964116+0000","last_clean":"2024-07-24T16:39:21.964116+0000","last_became_active":"2024-07-24T16:37:04.015860+0000","last_became_peered":"2024-07-24T16:37:04.015860+0000","last_unstale":"2024-07-24T16:39:21.964116+0000","last_undegraded":"2024-07-24T16:39:21.964116+0000","last_fullsized":"2024-07-24T16:39:21.964116+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:21.963980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:21.963980+0000","last_clean_scrub_stamp":"2024-07-24T16:39:21.963980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:47:29.473960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:27.013155+0000","last_change":"2024-07-24T16:39:27.013216+0000","last_active":"2024-07-24T16:39:27.013155+0000","last_peered":"2024-07-24T16:39:27.013155+0000","last_clean":"2024-07-24T16:39:27.013155+0000","last_became_active":"2024-07-24T16:37:04.005597+0000","last_became_peered":"2024-07-24T16:37:04.005597+0000","last_unstale":"2024-07-24T16:39:27.013155+0000","last_undegraded":"2024-07-24T16:39:27.013155+0000","last_fullsized":"2024-07-24T16:39:27.013155+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:27.013055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:27.013055+0000","last_clean_scrub_stamp":"2024-07-24T16:39:27.013055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:11:29.982591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:28.817188+0000","last_change":"2024-07-24T16:39:28.817213+0000","last_active":"2024-07-24T16:39:28.817188+0000","last_peered":"2024-07-24T16:39:28.817188+0000","last_clean":"2024-07-24T16:39:28.817188+0000","last_became_active":"2024-07-24T16:37:04.015678+0000","last_became_peered":"2024-07-24T16:37:04.015678+0000","last_unstale":"2024-07-24T16:39:28.817188+0000","last_undegraded":"2024-07-24T16:39:28.817188+0000","last_fullsized":"2024-07-24T16:39:28.817188+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:28.817065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:28.817065+0000","last_clean_scrub_stamp":"2024-07-24T16:39:28.817065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:47:28.384114+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:25.403232+0000","last_change":"2024-07-24T16:39:25.403259+0000","last_active":"2024-07-24T16:39:25.403232+0000","last_peered":"2024-07-24T16:39:25.403232+0000","last_clean":"2024-07-24T16:39:25.403232+0000","last_became_active":"2024-07-24T16:37:04.014310+0000","last_became_peered":"2024-07-24T16:37:04.014310+0000","last_unstale":"2024-07-24T16:39:25.403232+0000","last_undegraded":"2024-07-24T16:39:25.403232+0000","last_fullsized":"2024-07-24T16:39:25.403232+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:25.403138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:25.403138+0000","last_clean_scrub_stamp":"2024-07-24T16:39:25.403138+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:38:58.681510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:27.842137+0000","last_change":"2024-07-24T16:39:27.842161+0000","last_active":"2024-07-24T16:39:27.842137+0000","last_peered":"2024-07-24T16:39:27.842137+0000","last_clean":"2024-07-24T16:39:27.842137+0000","last_became_active":"2024-07-24T16:37:04.007367+0000","last_became_peered":"2024-07-24T16:37:04.007367+0000","last_unstale":"2024-07-24T16:39:27.842137+0000","last_undegraded":"2024-07-24T16:39:27.842137+0000","last_fullsized":"2024-07-24T16:39:27.842137+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:27.842048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:27.842048+0000","last_clean_scrub_stamp":"2024-07-24T16:39:27.842048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:15:17.390096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:22.857184+0000","last_change":"2024-07-24T16:39:22.857209+0000","last_active":"2024-07-24T16:39:22.857184+0000","last_peered":"2024-07-24T16:39:22.857184+0000","last_clean":"2024-07-24T16:39:22.857184+0000","last_became_active":"2024-07-24T16:37:04.011439+0000","last_became_peered":"2024-07-24T16:37:04.011439+0000","last_unstale":"2024-07-24T16:39:22.857184+0000","last_undegraded":"2024-07-24T16:39:22.857184+0000","last_fullsized":"2024-07-24T16:39:22.857184+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:22.857088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:22.857088+0000","last_clean_scrub_stamp":"2024-07-24T16:39:22.857088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:15:12.405136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:23.433441+0000","last_change":"2024-07-24T16:39:23.433441+0000","last_active":"2024-07-24T16:39:23.433441+0000","last_peered":"2024-07-24T16:39:23.433441+0000","last_clean":"2024-07-24T16:39:23.433441+0000","last_became_active":"2024-07-24T16:37:04.008128+0000","last_became_peered":"2024-07-24T16:37:04.008128+0000","last_unstale":"2024-07-24T16:39:23.433441+0000","last_undegraded":"2024-07-24T16:39:23.433441+0000","last_fullsized":"2024-07-24T16:39:23.433441+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:23.433330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:23.433330+0000","last_clean_scrub_stamp":"2024-07-24T16:39:23.433330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:42:03.601171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"65'6","reported_seq":35,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:23.047379+0000","last_change":"2024-07-24T16:39:23.047411+0000","last_active":"2024-07-24T16:39:23.047379+0000","last_peered":"2024-07-24T16:39:23.047379+0000","last_clean":"2024-07-24T16:39:23.047379+0000","last_became_active":"2024-07-24T16:37:03.003212+0000","last_became_peered":"2024-07-24T16:37:03.003212+0000","last_unstale":"2024-07-24T16:39:23.047379+0000","last_undegraded":"2024-07-24T16:39:23.047379+0000","last_fullsized":"2024-07-24T16:39:23.047379+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'6","last_scrub_stamp":"2024-07-24T16:39:23.047286+0000","last_deep_scrub":"65'6","last_deep_scrub_stamp":"2024-07-24T16:39:23.047286+0000","last_clean_scrub_stamp":"2024-07-24T16:39:23.047286+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:35:03.386644+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:21.808393+0000","last_change":"2024-07-24T16:39:21.808393+0000","last_active":"2024-07-24T16:39:21.808393+0000","last_peered":"2024-07-24T16:39:21.808393+0000","last_clean":"2024-07-24T16:39:21.808393+0000","last_became_active":"2024-07-24T16:37:04.006833+0000","last_became_peered":"2024-07-24T16:37:04.006833+0000","last_unstale":"2024-07-24T16:39:21.808393+0000","last_undegraded":"2024-07-24T16:39:21.808393+0000","last_fullsized":"2024-07-24T16:39:21.808393+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:21.808260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:21.808260+0000","last_clean_scrub_stamp":"2024-07-24T16:39:21.808260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:17:00.280655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"62'1","reported_seq":30,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:20.992660+0000","last_change":"2024-07-24T16:39:20.992688+0000","last_active":"2024-07-24T16:39:20.992660+0000","last_peered":"2024-07-24T16:39:20.992660+0000","last_clean":"2024-07-24T16:39:20.992660+0000","last_became_active":"2024-07-24T16:37:03.008450+0000","last_became_peered":"2024-07-24T16:37:03.008450+0000","last_unstale":"2024-07-24T16:39:20.992660+0000","last_undegraded":"2024-07-24T16:39:20.992660+0000","last_fullsized":"2024-07-24T16:39:20.992660+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'1","last_scrub_stamp":"2024-07-24T16:39:20.992568+0000","last_deep_scrub":"62'1","last_deep_scrub_stamp":"2024-07-24T16:39:20.992568+0000","last_clean_scrub_stamp":"2024-07-24T16:39:20.992568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:13:54.315272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:28.059475+0000","last_change":"2024-07-24T16:39:28.059503+0000","last_active":"2024-07-24T16:39:28.059475+0000","last_peered":"2024-07-24T16:39:28.059475+0000","last_clean":"2024-07-24T16:39:28.059475+0000","last_became_active":"2024-07-24T16:37:04.009341+0000","last_became_peered":"2024-07-24T16:37:04.009341+0000","last_unstale":"2024-07-24T16:39:28.059475+0000","last_undegraded":"2024-07-24T16:39:28.059475+0000","last_fullsized":"2024-07-24T16:39:28.059475+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:28.059383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:28.059383+0000","last_clean_scrub_stamp":"2024-07-24T16:39:28.059383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:54:03.982636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"65'3","reported_seq":32,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:15.050942+0000","last_change":"2024-07-24T16:39:15.050942+0000","last_active":"2024-07-24T16:39:15.050942+0000","last_peered":"2024-07-24T16:39:15.050942+0000","last_clean":"2024-07-24T16:39:15.050942+0000","last_became_active":"2024-07-24T16:37:02.999177+0000","last_became_peered":"2024-07-24T16:37:02.999177+0000","last_unstale":"2024-07-24T16:39:15.050942+0000","last_undegraded":"2024-07-24T16:39:15.050942+0000","last_fullsized":"2024-07-24T16:39:15.050942+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'3","last_scrub_stamp":"2024-07-24T16:39:15.050826+0000","last_deep_scrub":"65'3","last_deep_scrub_stamp":"2024-07-24T16:39:15.050826+0000","last_clean_scrub_stamp":"2024-07-24T16:39:15.050826+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:25:08.617394+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:24.124441+0000","last_change":"2024-07-24T16:39:24.124441+0000","last_active":"2024-07-24T16:39:24.124441+0000","last_peered":"2024-07-24T16:39:24.124441+0000","last_clean":"2024-07-24T16:39:24.124441+0000","last_became_active":"2024-07-24T16:37:04.004752+0000","last_became_peered":"2024-07-24T16:37:04.004752+0000","last_unstale":"2024-07-24T16:39:24.124441+0000","last_undegraded":"2024-07-24T16:39:24.124441+0000","last_fullsized":"2024-07-24T16:39:24.124441+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:24.124328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:24.124328+0000","last_clean_scrub_stamp":"2024-07-24T16:39:24.124328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:43:05.351535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"65'3","reported_seq":32,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:17.749420+0000","last_change":"2024-07-24T16:39:17.749420+0000","last_active":"2024-07-24T16:39:17.749420+0000","last_peered":"2024-07-24T16:39:17.749420+0000","last_clean":"2024-07-24T16:39:17.749420+0000","last_became_active":"2024-07-24T16:37:03.013501+0000","last_became_peered":"2024-07-24T16:37:03.013501+0000","last_unstale":"2024-07-24T16:39:17.749420+0000","last_undegraded":"2024-07-24T16:39:17.749420+0000","last_fullsized":"2024-07-24T16:39:17.749420+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'3","last_scrub_stamp":"2024-07-24T16:39:17.749307+0000","last_deep_scrub":"65'3","last_deep_scrub_stamp":"2024-07-24T16:39:17.749307+0000","last_clean_scrub_stamp":"2024-07-24T16:39:17.749307+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:35:26.076189+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:18.636739+0000","last_change":"2024-07-24T16:39:18.636739+0000","last_active":"2024-07-24T16:39:18.636739+0000","last_peered":"2024-07-24T16:39:18.636739+0000","last_clean":"2024-07-24T16:39:18.636739+0000","last_became_active":"2024-07-24T16:37:04.008251+0000","last_became_peered":"2024-07-24T16:37:04.008251+0000","last_unstale":"2024-07-24T16:39:18.636739+0000","last_undegraded":"2024-07-24T16:39:18.636739+0000","last_fullsized":"2024-07-24T16:39:18.636739+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:18.636614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:18.636614+0000","last_clean_scrub_stamp":"2024-07-24T16:39:18.636614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:29:18.833922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"62'1","reported_seq":30,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:20.796462+0000","last_change":"2024-07-24T16:39:20.796462+0000","last_active":"2024-07-24T16:39:20.796462+0000","last_peered":"2024-07-24T16:39:20.796462+0000","last_clean":"2024-07-24T16:39:20.796462+0000","last_became_active":"2024-07-24T16:37:02.999733+0000","last_became_peered":"2024-07-24T16:37:02.999733+0000","last_unstale":"2024-07-24T16:39:20.796462+0000","last_undegraded":"2024-07-24T16:39:20.796462+0000","last_fullsized":"2024-07-24T16:39:20.796462+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'1","last_scrub_stamp":"2024-07-24T16:39:20.796291+0000","last_deep_scrub":"62'1","last_deep_scrub_stamp":"2024-07-24T16:39:20.796291+0000","last_clean_scrub_stamp":"2024-07-24T16:39:20.796291+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:43:43.310927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:26.428147+0000","last_change":"2024-07-24T16:39:26.428147+0000","last_active":"2024-07-24T16:39:26.428147+0000","last_peered":"2024-07-24T16:39:26.428147+0000","last_clean":"2024-07-24T16:39:26.428147+0000","last_became_active":"2024-07-24T16:37:04.008293+0000","last_became_peered":"2024-07-24T16:37:04.008293+0000","last_unstale":"2024-07-24T16:39:26.428147+0000","last_undegraded":"2024-07-24T16:39:26.428147+0000","last_fullsized":"2024-07-24T16:39:26.428147+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:26.428008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:26.428008+0000","last_clean_scrub_stamp":"2024-07-24T16:39:26.428008+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:47:25.995058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"62'1","reported_seq":30,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:19.608836+0000","last_change":"2024-07-24T16:39:19.608836+0000","last_active":"2024-07-24T16:39:19.608836+0000","last_peered":"2024-07-24T16:39:19.608836+0000","last_clean":"2024-07-24T16:39:19.608836+0000","last_became_active":"2024-07-24T16:37:03.005494+0000","last_became_peered":"2024-07-24T16:37:03.005494+0000","last_unstale":"2024-07-24T16:39:19.608836+0000","last_undegraded":"2024-07-24T16:39:19.608836+0000","last_fullsized":"2024-07-24T16:39:19.608836+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"62'1","last_scrub_stamp":"2024-07-24T16:39:19.608712+0000","last_deep_scrub":"62'1","last_deep_scrub_stamp":"2024-07-24T16:39:19.608712+0000","last_clean_scrub_stamp":"2024-07-24T16:39:19.608712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:11:22.578248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:25.088636+0000","last_change":"2024-07-24T16:39:25.088636+0000","last_active":"2024-07-24T16:39:25.088636+0000","last_peered":"2024-07-24T16:39:25.088636+0000","last_clean":"2024-07-24T16:39:25.088636+0000","last_became_active":"2024-07-24T16:37:04.001396+0000","last_became_peered":"2024-07-24T16:37:04.001396+0000","last_unstale":"2024-07-24T16:39:25.088636+0000","last_undegraded":"2024-07-24T16:39:25.088636+0000","last_fullsized":"2024-07-24T16:39:25.088636+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:25.088502+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:25.088502+0000","last_clean_scrub_stamp":"2024-07-24T16:39:25.088502+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:39:14.642590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:21.115245+0000","last_change":"2024-07-24T16:39:21.115245+0000","last_active":"2024-07-24T16:39:21.115245+0000","last_peered":"2024-07-24T16:39:21.115245+0000","last_clean":"2024-07-24T16:39:21.115245+0000","last_became_active":"2024-07-24T16:37:03.003689+0000","last_became_peered":"2024-07-24T16:37:03.003689+0000","last_unstale":"2024-07-24T16:39:21.115245+0000","last_undegraded":"2024-07-24T16:39:21.115245+0000","last_fullsized":"2024-07-24T16:39:21.115245+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:21.115112+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:21.115112+0000","last_clean_scrub_stamp":"2024-07-24T16:39:21.115112+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:20:19.893826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:22.429060+0000","last_change":"2024-07-24T16:39:22.429060+0000","last_active":"2024-07-24T16:39:22.429060+0000","last_peered":"2024-07-24T16:39:22.429060+0000","last_clean":"2024-07-24T16:39:22.429060+0000","last_became_active":"2024-07-24T16:37:04.024040+0000","last_became_peered":"2024-07-24T16:37:04.024040+0000","last_unstale":"2024-07-24T16:39:22.429060+0000","last_undegraded":"2024-07-24T16:39:22.429060+0000","last_fullsized":"2024-07-24T16:39:22.429060+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:22.428944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:22.428944+0000","last_clean_scrub_stamp":"2024-07-24T16:39:22.428944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:01:15.729938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:18.821985+0000","last_change":"2024-07-24T16:39:18.821985+0000","last_active":"2024-07-24T16:39:18.821985+0000","last_peered":"2024-07-24T16:39:18.821985+0000","last_clean":"2024-07-24T16:39:18.821985+0000","last_became_active":"2024-07-24T16:37:02.999554+0000","last_became_peered":"2024-07-24T16:37:02.999554+0000","last_unstale":"2024-07-24T16:39:18.821985+0000","last_undegraded":"2024-07-24T16:39:18.821985+0000","last_fullsized":"2024-07-24T16:39:18.821985+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:18.821887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:18.821887+0000","last_clean_scrub_stamp":"2024-07-24T16:39:18.821887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:44:38.138288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:20.559707+0000","last_change":"2024-07-24T16:39:20.559707+0000","last_active":"2024-07-24T16:39:20.559707+0000","last_peered":"2024-07-24T16:39:20.559707+0000","last_clean":"2024-07-24T16:39:20.559707+0000","last_became_active":"2024-07-24T16:37:04.012217+0000","last_became_peered":"2024-07-24T16:37:04.012217+0000","last_unstale":"2024-07-24T16:39:20.559707+0000","last_undegraded":"2024-07-24T16:39:20.559707+0000","last_fullsized":"2024-07-24T16:39:20.559707+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:20.559549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:20.559549+0000","last_clean_scrub_stamp":"2024-07-24T16:39:20.559549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:53:56.482802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:24.392577+0000","last_change":"2024-07-24T16:39:24.392577+0000","last_active":"2024-07-24T16:39:24.392577+0000","last_peered":"2024-07-24T16:39:24.392577+0000","last_clean":"2024-07-24T16:39:24.392577+0000","last_became_active":"2024-07-24T16:37:03.005232+0000","last_became_peered":"2024-07-24T16:37:03.005232+0000","last_unstale":"2024-07-24T16:39:24.392577+0000","last_undegraded":"2024-07-24T16:39:24.392577+0000","last_fullsized":"2024-07-24T16:39:24.392577+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:24.392466+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:24.392466+0000","last_clean_scrub_stamp":"2024-07-24T16:39:24.392466+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:17:02.864861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:24.945258+0000","last_change":"2024-07-24T16:39:24.945258+0000","last_active":"2024-07-24T16:39:24.945258+0000","last_peered":"2024-07-24T16:39:24.945258+0000","last_clean":"2024-07-24T16:39:24.945258+0000","last_became_active":"2024-07-24T16:37:03.994904+0000","last_became_peered":"2024-07-24T16:37:03.994904+0000","last_unstale":"2024-07-24T16:39:24.945258+0000","last_undegraded":"2024-07-24T16:39:24.945258+0000","last_fullsized":"2024-07-24T16:39:24.945258+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:24.945139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:24.945139+0000","last_clean_scrub_stamp":"2024-07-24T16:39:24.945139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:40:14.055146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:16.559648+0000","last_change":"2024-07-24T16:39:16.559648+0000","last_active":"2024-07-24T16:39:16.559648+0000","last_peered":"2024-07-24T16:39:16.559648+0000","last_clean":"2024-07-24T16:39:16.559648+0000","last_became_active":"2024-07-24T16:37:03.003813+0000","last_became_peered":"2024-07-24T16:37:03.003813+0000","last_unstale":"2024-07-24T16:39:16.559648+0000","last_undegraded":"2024-07-24T16:39:16.559648+0000","last_fullsized":"2024-07-24T16:39:16.559648+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:16.559475+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:16.559475+0000","last_clean_scrub_stamp":"2024-07-24T16:39:16.559475+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:13:15.721342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:24.816037+0000","last_change":"2024-07-24T16:39:24.816037+0000","last_active":"2024-07-24T16:39:24.816037+0000","last_peered":"2024-07-24T16:39:24.816037+0000","last_clean":"2024-07-24T16:39:24.816037+0000","last_became_active":"2024-07-24T16:37:04.015577+0000","last_became_peered":"2024-07-24T16:37:04.015577+0000","last_unstale":"2024-07-24T16:39:24.816037+0000","last_undegraded":"2024-07-24T16:39:24.816037+0000","last_fullsized":"2024-07-24T16:39:24.816037+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:24.815905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:24.815905+0000","last_clean_scrub_stamp":"2024-07-24T16:39:24.815905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:39:50.767638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"65'5","reported_seq":34,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:20.414438+0000","last_change":"2024-07-24T16:39:20.414438+0000","last_active":"2024-07-24T16:39:20.414438+0000","last_peered":"2024-07-24T16:39:20.414438+0000","last_clean":"2024-07-24T16:39:20.414438+0000","last_became_active":"2024-07-24T16:37:03.001970+0000","last_became_peered":"2024-07-24T16:37:03.001970+0000","last_unstale":"2024-07-24T16:39:20.414438+0000","last_undegraded":"2024-07-24T16:39:20.414438+0000","last_fullsized":"2024-07-24T16:39:20.414438+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'5","last_scrub_stamp":"2024-07-24T16:39:20.414277+0000","last_deep_scrub":"65'5","last_deep_scrub_stamp":"2024-07-24T16:39:20.414277+0000","last_clean_scrub_stamp":"2024-07-24T16:39:20.414277+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:23:25.716491+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:21.529439+0000","last_change":"2024-07-24T16:39:21.529439+0000","last_active":"2024-07-24T16:39:21.529439+0000","last_peered":"2024-07-24T16:39:21.529439+0000","last_clean":"2024-07-24T16:39:21.529439+0000","last_became_active":"2024-07-24T16:37:03.996235+0000","last_became_peered":"2024-07-24T16:37:03.996235+0000","last_unstale":"2024-07-24T16:39:21.529439+0000","last_undegraded":"2024-07-24T16:39:21.529439+0000","last_fullsized":"2024-07-24T16:39:21.529439+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:21.529300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:21.529300+0000","last_clean_scrub_stamp":"2024-07-24T16:39:21.529300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:32:48.670588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"65'12","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:21.107292+0000","last_change":"2024-07-24T16:39:21.107292+0000","last_active":"2024-07-24T16:39:21.107292+0000","last_peered":"2024-07-24T16:39:21.107292+0000","last_clean":"2024-07-24T16:39:21.107292+0000","last_became_active":"2024-07-24T16:37:03.007813+0000","last_became_peered":"2024-07-24T16:37:03.007813+0000","last_unstale":"2024-07-24T16:39:21.107292+0000","last_undegraded":"2024-07-24T16:39:21.107292+0000","last_fullsized":"2024-07-24T16:39:21.107292+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'12","last_scrub_stamp":"2024-07-24T16:39:21.107169+0000","last_deep_scrub":"65'12","last_deep_scrub_stamp":"2024-07-24T16:39:21.107169+0000","last_clean_scrub_stamp":"2024-07-24T16:39:21.107169+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:38:39.819740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2996,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:23.898490+0000","last_change":"2024-07-24T16:39:23.898490+0000","last_active":"2024-07-24T16:39:23.898490+0000","last_peered":"2024-07-24T16:39:23.898490+0000","last_clean":"2024-07-24T16:39:23.898490+0000","last_became_active":"2024-07-24T16:37:04.007559+0000","last_became_peered":"2024-07-24T16:37:04.007559+0000","last_unstale":"2024-07-24T16:39:23.898490+0000","last_undegraded":"2024-07-24T16:39:23.898490+0000","last_fullsized":"2024-07-24T16:39:23.898490+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:23.898370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:23.898370+0000","last_clean_scrub_stamp":"2024-07-24T16:39:23.898370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:47:23.465419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"65'4","reported_seq":33,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:19.820672+0000","last_change":"2024-07-24T16:39:19.820672+0000","last_active":"2024-07-24T16:39:19.820672+0000","last_peered":"2024-07-24T16:39:19.820672+0000","last_clean":"2024-07-24T16:39:19.820672+0000","last_became_active":"2024-07-24T16:37:03.003386+0000","last_became_peered":"2024-07-24T16:37:03.003386+0000","last_unstale":"2024-07-24T16:39:19.820672+0000","last_undegraded":"2024-07-24T16:39:19.820672+0000","last_fullsized":"2024-07-24T16:39:19.820672+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'4","last_scrub_stamp":"2024-07-24T16:39:19.820562+0000","last_deep_scrub":"65'4","last_deep_scrub_stamp":"2024-07-24T16:39:19.820562+0000","last_clean_scrub_stamp":"2024-07-24T16:39:19.820562+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:21:50.507478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:25.799855+0000","last_change":"2024-07-24T16:39:25.799855+0000","last_active":"2024-07-24T16:39:25.799855+0000","last_peered":"2024-07-24T16:39:25.799855+0000","last_clean":"2024-07-24T16:39:25.799855+0000","last_became_active":"2024-07-24T16:37:04.018826+0000","last_became_peered":"2024-07-24T16:37:04.018826+0000","last_unstale":"2024-07-24T16:39:25.799855+0000","last_undegraded":"2024-07-24T16:39:25.799855+0000","last_fullsized":"2024-07-24T16:39:25.799855+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:25.799751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:25.799751+0000","last_clean_scrub_stamp":"2024-07-24T16:39:25.799751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:42:05.967593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:22.083353+0000","last_change":"2024-07-24T16:39:22.083353+0000","last_active":"2024-07-24T16:39:22.083353+0000","last_peered":"2024-07-24T16:39:22.083353+0000","last_clean":"2024-07-24T16:39:22.083353+0000","last_became_active":"2024-07-24T16:37:03.003542+0000","last_became_peered":"2024-07-24T16:37:03.003542+0000","last_unstale":"2024-07-24T16:39:22.083353+0000","last_undegraded":"2024-07-24T16:39:22.083353+0000","last_fullsized":"2024-07-24T16:39:22.083353+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:22.083238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:22.083238+0000","last_clean_scrub_stamp":"2024-07-24T16:39:22.083238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:20:38.662045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:26.067690+0000","last_change":"2024-07-24T16:39:26.067734+0000","last_active":"2024-07-24T16:39:26.067690+0000","last_peered":"2024-07-24T16:39:26.067690+0000","last_clean":"2024-07-24T16:39:26.067690+0000","last_became_active":"2024-07-24T16:37:04.010791+0000","last_became_peered":"2024-07-24T16:37:04.010791+0000","last_unstale":"2024-07-24T16:39:26.067690+0000","last_undegraded":"2024-07-24T16:39:26.067690+0000","last_fullsized":"2024-07-24T16:39:26.067690+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:26.067583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:26.067583+0000","last_clean_scrub_stamp":"2024-07-24T16:39:26.067583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:42:16.468347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:19.420957+0000","last_change":"2024-07-24T16:39:19.420957+0000","last_active":"2024-07-24T16:39:19.420957+0000","last_peered":"2024-07-24T16:39:19.420957+0000","last_clean":"2024-07-24T16:39:19.420957+0000","last_became_active":"2024-07-24T16:37:03.010566+0000","last_became_peered":"2024-07-24T16:37:03.010566+0000","last_unstale":"2024-07-24T16:39:19.420957+0000","last_undegraded":"2024-07-24T16:39:19.420957+0000","last_fullsized":"2024-07-24T16:39:19.420957+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:19.420834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:19.420834+0000","last_clean_scrub_stamp":"2024-07-24T16:39:19.420834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:46:32.747477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:26.829026+0000","last_change":"2024-07-24T16:39:26.829070+0000","last_active":"2024-07-24T16:39:26.829026+0000","last_peered":"2024-07-24T16:39:26.829026+0000","last_clean":"2024-07-24T16:39:26.829026+0000","last_became_active":"2024-07-24T16:37:04.020968+0000","last_became_peered":"2024-07-24T16:37:04.020968+0000","last_unstale":"2024-07-24T16:39:26.829026+0000","last_undegraded":"2024-07-24T16:39:26.829026+0000","last_fullsized":"2024-07-24T16:39:26.829026+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:26.828909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:26.828909+0000","last_clean_scrub_stamp":"2024-07-24T16:39:26.828909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:17:05.301305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"65'12","reported_seq":41,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:19.144320+0000","last_change":"2024-07-24T16:39:19.144320+0000","last_active":"2024-07-24T16:39:19.144320+0000","last_peered":"2024-07-24T16:39:19.144320+0000","last_clean":"2024-07-24T16:39:19.144320+0000","last_became_active":"2024-07-24T16:37:03.005719+0000","last_became_peered":"2024-07-24T16:37:03.005719+0000","last_unstale":"2024-07-24T16:39:19.144320+0000","last_undegraded":"2024-07-24T16:39:19.144320+0000","last_fullsized":"2024-07-24T16:39:19.144320+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'12","last_scrub_stamp":"2024-07-24T16:39:19.144215+0000","last_deep_scrub":"65'12","last_deep_scrub_stamp":"2024-07-24T16:39:19.144215+0000","last_clean_scrub_stamp":"2024-07-24T16:39:19.144215+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:24:49.225712+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:20.109005+0000","last_change":"2024-07-24T16:39:20.109049+0000","last_active":"2024-07-24T16:39:20.109005+0000","last_peered":"2024-07-24T16:39:20.109005+0000","last_clean":"2024-07-24T16:39:20.109005+0000","last_became_active":"2024-07-24T16:37:04.004750+0000","last_became_peered":"2024-07-24T16:37:04.004750+0000","last_unstale":"2024-07-24T16:39:20.109005+0000","last_undegraded":"2024-07-24T16:39:20.109005+0000","last_fullsized":"2024-07-24T16:39:20.109005+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:20.108885+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:20.108885+0000","last_clean_scrub_stamp":"2024-07-24T16:39:20.108885+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T01:55:04.318886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"65'2","reported_seq":31,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:17.784810+0000","last_change":"2024-07-24T16:39:17.784810+0000","last_active":"2024-07-24T16:39:17.784810+0000","last_peered":"2024-07-24T16:39:17.784810+0000","last_clean":"2024-07-24T16:39:17.784810+0000","last_became_active":"2024-07-24T16:37:03.013485+0000","last_became_peered":"2024-07-24T16:37:03.013485+0000","last_unstale":"2024-07-24T16:39:17.784810+0000","last_undegraded":"2024-07-24T16:39:17.784810+0000","last_fullsized":"2024-07-24T16:39:17.784810+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'2","last_scrub_stamp":"2024-07-24T16:39:17.784723+0000","last_deep_scrub":"65'2","last_deep_scrub_stamp":"2024-07-24T16:39:17.784723+0000","last_clean_scrub_stamp":"2024-07-24T16:39:17.784723+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:33:11.065879+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:17.033791+0000","last_change":"2024-07-24T16:39:17.033813+0000","last_active":"2024-07-24T16:39:17.033791+0000","last_peered":"2024-07-24T16:39:17.033791+0000","last_clean":"2024-07-24T16:39:17.033791+0000","last_became_active":"2024-07-24T16:37:04.019539+0000","last_became_peered":"2024-07-24T16:37:04.019539+0000","last_unstale":"2024-07-24T16:39:17.033791+0000","last_undegraded":"2024-07-24T16:39:17.033791+0000","last_fullsized":"2024-07-24T16:39:17.033791+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:17.033726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:17.033726+0000","last_clean_scrub_stamp":"2024-07-24T16:39:17.033726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T02:33:55.928169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"65'3","reported_seq":32,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:16.384906+0000","last_change":"2024-07-24T16:39:16.384906+0000","last_active":"2024-07-24T16:39:16.384906+0000","last_peered":"2024-07-24T16:39:16.384906+0000","last_clean":"2024-07-24T16:39:16.384906+0000","last_became_active":"2024-07-24T16:37:02.998007+0000","last_became_peered":"2024-07-24T16:37:02.998007+0000","last_unstale":"2024-07-24T16:39:16.384906+0000","last_undegraded":"2024-07-24T16:39:16.384906+0000","last_fullsized":"2024-07-24T16:39:16.384906+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'3","last_scrub_stamp":"2024-07-24T16:39:16.384774+0000","last_deep_scrub":"65'3","last_deep_scrub_stamp":"2024-07-24T16:39:16.384774+0000","last_clean_scrub_stamp":"2024-07-24T16:39:16.384774+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:10:23.917102+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:23.511662+0000","last_change":"2024-07-24T16:39:23.511689+0000","last_active":"2024-07-24T16:39:23.511662+0000","last_peered":"2024-07-24T16:39:23.511662+0000","last_clean":"2024-07-24T16:39:23.511662+0000","last_became_active":"2024-07-24T16:37:04.022113+0000","last_became_peered":"2024-07-24T16:37:04.022113+0000","last_unstale":"2024-07-24T16:39:23.511662+0000","last_undegraded":"2024-07-24T16:39:23.511662+0000","last_fullsized":"2024-07-24T16:39:23.511662+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:23.511580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:23.511580+0000","last_clean_scrub_stamp":"2024-07-24T16:39:23.511580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:47:31.021559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"65'2","reported_seq":31,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:20.145212+0000","last_change":"2024-07-24T16:39:20.145212+0000","last_active":"2024-07-24T16:39:20.145212+0000","last_peered":"2024-07-24T16:39:20.145212+0000","last_clean":"2024-07-24T16:39:20.145212+0000","last_became_active":"2024-07-24T16:37:03.001003+0000","last_became_peered":"2024-07-24T16:37:03.001003+0000","last_unstale":"2024-07-24T16:39:20.145212+0000","last_undegraded":"2024-07-24T16:39:20.145212+0000","last_fullsized":"2024-07-24T16:39:20.145212+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'2","last_scrub_stamp":"2024-07-24T16:39:20.145108+0000","last_deep_scrub":"65'2","last_deep_scrub_stamp":"2024-07-24T16:39:20.145108+0000","last_clean_scrub_stamp":"2024-07-24T16:39:20.145108+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T19:00:44.567468+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:19.049729+0000","last_change":"2024-07-24T16:39:19.049753+0000","last_active":"2024-07-24T16:39:19.049729+0000","last_peered":"2024-07-24T16:39:19.049729+0000","last_clean":"2024-07-24T16:39:19.049729+0000","last_became_active":"2024-07-24T16:37:03.998825+0000","last_became_peered":"2024-07-24T16:37:03.998825+0000","last_unstale":"2024-07-24T16:39:19.049729+0000","last_undegraded":"2024-07-24T16:39:19.049729+0000","last_fullsized":"2024-07-24T16:39:19.049729+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:19.049626+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:19.049626+0000","last_clean_scrub_stamp":"2024-07-24T16:39:19.049626+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:32:46.190914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:19.096653+0000","last_change":"2024-07-24T16:39:19.096653+0000","last_active":"2024-07-24T16:39:19.096653+0000","last_peered":"2024-07-24T16:39:19.096653+0000","last_clean":"2024-07-24T16:39:19.096653+0000","last_became_active":"2024-07-24T16:37:03.013550+0000","last_became_peered":"2024-07-24T16:37:03.013550+0000","last_unstale":"2024-07-24T16:39:19.096653+0000","last_undegraded":"2024-07-24T16:39:19.096653+0000","last_fullsized":"2024-07-24T16:39:19.096653+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:19.096530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:19.096530+0000","last_clean_scrub_stamp":"2024-07-24T16:39:19.096530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:54:01.069238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:20.779806+0000","last_change":"2024-07-24T16:39:20.779832+0000","last_active":"2024-07-24T16:39:20.779806+0000","last_peered":"2024-07-24T16:39:20.779806+0000","last_clean":"2024-07-24T16:39:20.779806+0000","last_became_active":"2024-07-24T16:37:04.000074+0000","last_became_peered":"2024-07-24T16:37:04.000074+0000","last_unstale":"2024-07-24T16:39:20.779806+0000","last_undegraded":"2024-07-24T16:39:20.779806+0000","last_fullsized":"2024-07-24T16:39:20.779806+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:20.779708+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:20.779708+0000","last_clean_scrub_stamp":"2024-07-24T16:39:20.779708+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:42:00.947550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"65'3","reported_seq":32,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:16.064365+0000","last_change":"2024-07-24T16:39:16.064365+0000","last_active":"2024-07-24T16:39:16.064365+0000","last_peered":"2024-07-24T16:39:16.064365+0000","last_clean":"2024-07-24T16:39:16.064365+0000","last_became_active":"2024-07-24T16:37:02.995536+0000","last_became_peered":"2024-07-24T16:37:02.995536+0000","last_unstale":"2024-07-24T16:39:16.064365+0000","last_undegraded":"2024-07-24T16:39:16.064365+0000","last_fullsized":"2024-07-24T16:39:16.064365+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'3","last_scrub_stamp":"2024-07-24T16:39:16.064224+0000","last_deep_scrub":"65'3","last_deep_scrub_stamp":"2024-07-24T16:39:16.064224+0000","last_clean_scrub_stamp":"2024-07-24T16:39:16.064224+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:29:16.261533+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:25.046237+0000","last_change":"2024-07-24T16:39:25.046262+0000","last_active":"2024-07-24T16:39:25.046237+0000","last_peered":"2024-07-24T16:39:25.046237+0000","last_clean":"2024-07-24T16:39:25.046237+0000","last_became_active":"2024-07-24T16:37:04.004210+0000","last_became_peered":"2024-07-24T16:37:04.004210+0000","last_unstale":"2024-07-24T16:39:25.046237+0000","last_undegraded":"2024-07-24T16:39:25.046237+0000","last_fullsized":"2024-07-24T16:39:25.046237+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:25.046154+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:25.046154+0000","last_clean_scrub_stamp":"2024-07-24T16:39:25.046154+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:41:20.147729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:18.094444+0000","last_change":"2024-07-24T16:39:18.094481+0000","last_active":"2024-07-24T16:39:18.094444+0000","last_peered":"2024-07-24T16:39:18.094444+0000","last_clean":"2024-07-24T16:39:18.094444+0000","last_became_active":"2024-07-24T16:37:03.006461+0000","last_became_peered":"2024-07-24T16:37:03.006461+0000","last_unstale":"2024-07-24T16:39:18.094444+0000","last_undegraded":"2024-07-24T16:39:18.094444+0000","last_fullsized":"2024-07-24T16:39:18.094444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:18.094366+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:18.094366+0000","last_clean_scrub_stamp":"2024-07-24T16:39:18.094366+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:33:07.454037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:21.806470+0000","last_change":"2024-07-24T16:39:21.806495+0000","last_active":"2024-07-24T16:39:21.806470+0000","last_peered":"2024-07-24T16:39:21.806470+0000","last_clean":"2024-07-24T16:39:21.806470+0000","last_became_active":"2024-07-24T16:37:04.011301+0000","last_became_peered":"2024-07-24T16:37:04.011301+0000","last_unstale":"2024-07-24T16:39:21.806470+0000","last_undegraded":"2024-07-24T16:39:21.806470+0000","last_fullsized":"2024-07-24T16:39:21.806470+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:21.806374+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:21.806374+0000","last_clean_scrub_stamp":"2024-07-24T16:39:21.806374+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:23:27.108588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:16.796247+0000","last_change":"2024-07-24T16:39:16.796283+0000","last_active":"2024-07-24T16:39:16.796247+0000","last_peered":"2024-07-24T16:39:16.796247+0000","last_clean":"2024-07-24T16:39:16.796247+0000","last_became_active":"2024-07-24T16:37:02.999863+0000","last_became_peered":"2024-07-24T16:37:02.999863+0000","last_unstale":"2024-07-24T16:39:16.796247+0000","last_undegraded":"2024-07-24T16:39:16.796247+0000","last_fullsized":"2024-07-24T16:39:16.796247+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:16.796146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:16.796146+0000","last_clean_scrub_stamp":"2024-07-24T16:39:16.796146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:04:06.524667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:20.020606+0000","last_change":"2024-07-24T16:39:20.020634+0000","last_active":"2024-07-24T16:39:20.020606+0000","last_peered":"2024-07-24T16:39:20.020606+0000","last_clean":"2024-07-24T16:39:20.020606+0000","last_became_active":"2024-07-24T16:37:04.009453+0000","last_became_peered":"2024-07-24T16:37:04.009453+0000","last_unstale":"2024-07-24T16:39:20.020606+0000","last_undegraded":"2024-07-24T16:39:20.020606+0000","last_fullsized":"2024-07-24T16:39:20.020606+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:20.020521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:20.020521+0000","last_clean_scrub_stamp":"2024-07-24T16:39:20.020521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:07:22.172853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:15.427689+0000","last_change":"2024-07-24T16:39:15.427689+0000","last_active":"2024-07-24T16:39:15.427689+0000","last_peered":"2024-07-24T16:39:15.427689+0000","last_clean":"2024-07-24T16:39:15.427689+0000","last_became_active":"2024-07-24T16:37:03.000630+0000","last_became_peered":"2024-07-24T16:37:03.000630+0000","last_unstale":"2024-07-24T16:39:15.427689+0000","last_undegraded":"2024-07-24T16:39:15.427689+0000","last_fullsized":"2024-07-24T16:39:15.427689+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:15.427597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:15.427597+0000","last_clean_scrub_stamp":"2024-07-24T16:39:15.427597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T04:31:58.010677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:19.787287+0000","last_change":"2024-07-24T16:39:19.787313+0000","last_active":"2024-07-24T16:39:19.787287+0000","last_peered":"2024-07-24T16:39:19.787287+0000","last_clean":"2024-07-24T16:39:19.787287+0000","last_became_active":"2024-07-24T16:37:04.001124+0000","last_became_peered":"2024-07-24T16:37:04.001124+0000","last_unstale":"2024-07-24T16:39:19.787287+0000","last_undegraded":"2024-07-24T16:39:19.787287+0000","last_fullsized":"2024-07-24T16:39:19.787287+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:19.787187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:19.787187+0000","last_clean_scrub_stamp":"2024-07-24T16:39:19.787187+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:39:45.738921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"65'3","reported_seq":32,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:18.106213+0000","last_change":"2024-07-24T16:39:18.106243+0000","last_active":"2024-07-24T16:39:18.106213+0000","last_peered":"2024-07-24T16:39:18.106213+0000","last_clean":"2024-07-24T16:39:18.106213+0000","last_became_active":"2024-07-24T16:37:03.003387+0000","last_became_peered":"2024-07-24T16:37:03.003387+0000","last_unstale":"2024-07-24T16:39:18.106213+0000","last_undegraded":"2024-07-24T16:39:18.106213+0000","last_fullsized":"2024-07-24T16:39:18.106213+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'3","last_scrub_stamp":"2024-07-24T16:39:18.106133+0000","last_deep_scrub":"65'3","last_deep_scrub_stamp":"2024-07-24T16:39:18.106133+0000","last_clean_scrub_stamp":"2024-07-24T16:39:18.106133+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:29:32.900301+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:18.002337+0000","last_change":"2024-07-24T16:39:18.002358+0000","last_active":"2024-07-24T16:39:18.002337+0000","last_peered":"2024-07-24T16:39:18.002337+0000","last_clean":"2024-07-24T16:39:18.002337+0000","last_became_active":"2024-07-24T16:37:03.999841+0000","last_became_peered":"2024-07-24T16:37:03.999841+0000","last_unstale":"2024-07-24T16:39:18.002337+0000","last_undegraded":"2024-07-24T16:39:18.002337+0000","last_fullsized":"2024-07-24T16:39:18.002337+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:18.002263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:18.002263+0000","last_clean_scrub_stamp":"2024-07-24T16:39:18.002263+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:53:53.925517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:21.427133+0000","last_change":"2024-07-24T16:39:21.427157+0000","last_active":"2024-07-24T16:39:21.427133+0000","last_peered":"2024-07-24T16:39:21.427133+0000","last_clean":"2024-07-24T16:39:21.427133+0000","last_became_active":"2024-07-24T16:37:03.002819+0000","last_became_peered":"2024-07-24T16:37:03.002819+0000","last_unstale":"2024-07-24T16:39:21.427133+0000","last_undegraded":"2024-07-24T16:39:21.427133+0000","last_fullsized":"2024-07-24T16:39:21.427133+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:21.427029+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:21.427029+0000","last_clean_scrub_stamp":"2024-07-24T16:39:21.427029+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:35:29.753911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:22.095863+0000","last_change":"2024-07-24T16:39:22.095891+0000","last_active":"2024-07-24T16:39:22.095863+0000","last_peered":"2024-07-24T16:39:22.095863+0000","last_clean":"2024-07-24T16:39:22.095863+0000","last_became_active":"2024-07-24T16:37:04.007614+0000","last_became_peered":"2024-07-24T16:37:04.007614+0000","last_unstale":"2024-07-24T16:39:22.095863+0000","last_undegraded":"2024-07-24T16:39:22.095863+0000","last_fullsized":"2024-07-24T16:39:22.095863+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:22.095769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:22.095769+0000","last_clean_scrub_stamp":"2024-07-24T16:39:22.095769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T21:30:11.493667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:14.741236+0000","last_change":"2024-07-24T16:39:14.741258+0000","last_active":"2024-07-24T16:39:14.741236+0000","last_peered":"2024-07-24T16:39:14.741236+0000","last_clean":"2024-07-24T16:39:14.741236+0000","last_became_active":"2024-07-24T16:37:03.002219+0000","last_became_peered":"2024-07-24T16:37:03.002219+0000","last_unstale":"2024-07-24T16:39:14.741236+0000","last_undegraded":"2024-07-24T16:39:14.741236+0000","last_fullsized":"2024-07-24T16:39:14.741236+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:14.741148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:14.741148+0000","last_clean_scrub_stamp":"2024-07-24T16:39:14.741148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:55:15.727581+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:22.797966+0000","last_change":"2024-07-24T16:39:22.798020+0000","last_active":"2024-07-24T16:39:22.797966+0000","last_peered":"2024-07-24T16:39:22.797966+0000","last_clean":"2024-07-24T16:39:22.797966+0000","last_became_active":"2024-07-24T16:37:04.021059+0000","last_became_peered":"2024-07-24T16:37:04.021059+0000","last_unstale":"2024-07-24T16:39:22.797966+0000","last_undegraded":"2024-07-24T16:39:22.797966+0000","last_fullsized":"2024-07-24T16:39:22.797966+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:22.797861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:22.797861+0000","last_clean_scrub_stamp":"2024-07-24T16:39:22.797861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:35:31.124743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:17.140444+0000","last_change":"2024-07-24T16:39:17.140467+0000","last_active":"2024-07-24T16:39:17.140444+0000","last_peered":"2024-07-24T16:39:17.140444+0000","last_clean":"2024-07-24T16:39:17.140444+0000","last_became_active":"2024-07-24T16:37:03.009216+0000","last_became_peered":"2024-07-24T16:37:03.009216+0000","last_unstale":"2024-07-24T16:39:17.140444+0000","last_undegraded":"2024-07-24T16:39:17.140444+0000","last_fullsized":"2024-07-24T16:39:17.140444+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:17.140375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:17.140375+0000","last_clean_scrub_stamp":"2024-07-24T16:39:17.140375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T18:58:10.249334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:18.738748+0000","last_change":"2024-07-24T16:39:18.738748+0000","last_active":"2024-07-24T16:39:18.738748+0000","last_peered":"2024-07-24T16:39:18.738748+0000","last_clean":"2024-07-24T16:39:18.738748+0000","last_became_active":"2024-07-24T16:37:04.007096+0000","last_became_peered":"2024-07-24T16:37:04.007096+0000","last_unstale":"2024-07-24T16:39:18.738748+0000","last_undegraded":"2024-07-24T16:39:18.738748+0000","last_fullsized":"2024-07-24T16:39:18.738748+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:18.738594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:18.738594+0000","last_clean_scrub_stamp":"2024-07-24T16:39:18.738594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:44:06.414837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:16.119872+0000","last_change":"2024-07-24T16:39:16.119901+0000","last_active":"2024-07-24T16:39:16.119872+0000","last_peered":"2024-07-24T16:39:16.119872+0000","last_clean":"2024-07-24T16:39:16.119872+0000","last_became_active":"2024-07-24T16:37:03.008025+0000","last_became_peered":"2024-07-24T16:37:03.008025+0000","last_unstale":"2024-07-24T16:39:16.119872+0000","last_undegraded":"2024-07-24T16:39:16.119872+0000","last_fullsized":"2024-07-24T16:39:16.119872+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:16.119801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:16.119801+0000","last_clean_scrub_stamp":"2024-07-24T16:39:16.119801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:17:04.493020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:23.823662+0000","last_change":"2024-07-24T16:39:23.823686+0000","last_active":"2024-07-24T16:39:23.823662+0000","last_peered":"2024-07-24T16:39:23.823662+0000","last_clean":"2024-07-24T16:39:23.823662+0000","last_became_active":"2024-07-24T16:37:04.017748+0000","last_became_peered":"2024-07-24T16:37:04.017748+0000","last_unstale":"2024-07-24T16:39:23.823662+0000","last_undegraded":"2024-07-24T16:39:23.823662+0000","last_fullsized":"2024-07-24T16:39:23.823662+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:23.823582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:23.823582+0000","last_clean_scrub_stamp":"2024-07-24T16:39:23.823582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T03:44:11.499824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:17.607848+0000","last_change":"2024-07-24T16:39:17.607874+0000","last_active":"2024-07-24T16:39:17.607848+0000","last_peered":"2024-07-24T16:39:17.607848+0000","last_clean":"2024-07-24T16:39:17.607848+0000","last_became_active":"2024-07-24T16:37:03.008010+0000","last_became_peered":"2024-07-24T16:37:03.008010+0000","last_unstale":"2024-07-24T16:39:17.607848+0000","last_undegraded":"2024-07-24T16:39:17.607848+0000","last_fullsized":"2024-07-24T16:39:17.607848+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:17.607761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:17.607761+0000","last_clean_scrub_stamp":"2024-07-24T16:39:17.607761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T23:25:11.174329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:23.142788+0000","last_change":"2024-07-24T16:39:23.142813+0000","last_active":"2024-07-24T16:39:23.142788+0000","last_peered":"2024-07-24T16:39:23.142788+0000","last_clean":"2024-07-24T16:39:23.142788+0000","last_became_active":"2024-07-24T16:37:04.004446+0000","last_became_peered":"2024-07-24T16:37:04.004446+0000","last_unstale":"2024-07-24T16:39:23.142788+0000","last_undegraded":"2024-07-24T16:39:23.142788+0000","last_fullsized":"2024-07-24T16:39:23.142788+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:23.142700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:23.142700+0000","last_clean_scrub_stamp":"2024-07-24T16:39:23.142700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T17:37:38.039597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":29,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:16.738982+0000","last_change":"2024-07-24T16:39:16.739003+0000","last_active":"2024-07-24T16:39:16.738982+0000","last_peered":"2024-07-24T16:39:16.738982+0000","last_clean":"2024-07-24T16:39:16.738982+0000","last_became_active":"2024-07-24T16:37:02.996841+0000","last_became_peered":"2024-07-24T16:37:02.996841+0000","last_unstale":"2024-07-24T16:39:16.738982+0000","last_undegraded":"2024-07-24T16:39:16.738982+0000","last_fullsized":"2024-07-24T16:39:16.738982+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:16.738899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:16.738899+0000","last_clean_scrub_stamp":"2024-07-24T16:39:16.738899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T20:23:22.041113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":27,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:24.025649+0000","last_change":"2024-07-24T16:39:24.025676+0000","last_active":"2024-07-24T16:39:24.025649+0000","last_peered":"2024-07-24T16:39:24.025649+0000","last_clean":"2024-07-24T16:39:24.025649+0000","last_became_active":"2024-07-24T16:37:04.005578+0000","last_became_peered":"2024-07-24T16:37:04.005578+0000","last_unstale":"2024-07-24T16:39:24.025649+0000","last_undegraded":"2024-07-24T16:39:24.025649+0000","last_fullsized":"2024-07-24T16:39:24.025649+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-07-24T16:39:24.025561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-07-24T16:39:24.025561+0000","last_clean_scrub_stamp":"2024-07-24T16:39:24.025561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T16:54:10.059802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"65'3","reported_seq":32,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:15.754220+0000","last_change":"2024-07-24T16:39:15.754263+0000","last_active":"2024-07-24T16:39:15.754220+0000","last_peered":"2024-07-24T16:39:15.754220+0000","last_clean":"2024-07-24T16:39:15.754220+0000","last_became_active":"2024-07-24T16:37:03.001758+0000","last_became_peered":"2024-07-24T16:37:03.001758+0000","last_unstale":"2024-07-24T16:39:15.754220+0000","last_undegraded":"2024-07-24T16:39:15.754220+0000","last_fullsized":"2024-07-24T16:39:15.754220+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'3","last_scrub_stamp":"2024-07-24T16:39:15.754119+0000","last_deep_scrub":"65'3","last_deep_scrub_stamp":"2024-07-24T16:39:15.754119+0000","last_clean_scrub_stamp":"2024-07-24T16:39:15.754119+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-25T22:25:48.076574+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"65'88","reported_seq":260,"reported_epoch":65,"state":"active+clean","last_fresh":"2024-07-24T16:39:18.409949+0000","last_change":"2024-07-24T16:39:18.409985+0000","last_active":"2024-07-24T16:39:18.409949+0000","last_peered":"2024-07-24T16:39:18.409949+0000","last_clean":"2024-07-24T16:39:18.409949+0000","last_became_active":"2024-07-24T16:24:00.727949+0000","last_became_peered":"2024-07-24T16:24:00.727949+0000","last_unstale":"2024-07-24T16:39:18.409949+0000","last_undegraded":"2024-07-24T16:39:18.409949+0000","last_fullsized":"2024-07-24T16:39:18.409949+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"65'88","last_scrub_stamp":"2024-07-24T16:39:18.409842+0000","last_deep_scrub":"65'88","last_deep_scrub_stamp":"2024-07-24T16:39:18.409842+0000","last_clean_scrub_stamp":"2024-07-24T16:39:18.409842+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-07-26T00:43:40.924478+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":3794,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":53,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":7588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":64,"ondisk_log_size":64,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":186,"num_read_kb":407,"num_write":125,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":88,"ondisk_log_size":88,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575037,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54732,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317108,"statfs":{"total":96636764160,"available":96580718592,"internally_reserved":0,"allocated":1380352,"data_stored":977699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":54655434},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575037,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":786432,"data_stored":387859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575037,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49984,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94321856,"statfs":{"total":96636764160,"available":96585580544,"internally_reserved":0,"allocated":778240,"data_stored":387207,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":50395589},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575038,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":782336,"data_stored":387789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575038,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31952,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339888,"statfs":{"total":96636764160,"available":96604045312,"internally_reserved":0,"allocated":794624,"data_stored":390225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575038,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":54156,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94317684,"statfs":{"total":96636764160,"available":96581308416,"internally_reserved":0,"allocated":790528,"data_stored":390203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":54655429},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31944,"kb_used_data":768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339896,"statfs":{"total":96636764160,"available":96604053504,"internally_reserved":0,"allocated":786432,"data_stored":387367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575038,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1380352,"data_stored":977631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-07-24T16:39:38.274 DEBUG:teuthology.orchestra.run.smithi159:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-07-24T16:39:38.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.409+0000 7fbc65932640 1 -- 172.21.15.159:0/1506647748 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbc6015d950 msgr2=0x7fbc60161f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.409+0000 7fbc65932640 1 --2- 172.21.15.159:0/1506647748 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbc6015d950 0x7fbc60161f20 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009860 tx=0x7fbc5002a5c0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.409+0000 7fbc65932640 1 -- 172.21.15.159:0/1506647748 shutdown_connections 2024-07-24T16:39:38.412 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.409+0000 7fbc65932640 1 --2- 172.21.15.159:0/1506647748 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbc6015d950 0x7fbc60161f20 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.409+0000 7fbc65932640 1 -- 172.21.15.159:0/1506647748 >> 172.21.15.159:0/1506647748 conn(0x7fbc6009cd30 msgr2=0x7fbc600d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:38.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.409+0000 7fbc65932640 1 -- 172.21.15.159:0/1506647748 shutdown_connections 2024-07-24T16:39:38.413 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.409+0000 7fbc65932640 1 -- 172.21.15.159:0/1506647748 wait complete. 2024-07-24T16:39:38.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.410+0000 7fbc65932640 1 Processor -- start 2024-07-24T16:39:38.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.410+0000 7fbc65932640 1 -- start start 2024-07-24T16:39:38.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc65932640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbc600b2ae0 0x7fbc6015ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:38.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc65932640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc600cf770 0x7fbc6015b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:38.415 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc65932640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc6015d950 0x7fbc600b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:38.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc65932640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7fbc600d0b70 con 0x7fbc6015d950 2024-07-24T16:39:38.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc65932640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7fbc600d09f0 con 0x7fbc600cf770 2024-07-24T16:39:38.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc65932640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7fbc600cfc20 con 0x7fbc600b2ae0 2024-07-24T16:39:38.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc5f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc6015d950 0x7fbc600b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:38.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc5f7fe640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc6015d950 0x7fbc600b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60184/0 (socket says 172.21.15.159:60184) 2024-07-24T16:39:38.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc5f7fe640 1 -- 172.21.15.159:0/3855045101 learned_addr learned my addr 172.21.15.159:0/3855045101 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:38.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc5effd640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbc600b2ae0 0x7fbc6015ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:38.416 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc57fff640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc600cf770 0x7fbc6015b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:38.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc5f7fe640 1 -- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbc600b2ae0 msgr2=0x7fbc6015ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc5f7fe640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbc600b2ae0 0x7fbc6015ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc5f7fe640 1 -- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc600cf770 msgr2=0x7fbc6015b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc5f7fe640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc600cf770 0x7fbc6015b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc5f7fe640 1 -- 172.21.15.159:0/3855045101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc601f4470 con 0x7fbc6015d950 2024-07-24T16:39:38.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.411+0000 7fbc57fff640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc600cf770 0x7fbc6015b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-07-24T16:39:38.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.412+0000 7fbc5f7fe640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc6015d950 0x7fbc600b3b40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800c780 tx=0x7fbc5800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:38.417 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.412+0000 7fbc5cff9640 1 -- 172.21.15.159:0/3855045101 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc58003b70 con 0x7fbc6015d950 2024-07-24T16:39:38.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.412+0000 7fbc5cff9640 1 -- 172.21.15.159:0/3855045101 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc58003d10 con 0x7fbc6015d950 2024-07-24T16:39:38.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.412+0000 7fbc65932640 1 -- 172.21.15.159:0/3855045101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc601f5670 con 0x7fbc6015d950 2024-07-24T16:39:38.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.412+0000 7fbc5cff9640 1 -- 172.21.15.159:0/3855045101 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800aab0 con 0x7fbc6015d950 2024-07-24T16:39:38.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.412+0000 7fbc65932640 1 -- 172.21.15.159:0/3855045101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc600b93d0 con 0x7fbc6015d950 2024-07-24T16:39:38.418 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.413+0000 7fbc65932640 1 -- 172.21.15.159:0/3855045101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc60161f20 con 0x7fbc6015d950 2024-07-24T16:39:38.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.413+0000 7fbc5cff9640 1 -- 172.21.15.159:0/3855045101 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7fbc5800ac50 con 0x7fbc6015d950 2024-07-24T16:39:38.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.414+0000 7fbc5cff9640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fbc40077010 0x7fbc400794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:38.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.414+0000 7fbc5cff9640 1 -- 172.21.15.159:0/3855045101 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7fbc58098a00 con 0x7fbc6015d950 2024-07-24T16:39:38.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.414+0000 7fbc5effd640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fbc40077010 0x7fbc400794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:38.419 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.415+0000 7fbc5effd640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fbc40077010 0x7fbc400794d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbc50034000 tx=0x7fbc50004730 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:38.420 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.418+0000 7fbc5cff9640 1 -- 172.21.15.159:0/3855045101 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7fbc58061a30 con 0x7fbc6015d950 2024-07-24T16:39:38.603 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.600+0000 7fbc65932640 1 -- 172.21.15.159:0/3855045101 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fbc600cdda0 con 0x7fbc6015d950 2024-07-24T16:39:38.606 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.604+0000 7fbc5cff9640 1 -- 172.21.15.159:0/3855045101 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v33)=0 v33) ==== 123+0+0 (secure 0 0 0) 0x7fbc58061330 con 0x7fbc6015d950 2024-07-24T16:39:38.607 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.605+0000 7fbc5cff9640 1 -- 172.21.15.159:0/3855045101 <== mon.0 v2:172.21.15.159:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7fbc58060e40 con 0x7fbc6015d950 2024-07-24T16:39:38.609 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.606+0000 7fbc65932640 1 -- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fbc40077010 msgr2=0x7fbc400794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.606+0000 7fbc65932640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fbc40077010 0x7fbc400794d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbc50034000 tx=0x7fbc50004730 comp rx=0 tx=0).stop 2024-07-24T16:39:38.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.606+0000 7fbc65932640 1 -- 172.21.15.159:0/3855045101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc6015d950 msgr2=0x7fbc600b3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.606+0000 7fbc65932640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc6015d950 0x7fbc600b3b40 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800c780 tx=0x7fbc5800cc40 comp rx=0 tx=0).stop 2024-07-24T16:39:38.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.607+0000 7fbc65932640 1 -- 172.21.15.159:0/3855045101 shutdown_connections 2024-07-24T16:39:38.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.607+0000 7fbc65932640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7fbc40077010 0x7fbc400794d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.607+0000 7fbc65932640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7fbc6015d950 0x7fbc600b3b40 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.607+0000 7fbc65932640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7fbc600cf770 0x7fbc6015b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.610 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.607+0000 7fbc65932640 1 --2- 172.21.15.159:0/3855045101 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7fbc600b2ae0 0x7fbc6015ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.607+0000 7fbc65932640 1 -- 172.21.15.159:0/3855045101 >> 172.21.15.159:0/3855045101 conn(0x7fbc6009cd30 msgr2=0x7fbc600b69e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:38.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.607+0000 7fbc65932640 1 -- 172.21.15.159:0/3855045101 shutdown_connections 2024-07-24T16:39:38.611 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.607+0000 7fbc65932640 1 -- 172.21.15.159:0/3855045101 wait complete. 2024-07-24T16:39:38.620 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-07-24T16:39:38.620 DEBUG:teuthology.orchestra.run.smithi159:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-07-24T16:39:38.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.721+0000 7f4830160640 1 -- 172.21.15.159:0/3860935111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48100039e0 msgr2=0x7f4810003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.721+0000 7f4830160640 1 --2- 172.21.15.159:0/3860935111 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48100039e0 0x7f4810003dc0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f481800c610 tx=0x7f4810005830 comp rx=0 tx=0).stop 2024-07-24T16:39:38.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.721+0000 7f482e6fd640 1 -- 172.21.15.159:0/3860935111 reap_dead start 2024-07-24T16:39:38.724 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.721+0000 7f4830160640 1 -- 172.21.15.159:0/3860935111 shutdown_connections 2024-07-24T16:39:38.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.721+0000 7f4830160640 1 -- 172.21.15.159:0/3860935111 >> 172.21.15.159:0/3860935111 conn(0x7f482809cd30 msgr2=0x7f48280d3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:38.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.721+0000 7f4830160640 1 -- 172.21.15.159:0/3860935111 shutdown_connections 2024-07-24T16:39:38.725 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.721+0000 7f4830160640 1 -- 172.21.15.159:0/3860935111 wait complete. 2024-07-24T16:39:38.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.722+0000 7f4830160640 1 Processor -- start 2024-07-24T16:39:38.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.722+0000 7f4830160640 1 -- start start 2024-07-24T16:39:38.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f4830160640 1 --2- >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48100039e0 0x7f482815be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:38.727 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f4830160640 1 --2- >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48281604c0 0x7f48280b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:38.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f4830160640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48280cab60 0x7f48281f4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:38.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f4830160640 1 -- --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_getmap magic: 0 -- 0x7f48280ce490 con 0x7f48280cab60 2024-07-24T16:39:38.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f4830160640 1 -- --> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] -- mon_getmap magic: 0 -- 0x7f48280d0c00 con 0x7f48100039e0 2024-07-24T16:39:38.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f4830160640 1 -- --> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] -- mon_getmap magic: 0 -- 0x7f4828161f20 con 0x7f48281604c0 2024-07-24T16:39:38.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f482e6fd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48280cab60 0x7f48281f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:38.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f482e6fd640 1 --2- >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48280cab60 0x7f48281f4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.159:3300/0 says I am v2:172.21.15.159:60204/0 (socket says 172.21.15.159:60204) 2024-07-24T16:39:38.728 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f482e6fd640 1 -- 172.21.15.159:0/1071272420 learned_addr learned my addr 172.21.15.159:0/1071272420 (peer_addr_for_me v2:172.21.15.159:0/0) 2024-07-24T16:39:38.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f482d6fb640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48281604c0 0x7f48280b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:38.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f482defc640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48100039e0 0x7f482815be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:38.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f482e6fd640 1 -- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48281604c0 msgr2=0x7f48280b5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f482e6fd640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48281604c0 0x7f48280b5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f482e6fd640 1 -- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48100039e0 msgr2=0x7f482815be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f482e6fd640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48100039e0 0x7f482815be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f482e6fd640 1 -- 172.21.15.159:0/1071272420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48281611f0 con 0x7f48280cab60 2024-07-24T16:39:38.729 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f482e6fd640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48280cab60 0x7f48281f4250 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f48280d3210 tx=0x7f4820004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:38.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.723+0000 7f48267fc640 1 -- 172.21.15.159:0/1071272420 <== mon.0 v2:172.21.15.159:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4820011460 con 0x7f48280cab60 2024-07-24T16:39:38.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.724+0000 7f48267fc640 1 -- 172.21.15.159:0/1071272420 <== mon.0 v2:172.21.15.159:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f4820017070 con 0x7f48280cab60 2024-07-24T16:39:38.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.724+0000 7f4830160640 1 -- 172.21.15.159:0/1071272420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48281f3d70 con 0x7f48280cab60 2024-07-24T16:39:38.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.724+0000 7f48267fc640 1 -- 172.21.15.159:0/1071272420 <== mon.0 v2:172.21.15.159:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48200119d0 con 0x7f48280cab60 2024-07-24T16:39:38.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.724+0000 7f4830160640 1 -- 172.21.15.159:0/1071272420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4828160c30 con 0x7f48280cab60 2024-07-24T16:39:38.730 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.725+0000 7f4830160640 1 -- 172.21.15.159:0/1071272420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48281f3f40 con 0x7f48280cab60 2024-07-24T16:39:38.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.725+0000 7f48267fc640 1 -- 172.21.15.159:0/1071272420 <== mon.0 v2:172.21.15.159:3300/0 4 ==== mgrmap(e 18) ==== 99139+0+0 (secure 0 0 0) 0x7f482001c460 con 0x7f48280cab60 2024-07-24T16:39:38.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.726+0000 7f48267fc640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4814077010 0x7f48140794d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-07-24T16:39:38.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.726+0000 7f48267fc640 1 -- 172.21.15.159:0/1071272420 <== mon.0 v2:172.21.15.159:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6459+0+0 (secure 0 0 0) 0x7f4820098fc0 con 0x7f48280cab60 2024-07-24T16:39:38.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.726+0000 7f482defc640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4814077010 0x7f48140794d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-07-24T16:39:38.731 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.727+0000 7f482defc640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4814077010 0x7f48140794d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f481800c610 tx=0x7f48280cee60 comp rx=0 tx=0).ready entity=mgr.5335 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-07-24T16:39:38.732 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.730+0000 7f48267fc640 1 -- 172.21.15.159:0/1071272420 <== mon.0 v2:172.21.15.159:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+192868 (secure 0 0 0) 0x7f4820061f60 con 0x7f48280cab60 2024-07-24T16:39:38.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.951+0000 7f4830160640 1 -- 172.21.15.159:0/1071272420 --> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f48280b9180 con 0x7f48280cab60 2024-07-24T16:39:38.954 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.951+0000 7f48267fc640 1 -- 172.21.15.159:0/1071272420 <== mon.0 v2:172.21.15.159:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5229 (secure 0 0 0) 0x7f482006a1a0 con 0x7f48280cab60 2024-07-24T16:39:38.954 INFO:teuthology.orchestra.run.smithi159.stdout: 2024-07-24T16:39:38.955 INFO:teuthology.orchestra.run.smithi159.stdout:{"epoch":24,"btime":"2024-07-24T16:37:06:000526+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5222,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6837/2788613741","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6836","nonce":2788613741},{"type":"v1","addr":"172.21.15.193:6837","nonce":2788613741}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":21},{"gid":5500,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.193:6835/804895322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.193:6834","nonce":804895322},{"type":"v1","addr":"172.21.15.193:6835","nonce":804895322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5793,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.159:6834/4181924724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6832","nonce":4181924724},{"type":"v1","addr":"172.21.15.159:6834","nonce":4181924724}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-07-24T16:37:03.352837+0000","modified":"2024-07-24T16:37:05.351191+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5796},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5796":{"gid":5796,"name":"a","rank":0,"incarnation":22,"state":"up:active","state_seq":4,"addr":"172.21.15.159:6835/433186879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.159:6833","nonce":433186879},{"type":"v1","addr":"172.21.15.159:6835","nonce":433186879}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5796,"qdb_cluster":[5796]},"id":3}]} 2024-07-24T16:39:38.955 INFO:teuthology.orchestra.run.smithi159.stderr:dumped fsmap epoch 24 2024-07-24T16:39:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.954+0000 7f4830160640 1 -- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4814077010 msgr2=0x7f48140794d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.956 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.954+0000 7f4830160640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4814077010 0x7f48140794d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f481800c610 tx=0x7f48280cee60 comp rx=0 tx=0).stop 2024-07-24T16:39:38.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.954+0000 7f4830160640 1 -- 172.21.15.159:0/1071272420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48280cab60 msgr2=0x7f48281f4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-07-24T16:39:38.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.954+0000 7f4830160640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48280cab60 0x7f48281f4250 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f48280d3210 tx=0x7f4820004f70 comp rx=0 tx=0).stop 2024-07-24T16:39:38.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.954+0000 7f4830160640 1 -- 172.21.15.159:0/1071272420 shutdown_connections 2024-07-24T16:39:38.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.954+0000 7f4830160640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:6832/968221167,v1:172.21.15.193:6833/968221167] conn(0x7f4814077010 0x7f48140794d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.954+0000 7f4830160640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.159:3300/0,v1:172.21.15.159:6789/0] conn(0x7f48280cab60 0x7f48281f4250 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.954+0000 7f4830160640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:3301/0,v1:172.21.15.193:6790/0] conn(0x7f48281604c0 0x7f48280b5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.957 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.954+0000 7f4830160640 1 --2- 172.21.15.159:0/1071272420 >> [v2:172.21.15.193:3300/0,v1:172.21.15.193:6789/0] conn(0x7f48100039e0 0x7f482815be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-07-24T16:39:38.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.954+0000 7f4830160640 1 -- 172.21.15.159:0/1071272420 >> 172.21.15.159:0/1071272420 conn(0x7f482809cd30 msgr2=0x7f48280b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-07-24T16:39:38.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.954+0000 7f4830160640 1 -- 172.21.15.159:0/1071272420 shutdown_connections 2024-07-24T16:39:38.958 INFO:teuthology.orchestra.run.smithi159.stderr:2024-07-24T16:39:38.954+0000 7f4830160640 1 -- 172.21.15.159:0/1071272420 wait complete. 2024-07-24T16:39:38.967 DEBUG:tasks.cephfs.filesystem:already dead... 2024-07-24T16:39:38.967 INFO:teuthology.misc:Shutting down mds daemons... 2024-07-24T16:39:38.968 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-07-24T16:39:38.968 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:38.977 INFO:tasks.ceph.mds.a:Stopped 2024-07-24T16:39:38.978 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-07-24T16:39:38.978 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.026 INFO:tasks.ceph.mds.c:Stopped 2024-07-24T16:39:39.026 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-07-24T16:39:39.027 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.039 INFO:tasks.ceph.mds.b:Stopped 2024-07-24T16:39:39.039 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-07-24T16:39:39.039 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.090 INFO:tasks.ceph.mds.d:Stopped 2024-07-24T16:39:39.091 INFO:teuthology.misc:Shutting down osd daemons... 2024-07-24T16:39:39.091 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-07-24T16:39:39.091 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.120 INFO:tasks.ceph.osd.0:Stopped 2024-07-24T16:39:39.120 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-07-24T16:39:39.120 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.193 INFO:tasks.ceph.osd.1:Stopped 2024-07-24T16:39:39.193 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-07-24T16:39:39.193 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.263 INFO:tasks.ceph.osd.2:Stopped 2024-07-24T16:39:39.263 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-07-24T16:39:39.263 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.330 INFO:tasks.ceph.osd.3:Stopped 2024-07-24T16:39:39.331 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-07-24T16:39:39.331 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.359 INFO:tasks.ceph.osd.4:Stopped 2024-07-24T16:39:39.359 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-07-24T16:39:39.359 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.432 INFO:tasks.ceph.osd.5:Stopped 2024-07-24T16:39:39.433 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-07-24T16:39:39.433 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.500 INFO:tasks.ceph.osd.6:Stopped 2024-07-24T16:39:39.500 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-07-24T16:39:39.501 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.568 INFO:tasks.ceph.osd.7:Stopped 2024-07-24T16:39:39.568 INFO:teuthology.misc:Shutting down mgr daemons... 2024-07-24T16:39:39.569 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-07-24T16:39:39.569 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.596 INFO:tasks.ceph.mgr.y:Stopped 2024-07-24T16:39:39.596 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-07-24T16:39:39.596 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.639 INFO:tasks.ceph.mgr.x:Stopped 2024-07-24T16:39:39.639 INFO:teuthology.misc:Shutting down mon daemons... 2024-07-24T16:39:39.639 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-07-24T16:39:39.640 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.651 INFO:tasks.ceph.mon.a:Stopped 2024-07-24T16:39:39.651 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-07-24T16:39:39.652 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.691 INFO:tasks.ceph.mon.b:Stopped 2024-07-24T16:39:39.692 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-07-24T16:39:39.692 INFO:teuthology.orchestra.run:waiting for 300 2024-07-24T16:39:39.745 INFO:tasks.ceph.mon.c:Stopped 2024-07-24T16:39:39.746 INFO:tasks.ceph:Checking cluster log for badness... 2024-07-24T16:39:39.746 DEBUG:teuthology.orchestra.run.smithi159:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-07-24T16:39:39.783 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:39:39.783 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-07-24T16:39:40.130 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:39:40.131 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-07-24T16:39:40.224 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:39:40.224 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-07-24T16:39:40.309 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:39:40.309 DEBUG:teuthology.orchestra.run.smithi159:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-07-24T16:39:40.365 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi193.front.sepia.ceph.com 2024-07-24T16:39:40.365 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-07-24T16:39:40.580 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi193.front.sepia.ceph.com 2024-07-24T16:39:40.581 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-07-24T16:39:40.652 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi193.front.sepia.ceph.com 2024-07-24T16:39:40.652 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-07-24T16:39:40.708 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi193.front.sepia.ceph.com 2024-07-24T16:39:40.708 DEBUG:teuthology.orchestra.run.smithi193:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-07-24T16:39:40.760 INFO:tasks.ceph:Archiving mon data... 2024-07-24T16:39:40.761 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816776/data/mon.a.tgz 2024-07-24T16:39:40.761 DEBUG:teuthology.orchestra.run.smithi159:> mktemp 2024-07-24T16:39:40.777 INFO:teuthology.orchestra.run.smithi159.stdout:/tmp/tmp.ZWPX545lIa 2024-07-24T16:39:40.778 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.ZWPX545lIa 2024-07-24T16:39:40.976 DEBUG:teuthology.orchestra.run.smithi159:> sudo chmod 0666 /tmp/tmp.ZWPX545lIa 2024-07-24T16:39:41.059 DEBUG:teuthology.orchestra.remote:smithi159:/tmp/tmp.ZWPX545lIa is 667KB 2024-07-24T16:39:41.159 DEBUG:teuthology.orchestra.run.smithi159:> rm -fr /tmp/tmp.ZWPX545lIa 2024-07-24T16:39:41.175 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816776/data/mon.b.tgz 2024-07-24T16:39:41.175 DEBUG:teuthology.orchestra.run.smithi193:> mktemp 2024-07-24T16:39:41.193 INFO:teuthology.orchestra.run.smithi193.stdout:/tmp/tmp.nQJ5cuap7h 2024-07-24T16:39:41.193 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.nQJ5cuap7h 2024-07-24T16:39:41.386 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0666 /tmp/tmp.nQJ5cuap7h 2024-07-24T16:39:41.468 DEBUG:teuthology.orchestra.remote:smithi193:/tmp/tmp.nQJ5cuap7h is 676KB 2024-07-24T16:39:41.567 DEBUG:teuthology.orchestra.run.smithi193:> rm -fr /tmp/tmp.nQJ5cuap7h 2024-07-24T16:39:41.582 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816776/data/mon.c.tgz 2024-07-24T16:39:41.582 DEBUG:teuthology.orchestra.run.smithi193:> mktemp 2024-07-24T16:39:41.637 INFO:teuthology.orchestra.run.smithi193.stdout:/tmp/tmp.snCMKW0iR5 2024-07-24T16:39:41.637 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.snCMKW0iR5 2024-07-24T16:39:41.816 DEBUG:teuthology.orchestra.run.smithi193:> sudo chmod 0666 /tmp/tmp.snCMKW0iR5 2024-07-24T16:39:41.900 DEBUG:teuthology.orchestra.remote:smithi193:/tmp/tmp.snCMKW0iR5 is 676KB 2024-07-24T16:39:41.999 DEBUG:teuthology.orchestra.run.smithi193:> rm -fr /tmp/tmp.snCMKW0iR5 2024-07-24T16:39:42.014 INFO:tasks.ceph:Cleaning ceph cluster... 2024-07-24T16:39:42.014 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-07-24T16:39:42.017 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-07-24T16:39:42.100 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-07-24T16:39:42.135 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-07-24T16:39:42.135 INFO:tasks.ceph:Archiving crash dumps... 2024-07-24T16:39:42.137 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816776/remote/smithi159/crash 2024-07-24T16:39:42.137 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-07-24T16:39:42.170 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816776/remote/smithi193/crash 2024-07-24T16:39:42.171 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-07-24T16:39:42.198 INFO:tasks.ceph:Shutting down logrotate 2024-07-24T16:39:42.199 DEBUG:teuthology.orchestra.run.smithi159:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:39:42.215 DEBUG:teuthology.orchestra.run.smithi193:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-07-24T16:39:42.288 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-07-24T16:39:42.317 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-07-24T16:39:42.341 INFO:tasks.ceph:Compressing logs... 2024-07-24T16:39:42.342 DEBUG:teuthology.orchestra.run.smithi159:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-07-24T16:39:42.360 DEBUG:teuthology.orchestra.run.smithi193:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-07-24T16:39:42.414 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38310.log 2024-07-24T16:39:42.415 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38510.log 2024-07-24T16:39:42.415 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.38310.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-07-24T16:39:42.415 INFO:teuthology.orchestra.run.smithi193.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.38310.log.gz 2024-07-24T16:39:42.415 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.38510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38270.log 2024-07-24T16:39:42.415 INFO:teuthology.orchestra.run.smithi193.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.38510.log.gz 2024-07-24T16:39:42.415 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-07-24T16:39:42.415 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.38270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44808.log 2024-07-24T16:39:42.416 INFO:teuthology.orchestra.run.smithi193.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.38270.log.gz 2024-07-24T16:39:42.416 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-07-24T16:39:42.416 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.3.44808.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-07-24T16:39:42.416 INFO:teuthology.orchestra.run.smithi193.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44808.log.gz 2024-07-24T16:39:42.416 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-07-24T16:39:42.416 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44408.log 2024-07-24T16:39:42.416 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-07-24T16:39:42.417 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.1.44408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38390.log 2024-07-24T16:39:42.417 INFO:teuthology.orchestra.run.smithi193.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44408.log.gz 2024-07-24T16:39:42.417 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-07-24T16:39:42.417 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.38390.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-07-24T16:39:42.417 INFO:teuthology.orchestra.run.smithi193.stderr: 93.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-07-24T16:39:42.417 INFO:teuthology.orchestra.run.smithi193.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.38390.log.gz 2024-07-24T16:39:42.417 INFO:teuthology.orchestra.run.smithi193.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-07-24T16:39:42.417 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38230.log 2024-07-24T16:39:42.418 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38430.log 2024-07-24T16:39:42.418 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.38230.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-07-24T16:39:42.418 INFO:teuthology.orchestra.run.smithi193.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.38230.log.gz 2024-07-24T16:39:42.418 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.38430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38470.log 2024-07-24T16:39:42.418 INFO:teuthology.orchestra.run.smithi193.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.38430.log.gz 2024-07-24T16:39:42.418 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.44804.log 2024-07-24T16:39:42.418 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.38470.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.38470.log.gz 2024-07-24T16:39:42.418 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38350.log 2024-07-24T16:39:42.419 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.3.44804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.44804.log.gz 2024-07-24T16:39:42.422 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44403.log 2024-07-24T16:39:42.422 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.admin.38350.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38350.log.gz 2024-07-24T16:39:42.422 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-07-24T16:39:42.422 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-client.1.44403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.44403.log.gz 2024-07-24T16:39:42.422 INFO:teuthology.orchestra.run.smithi193.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-07-24T16:39:42.423 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-mds.d.log: 93.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-07-24T16:39:42.445 INFO:teuthology.orchestra.run.smithi193.stderr:/var/log/ceph/ceph-mon.b.log: 92.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-07-24T16:39:42.520 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50263.log 2024-07-24T16:39:42.520 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57653.log 2024-07-24T16:39:42.520 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38024.log 2024-07-24T16:39:42.521 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50263.log.gz 2024-07-24T16:39:42.521 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60204.log 2024-07-24T16:39:42.521 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57653.log.gz 2024-07-24T16:39:42.521 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49922.log 2024-07-24T16:39:42.521 INFO:teuthology.orchestra.run.smithi159.stderr: 77.2% -- replaced with /var/log/ceph/ceph-client.admin.38024.log.gz 2024-07-24T16:39:42.521 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.60204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38235.log 2024-07-24T16:39:42.521 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49922.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60204.log.gz 2024-07-24T16:39:42.522 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57695.log 2024-07-24T16:39:42.522 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49922.log.gz 2024-07-24T16:39:42.522 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53885.log 2024-07-24T16:39:42.522 INFO:teuthology.orchestra.run.smithi159.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.38235.log.gz 2024-07-24T16:39:42.522 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38472.log 2024-07-24T16:39:42.522 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57695.log.gz 2024-07-24T16:39:42.523 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.53885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49461.log 2024-07-24T16:39:42.523 INFO:teuthology.orchestra.run.smithi159.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.53885.log.gz 2024-07-24T16:39:42.523 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49230.log 2024-07-24T16:39:42.523 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.38472.log.gz 2024-07-24T16:39:42.523 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.48739.log 2024-07-24T16:39:42.523 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49461.log: /var/log/ceph/ceph-client.admin.49230.log: gzip -5 87.7% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.49461.log.gz 2024-07-24T16:39:42.523 INFO:teuthology.orchestra.run.smithi159.stderr: /var/log/ceph/ceph-client.admin.58600.log 2024-07-24T16:39:42.524 INFO:teuthology.orchestra.run.smithi159.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49230.log.gz 2024-07-24T16:39:42.524 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.2.48739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44542.log 2024-07-24T16:39:42.524 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.48739.log.gz 2024-07-24T16:39:42.524 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47688.log 2024-07-24T16:39:42.524 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58600.log.gz 2024-07-24T16:39:42.524 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.44542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46988.log 2024-07-24T16:39:42.524 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44542.log.gz 2024-07-24T16:39:42.525 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50558.log 2024-07-24T16:39:42.525 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47688.log.gz 2024-07-24T16:39:42.525 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57863.log 2024-07-24T16:39:42.525 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46988.log.gz/var/log/ceph/ceph-client.admin.50558.log: 2024-07-24T16:39:42.525 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59628.log 2024-07-24T16:39:42.525 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50558.log.gz 2024-07-24T16:39:42.525 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46050.log 2024-07-24T16:39:42.526 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57863.log.gz 2024-07-24T16:39:42.526 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.59628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59292.log 2024-07-24T16:39:42.526 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59628.log.gz 2024-07-24T16:39:42.526 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59502.log 2024-07-24T16:39:42.526 INFO:teuthology.orchestra.run.smithi159.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46050.log.gz 2024-07-24T16:39:42.526 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.59292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58291.log 2024-07-24T16:39:42.526 INFO:teuthology.orchestra.run.smithi159.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.59292.log.gz 2024-07-24T16:39:42.526 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.59502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45194.log 2024-07-24T16:39:42.527 INFO:teuthology.orchestra.run.smithi159.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.59502.log.gz 2024-07-24T16:39:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45134.log 2024-07-24T16:39:42.527 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58291.log.gz 2024-07-24T16:39:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.45194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52453.log 2024-07-24T16:39:42.527 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.45134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51759.log 2024-07-24T16:39:42.527 INFO:teuthology.orchestra.run.smithi159.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.45194.log.gz 2024-07-24T16:39:42.527 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45134.log.gz 2024-07-24T16:39:42.528 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50953.log 2024-07-24T16:39:42.528 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52453.log.gz 2024-07-24T16:39:42.528 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.51759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50600.log 2024-07-24T16:39:42.528 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50953.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51759.log.gz 2024-07-24T16:39:42.528 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50911.log 2024-07-24T16:39:42.528 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50953.log.gz 2024-07-24T16:39:42.528 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50474.log 2024-07-24T16:39:42.528 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50600.log.gz/var/log/ceph/ceph-client.admin.50911.log: 2024-07-24T16:39:42.529 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57569.log 2024-07-24T16:39:42.529 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50911.log.gz 2024-07-24T16:39:42.529 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50474.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-07-24T16:39:42.529 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50474.log.gz 2024-07-24T16:39:42.529 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52335.log 2024-07-24T16:39:42.529 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57569.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50823.log 2024-07-24T16:39:42.529 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.57569.log.gz 2024-07-24T16:39:42.529 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57424.log 2024-07-24T16:39:42.530 INFO:teuthology.orchestra.run.smithi159.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.52335.log.gz 2024-07-24T16:39:42.530 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57524.log 2024-07-24T16:39:42.530 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57424.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50823.log.gz 2024-07-24T16:39:42.530 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52789.log 2024-07-24T16:39:42.530 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57424.log.gz 2024-07-24T16:39:42.530 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51817.log 2024-07-24T16:39:42.530 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57524.log.gz 2024-07-24T16:39:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59865.log 2024-07-24T16:39:42.531 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-07-24T16:39:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.51817.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52789.log.gz 2024-07-24T16:39:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58247.log 2024-07-24T16:39:42.531 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51817.log.gz 2024-07-24T16:39:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.59865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59815.log 2024-07-24T16:39:42.531 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59865.log.gz 2024-07-24T16:39:42.531 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57364.log 2024-07-24T16:39:42.532 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58247.log.gz 2024-07-24T16:39:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.59815.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-07-24T16:39:42.532 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59815.log.gz 2024-07-24T16:39:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49086.log 2024-07-24T16:39:42.532 INFO:teuthology.orchestra.run.smithi159.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57364.log.gz 2024-07-24T16:39:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52873.log 2024-07-24T16:39:42.532 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59907.log 2024-07-24T16:39:42.532 INFO:teuthology.orchestra.run.smithi159.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49086.log.gz 2024-07-24T16:39:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49188.log 2024-07-24T16:39:42.533 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52873.log.gz 2024-07-24T16:39:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.59907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59670.log 2024-07-24T16:39:42.533 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59907.log.gz 2024-07-24T16:39:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49796.log 2024-07-24T16:39:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.59670.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.49188.log.gz 2024-07-24T16:39:42.533 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51037.log 2024-07-24T16:39:42.533 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59670.log.gz 2024-07-24T16:39:42.534 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47184.log 2024-07-24T16:39:42.534 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49796.log.gz 2024-07-24T16:39:42.534 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.51037.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48435.log 2024-07-24T16:39:42.534 INFO:teuthology.orchestra.run.smithi159.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51037.log.gz 2024-07-24T16:39:42.534 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55392.log 2024-07-24T16:39:42.534 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.47184.log.gz 2024-07-24T16:39:42.534 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.48435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46987.log 2024-07-24T16:39:42.534 INFO:teuthology.orchestra.run.smithi159.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48435.log.gz 2024-07-24T16:39:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.55392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58684.log 2024-07-24T16:39:42.535 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55392.log.gz 2024-07-24T16:39:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46987.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-07-24T16:39:42.535 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46987.log.gz 2024-07-24T16:39:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45008.log 2024-07-24T16:39:42.535 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58684.log.gz 2024-07-24T16:39:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47323.log 2024-07-24T16:39:42.535 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.45008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53624.log 2024-07-24T16:39:42.536 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45008.log.gz 2024-07-24T16:39:42.536 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49754.log 2024-07-24T16:39:42.536 INFO:teuthology.orchestra.run.smithi159.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47323.log.gz 2024-07-24T16:39:42.536 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56970.log 2024-07-24T16:39:42.536 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.53624.log: /var/log/ceph/ceph-client.admin.49754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47562.log 2024-07-24T16:39:42.536 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53624.log.gz 2024-07-24T16:39:42.536 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49754.log.gz 2024-07-24T16:39:42.537 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.56970.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-07-24T16:39:42.537 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45260.log 2024-07-24T16:39:42.537 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56970.log.gz 2024-07-24T16:39:42.537 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38186.log 2024-07-24T16:39:42.537 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47562.log: /var/log/ceph/ceph-client.admin.45260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57091.log 2024-07-24T16:39:42.537 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47562.log.gz 2024-07-24T16:39:42.537 INFO:teuthology.orchestra.run.smithi159.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45260.log.gz 2024-07-24T16:39:42.537 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53708.log 2024-07-24T16:39:42.538 INFO:teuthology.orchestra.run.smithi159.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.38186.log.gz 2024-07-24T16:39:42.538 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38306.log 2024-07-24T16:39:42.538 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57091.log: /var/log/ceph/ceph-client.admin.53708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58516.log 2024-07-24T16:39:42.538 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57091.log.gz 2024-07-24T16:39:42.538 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53708.log.gz 2024-07-24T16:39:42.538 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44458.log 2024-07-24T16:39:42.538 INFO:teuthology.orchestra.run.smithi159.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.38306.log.gz 2024-07-24T16:39:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52495.log 2024-07-24T16:39:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.44458.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58516.log.gz 2024-07-24T16:39:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53540.log 2024-07-24T16:39:42.539 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44458.log.gz 2024-07-24T16:39:42.539 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52495.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-07-24T16:39:42.539 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52495.log.gz 2024-07-24T16:39:42.540 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.53540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46645.log 2024-07-24T16:39:42.540 INFO:teuthology.orchestra.run.smithi159.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.53540.log.gz 2024-07-24T16:39:42.540 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38471.log 2024-07-24T16:39:42.540 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58163.log 2024-07-24T16:39:42.540 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46645.log.gz 2024-07-24T16:39:42.540 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54003.log 2024-07-24T16:39:42.541 INFO:teuthology.orchestra.run.smithi159.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.38471.log.gz 2024-07-24T16:39:42.541 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58335.log 2024-07-24T16:39:42.541 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58163.log: /var/log/ceph/ceph-client.admin.54003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54298.log 2024-07-24T16:39:42.541 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58163.log.gz 2024-07-24T16:39:42.541 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54003.log.gz 2024-07-24T16:39:42.541 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46008.log 2024-07-24T16:39:42.541 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.58335.log.gz 2024-07-24T16:39:42.542 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.54298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46649.log 2024-07-24T16:39:42.542 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54298.log.gz 2024-07-24T16:39:42.542 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53582.log 2024-07-24T16:39:42.542 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46008.log: /var/log/ceph/ceph-client.admin.46649.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46008.log.gz 2024-07-24T16:39:42.542 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51079.log 2024-07-24T16:39:42.542 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46649.log.gz 2024-07-24T16:39:42.542 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53666.log 2024-07-24T16:39:42.543 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.53582.log: /var/log/ceph/ceph-client.admin.51079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57280.log 2024-07-24T16:39:42.543 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53582.log.gz 2024-07-24T16:39:42.543 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51079.log.gz 2024-07-24T16:39:42.543 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.53666.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-07-24T16:39:42.543 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53666.log.gz 2024-07-24T16:39:42.543 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44796.log 2024-07-24T16:39:42.543 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57280.log.gz 2024-07-24T16:39:42.543 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46985.log 2024-07-24T16:39:42.544 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.44796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60078.log 2024-07-24T16:39:42.544 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44796.log.gz 2024-07-24T16:39:42.544 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59730.log 2024-07-24T16:39:42.544 INFO:teuthology.orchestra.run.smithi159.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46985.log.gz 2024-07-24T16:39:42.544 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50006.log 2024-07-24T16:39:42.544 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.60078.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60078.log.gz 2024-07-24T16:39:42.544 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.59730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38465.log 2024-07-24T16:39:42.544 INFO:teuthology.orchestra.run.smithi159.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.59730.log.gz 2024-07-24T16:39:42.545 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58386.log 2024-07-24T16:39:42.545 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50006.log: gzip -5 --verbose --/var/log/ceph/ceph-client.admin.38465.log: /var/log/ceph/ceph-client.admin.57466.log 2024-07-24T16:39:42.545 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50006.log.gz 2024-07-24T16:39:42.545 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58386.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.38465.log.gz 2024-07-24T16:39:42.545 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37988.log 2024-07-24T16:39:42.545 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58386.log.gz 2024-07-24T16:39:42.545 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46650.log 2024-07-24T16:39:42.545 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57466.log.gz 2024-07-24T16:39:42.546 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.37988.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-07-24T16:39:42.546 INFO:teuthology.orchestra.run.smithi159.stderr: 77.1% -- replaced with /var/log/ceph/ceph-client.admin.37988.log.gz 2024-07-24T16:39:42.546 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38454.log 2024-07-24T16:39:42.546 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46650.log.gz 2024-07-24T16:39:42.546 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-07-24T16:39:42.546 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52621.log 2024-07-24T16:39:42.546 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38454.log: 93.6% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-07-24T16:39:42.547 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-mgr.y.log: gzip 86.3% -5 -- replaced with /var/log/ceph/ceph-client.admin.38454.log.gz --verbose 2024-07-24T16:39:42.547 INFO:teuthology.orchestra.run.smithi159.stderr: -- /var/log/ceph/ceph-client.admin.44710.log 2024-07-24T16:39:42.547 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59773.log 2024-07-24T16:39:42.547 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52621.log.gz 2024-07-24T16:39:42.547 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.44710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45931.log 2024-07-24T16:39:42.547 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44710.log.gz 2024-07-24T16:39:42.547 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.59773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38424.log 2024-07-24T16:39:42.547 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59773.log.gz 2024-07-24T16:39:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.45931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56444.log 2024-07-24T16:39:42.548 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45931.log.gz 2024-07-24T16:39:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51981.log 2024-07-24T16:39:42.548 INFO:teuthology.orchestra.run.smithi159.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.38424.log.gz 2024-07-24T16:39:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.56444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59064.log 2024-07-24T16:39:42.548 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56444.log.gz/var/log/ceph/ceph-client.admin.51981.log: 2024-07-24T16:39:42.548 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54866.log 2024-07-24T16:39:42.548 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.51981.log.gz 2024-07-24T16:39:42.549 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.0.59064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50432.log 2024-07-24T16:39:42.549 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59064.log.gz 2024-07-24T16:39:42.549 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.54866.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-07-24T16:39:42.549 INFO:teuthology.orchestra.run.smithi159.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.54866.log.gz 2024-07-24T16:39:42.549 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60454.log 2024-07-24T16:39:42.549 INFO:teuthology.orchestra.run.smithi159.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.50432.log.gz 2024-07-24T16:39:42.549 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45092.log 2024-07-24T16:39:42.550 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.60454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46134.log 2024-07-24T16:39:42.550 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60454.log.gz/var/log/ceph/ceph-client.admin.45092.log: 2024-07-24T16:39:42.550 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52394.log 2024-07-24T16:39:42.550 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45092.log.gz 2024-07-24T16:39:42.550 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5/var/log/ceph/ceph-client.admin.46134.log: --verbose -- /var/log/ceph/ceph-client.admin.47520.log 2024-07-24T16:39:42.550 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52394.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46134.log.gz 2024-07-24T16:39:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51585.log 2024-07-24T16:39:42.551 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52394.log.gz 2024-07-24T16:39:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52217.log 2024-07-24T16:39:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47520.log: /var/log/ceph/ceph-client.0.51585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38455.log 2024-07-24T16:39:42.551 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51585.log.gz 2024-07-24T16:39:42.551 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52217.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47520.log.gz 2024-07-24T16:39:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52217.log.gz 2024-07-24T16:39:42.552 INFO:teuthology.orchestra.run.smithi159.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46978.log 2024-07-24T16:39:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38455.log: gzip 86.2% -- replaced with /var/log/ceph/ceph-client.admin.38455.log.gz 2024-07-24T16:39:42.552 INFO:teuthology.orchestra.run.smithi159.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49838.log 2024-07-24T16:39:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59951.log 2024-07-24T16:39:42.552 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46978.log.gz 2024-07-24T16:39:42.552 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49002.log 2024-07-24T16:39:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49838.log: gzip/var/log/ceph/ceph-client.admin.59951.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46979.log 2024-07-24T16:39:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49002.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59951.log.gz 2024-07-24T16:39:42.553 INFO:teuthology.orchestra.run.smithi159.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.49838.log.gz 2024-07-24T16:39:42.553 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52537.log 2024-07-24T16:39:42.553 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.49002.log.gz 2024-07-24T16:39:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54062.log 2024-07-24T16:39:42.553 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46979.log.gz 2024-07-24T16:39:42.553 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45873.log 2024-07-24T16:39:42.554 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52537.log: /var/log/ceph/ceph-client.admin.54062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50048.log 2024-07-24T16:39:42.554 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52537.log.gz 2024-07-24T16:39:42.554 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.45873.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.54062.log.gz 2024-07-24T16:39:42.554 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45873.log.gz 2024-07-24T16:39:42.554 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52276.log 2024-07-24T16:39:42.554 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46640.log 2024-07-24T16:39:42.554 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50048.log: /var/log/ceph/ceph-client.admin.52276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46642.log 2024-07-24T16:39:42.554 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50048.log.gz 2024-07-24T16:39:42.555 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46640.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52276.log.gz 2024-07-24T16:39:42.555 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46640.log.gz 2024-07-24T16:39:42.555 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46651.log 2024-07-24T16:39:42.555 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45050.log 2024-07-24T16:39:42.555 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46642.log: /var/log/ceph/ceph-client.admin.46651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57238.log 2024-07-24T16:39:42.555 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.45050.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46642.log.gz 2024-07-24T16:39:42.555 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46651.log.gz 2024-07-24T16:39:42.555 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-client.admin.58768.log 2024-07-24T16:39:42.556 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45050.log.gz 2024-07-24T16:39:42.556 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52747.log 2024-07-24T16:39:42.556 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57238.log: /var/log/ceph/ceph-client.admin.58768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38439.log 2024-07-24T16:39:42.556 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57238.log.gz 2024-07-24T16:39:42.556 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52747.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58768.log.gz 2024-07-24T16:39:42.556 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53456.log 2024-07-24T16:39:42.556 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52747.log.gz 2024-07-24T16:39:42.556 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50305.log 2024-07-24T16:39:42.557 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38439.log: /var/log/ceph/ceph-client.admin.53456.log: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-07-24T16:39:42.557 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53372.log 2024-07-24T16:39:42.557 INFO:teuthology.orchestra.run.smithi159.stderr: 86.4%/var/log/ceph/ceph-client.admin.50305.log: -- replaced with /var/log/ceph/ceph-client.admin.38439.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38915.log 2024-07-24T16:39:42.557 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53456.log.gz 2024-07-24T16:39:42.557 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-07-24T16:39:42.557 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50305.log.gz 2024-07-24T16:39:42.557 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-07-24T16:39:42.557 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.53372.log: /var/log/ceph/ceph-client.admin.38915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49044.log 2024-07-24T16:39:42.558 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% 86.8% -- replaced with /var/log/ceph/ceph-client.admin.38915.log.gz 2024-07-24T16:39:42.558 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53372.log.gz 2024-07-24T16:39:42.558 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47321.log 2024-07-24T16:39:42.558 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55918.log 2024-07-24T16:39:42.558 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59586.log 2024-07-24T16:39:42.558 INFO:teuthology.orchestra.run.smithi159.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49044.log.gz 2024-07-24T16:39:42.558 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.47321.log.gz 2024-07-24T16:39:42.559 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.55918.log: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51397.log 2024-07-24T16:39:42.559 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55918.log.gz 2024-07-24T16:39:42.559 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.59586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49670.log 2024-07-24T16:39:42.559 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59586.log.gz 2024-07-24T16:39:42.559 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.51397.log: gzip -5 --verbose -- 87.9% -- replaced with /var/log/ceph/ceph-client.admin.51397.log.gz 2024-07-24T16:39:42.559 INFO:teuthology.orchestra.run.smithi159.stderr: /var/log/ceph/ceph-client.admin.46092.log 2024-07-24T16:39:42.560 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49670.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49670.log.gz 2024-07-24T16:39:42.560 INFO:teuthology.orchestra.run.smithi159.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.49383.log 2024-07-24T16:39:42.560 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52579.log 2024-07-24T16:39:42.560 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46092.log.gz/var/log/ceph/ceph-client.admin.49383.log: 2024-07-24T16:39:42.560 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49383.log.gz 2024-07-24T16:39:42.560 INFO:teuthology.orchestra.run.smithi159.stderr: -- /var/log/ceph/ceph-client.admin.57194.log 2024-07-24T16:39:42.560 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52579.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52579.log.gz 2024-07-24T16:39:42.561 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50995.log 2024-07-24T16:39:42.561 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58001.log/var/log/ceph/ceph-client.admin.57194.log: 2024-07-24T16:39:42.561 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50995.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57194.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60372.log 2024-07-24T16:39:42.561 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-07-24T16:39:42.561 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50995.log.gz 2024-07-24T16:39:42.561 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49712.log 2024-07-24T16:39:42.561 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58001.log.gz/var/log/ceph/ceph-client.admin.60372.log: 2024-07-24T16:39:42.562 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose 86.9% -- replaced with /var/log/ceph/ceph-client.admin.60372.log.gz 2024-07-24T16:39:42.562 INFO:teuthology.orchestra.run.smithi159.stderr: -- /var/log/ceph/ceph-client.admin.46302.log 2024-07-24T16:39:42.562 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38470.log 2024-07-24T16:39:42.562 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.49712.log.gz 2024-07-24T16:39:42.562 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48960.log 2024-07-24T16:39:42.562 INFO:teuthology.orchestra.run.smithi159.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.46302.log.gz 2024-07-24T16:39:42.562 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38470.log: gzip -5 --verbose 86.1% -- /var/log/ceph/ceph-client.admin.46986.log 2024-07-24T16:39:42.562 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38470.log.gz 2024-07-24T16:39:42.563 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.48960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57821.log 2024-07-24T16:39:42.563 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48960.log.gz 2024-07-24T16:39:42.563 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44882.log 2024-07-24T16:39:42.563 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46986.log: /var/log/ceph/ceph-client.admin.57821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50347.log 2024-07-24T16:39:42.563 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.44882.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.57821.log.gz 2024-07-24T16:39:42.563 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46986.log.gz 2024-07-24T16:39:42.563 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56707.log 2024-07-24T16:39:42.563 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44882.log.gz 2024-07-24T16:39:42.564 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52158.log 2024-07-24T16:39:42.564 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50347.log.gz 2024-07-24T16:39:42.564 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.56707.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.38080.log 2024-07-24T16:39:42.564 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56707.log.gz 2024-07-24T16:39:42.564 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58121.log 2024-07-24T16:39:42.564 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52158.log.gz 2024-07-24T16:39:42.564 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38080.log: 78.8% -- replaced with /var/log/ceph/ceph-client.admin.38080.log.gz 2024-07-24T16:39:42.564 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47312.log 2024-07-24T16:39:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46470.log/var/log/ceph/ceph-client.admin.58121.log: 2024-07-24T16:39:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47312.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58121.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52663.log 2024-07-24T16:39:42.565 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-07-24T16:39:42.565 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47312.log.gz 2024-07-24T16:39:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47646.log 2024-07-24T16:39:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52663.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46470.log.gz 2024-07-24T16:39:42.565 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49272.log 2024-07-24T16:39:42.566 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47646.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52663.log.gz 2024-07-24T16:39:42.566 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60288.log 2024-07-24T16:39:42.566 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58642.log 2024-07-24T16:39:42.566 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49272.log: -- replaced with /var/log/ceph/ceph-client.admin.47646.log.gz 2024-07-24T16:39:42.566 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49272.log.gz 2024-07-24T16:39:42.566 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.60288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52705.log 2024-07-24T16:39:42.566 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60288.log.gz 2024-07-24T16:39:42.566 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58428.log 2024-07-24T16:39:42.567 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.52705.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58642.log.gz -5 2024-07-24T16:39:42.567 INFO:teuthology.orchestra.run.smithi159.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38108.log 2024-07-24T16:39:42.567 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53944.log 2024-07-24T16:39:42.567 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52705.log.gz/var/log/ceph/ceph-client.admin.58428.log: 2024-07-24T16:39:42.567 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58428.log.gz 2024-07-24T16:39:42.567 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38108.log: 79.0% -- replaced with /var/log/ceph/ceph-client.admin.38108.log.gz 2024-07-24T16:39:42.567 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52040.log 2024-07-24T16:39:42.568 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.53944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51163.log 2024-07-24T16:39:42.568 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0%/var/log/ceph/ceph-client.admin.52040.log: -- replaced with /var/log/ceph/ceph-client.admin.53944.log.gz 2024-07-24T16:39:42.568 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54180.log 2024-07-24T16:39:42.568 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52040.log.gz 2024-07-24T16:39:42.568 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38052.log 2024-07-24T16:39:42.568 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.51163.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.51163.log.gz 2024-07-24T16:39:42.568 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.54180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51709.log 2024-07-24T16:39:42.568 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.54180.log.gz 2024-07-24T16:39:42.569 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58726.log 2024-07-24T16:39:42.569 INFO:teuthology.orchestra.run.smithi159.stderr: 78.9% -- replaced with /var/log/ceph/ceph-client.admin.38052.log.gz 2024-07-24T16:39:42.569 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.51709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55655.log 2024-07-24T16:39:42.569 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48876.log 2024-07-24T16:39:42.569 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5%/var/log/ceph/ceph-client.admin.58726.log: -- replaced with /var/log/ceph/ceph-client.admin.51709.log.gz 2024-07-24T16:39:42.569 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58726.log.gz 2024-07-24T16:39:42.569 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.55655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53498.log 2024-07-24T16:39:42.569 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55655.log.gz 2024-07-24T16:39:42.570 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.48876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59993.log 2024-07-24T16:39:42.570 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.53498.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48876.log.gz 2024-07-24T16:39:42.570 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57322.log 2024-07-24T16:39:42.570 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50090.log 2024-07-24T16:39:42.570 INFO:teuthology.orchestra.run.smithi159.stderr: 86.7%/var/log/ceph/ceph-client.admin.59993.log: -- replaced with /var/log/ceph/ceph-client.admin.53498.log.gz 2024-07-24T16:39:42.570 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.59993.log.gz 2024-07-24T16:39:42.570 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59068.log 2024-07-24T16:39:42.571 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57322.log.gz 2024-07-24T16:39:42.571 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58876.log 2024-07-24T16:39:42.571 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.0.59068.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50090.log.gz 2024-07-24T16:39:42.571 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46641.log 2024-07-24T16:39:42.571 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.59068.log.gz 2024-07-24T16:39:42.571 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50516.log 2024-07-24T16:39:42.571 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58876.log: gzip 87.9% -5 -- replaced with /var/log/ceph/ceph-client.admin.58876.log.gz --verbose 2024-07-24T16:39:42.571 INFO:teuthology.orchestra.run.smithi159.stderr: -- /var/log/ceph/ceph-client.admin.50869.log 2024-07-24T16:39:42.572 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46641.log: gzip/var/log/ceph/ceph-client.admin.50516.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.54603.log 2024-07-24T16:39:42.572 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7%/var/log/ceph/ceph-client.admin.50869.log: -- replaced with /var/log/ceph/ceph-client.admin.50516.log.gz 2024-07-24T16:39:42.572 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46641.log.gz 2024-07-24T16:39:42.572 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50869.log.gz 2024-07-24T16:39:42.572 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53414.log 2024-07-24T16:39:42.572 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.54603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50644.log 2024-07-24T16:39:42.572 INFO:teuthology.orchestra.run.smithi159.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.54603.log.gz 2024-07-24T16:39:42.572 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.53414.log: gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.60414.log 2024-07-24T16:39:42.573 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.53414.log.gz 2024-07-24T16:39:42.573 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50781.log 2024-07-24T16:39:42.573 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50644.log.gz 2024-07-24T16:39:42.573 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47318.log 2024-07-24T16:39:42.573 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.60414.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.50781.log: -- /var/log/ceph/ceph-client.admin.44626.log 2024-07-24T16:39:42.573 INFO:teuthology.orchestra.run.smithi159.stderr: 86.9% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50781.log.gz 2024-07-24T16:39:42.573 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60414.log.gz 2024-07-24T16:39:42.574 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57906.log 2024-07-24T16:39:42.574 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47318.log.gz 2024-07-24T16:39:42.574 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.44626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55129.log 2024-07-24T16:39:42.574 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57906.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44626.log.gz 2024-07-24T16:39:42.574 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51667.log 2024-07-24T16:39:42.574 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59146.log 2024-07-24T16:39:42.574 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.55129.log: -- replaced with /var/log/ceph/ceph-client.admin.57906.log.gz 2024-07-24T16:39:42.574 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55129.log.gz 2024-07-24T16:39:42.575 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.51667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49551.log 2024-07-24T16:39:42.575 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.51667.log.gz 2024-07-24T16:39:42.575 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.59146.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51589.log 2024-07-24T16:39:42.575 INFO:teuthology.orchestra.run.smithi159.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.59146.log.gz 2024-07-24T16:39:42.575 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38714.log 2024-07-24T16:39:42.575 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49551.log: /var/log/ceph/ceph-client.0.51589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45699.log 2024-07-24T16:39:42.575 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.51589.log.gz 2024-07-24T16:39:42.575 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4%/var/log/ceph/ceph-client.admin.38714.log: -- replaced with /var/log/ceph/ceph-client.admin.49551.log.gz 2024-07-24T16:39:42.576 INFO:teuthology.orchestra.run.smithi159.stderr:gzip 86.5% -- replaced with /var/log/ceph/ceph-client.admin.38714.log.gz 2024-07-24T16:39:42.576 INFO:teuthology.orchestra.run.smithi159.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.57737.log 2024-07-24T16:39:42.576 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.45699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58470.log 2024-07-24T16:39:42.576 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50688.log 2024-07-24T16:39:42.576 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57737.log.gz 2024-07-24T16:39:42.576 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60162.log 2024-07-24T16:39:42.576 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50688.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58470.log.gz 2024-07-24T16:39:42.577 INFO:teuthology.orchestra.run.smithi159.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.45699.log.gz 2024-07-24T16:39:42.577 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50688.log.gz 2024-07-24T16:39:42.577 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57779.log 2024-07-24T16:39:42.577 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53767.log/var/log/ceph/ceph-client.admin.60162.log: 2024-07-24T16:39:42.577 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57779.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60162.log.gz 2024-07-24T16:39:42.577 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56181.log 2024-07-24T16:39:42.577 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57779.log.gz 2024-07-24T16:39:42.577 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.53767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48918.log 2024-07-24T16:39:42.578 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.56181.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51904.log 2024-07-24T16:39:42.578 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53767.log.gz 2024-07-24T16:39:42.578 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.48918.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.56181.log.gz 2024-07-24T16:39:42.578 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46344.log 2024-07-24T16:39:42.578 INFO:teuthology.orchestra.run.smithi159.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48918.log.gz 2024-07-24T16:39:42.578 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58810.log 2024-07-24T16:39:42.578 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.51904.log: /var/log/ceph/ceph-client.admin.46344.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31902.log 2024-07-24T16:39:42.578 INFO:teuthology.orchestra.run.smithi159.stderr: 87.8%/var/log/ceph/ceph-client.admin.58810.log: -- replaced with /var/log/ceph/ceph-client.admin.46344.log.gz 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51904.log.gz 2024-07-24T16:39:42.579 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-07-24T16:39:42.579 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53826.log 2024-07-24T16:39:42.579 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph.tmp-client.admin.31902.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.58810.log.gz 2024-07-24T16:39:42.579 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31902.log.gz 2024-07-24T16:39:42.579 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37931.log 2024-07-24T16:39:42.579 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5/var/log/ceph/ceph-client.admin.53826.log: --verbose -- /var/log/ceph/ceph-client.admin.46260.log 2024-07-24T16:39:42.579 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.37931.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53826.log.gz 2024-07-24T16:39:42.579 INFO:teuthology.orchestra.run.smithi159.stderr:gzip 75.5% -- replaced with /var/log/ceph/ceph-client.admin.37931.log.gz 2024-07-24T16:39:42.580 INFO:teuthology.orchestra.run.smithi159.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.58558.log 2024-07-24T16:39:42.580 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44966.log 2024-07-24T16:39:42.580 INFO:teuthology.orchestra.run.smithi159.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46260.log.gz 2024-07-24T16:39:42.580 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53330.log 2024-07-24T16:39:42.580 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58558.log.gz 2024-07-24T16:39:42.580 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46970.log 2024-07-24T16:39:42.580 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.44966.log: /var/log/ceph/ceph-client.admin.53330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47978.log 2024-07-24T16:39:42.580 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44966.log.gz 2024-07-24T16:39:42.581 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.53330.log.gz 2024-07-24T16:39:42.581 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57611.log 2024-07-24T16:39:42.581 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46970.log.gz/var/log/ceph/ceph-client.admin.47978.log: 2024-07-24T16:39:42.581 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47978.log.gz 2024-07-24T16:39:42.581 INFO:teuthology.orchestra.run.smithi159.stderr: -- /var/log/ceph/ceph-client.admin.60120.log 2024-07-24T16:39:42.581 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.57611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52831.log 2024-07-24T16:39:42.581 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57611.log.gz 2024-07-24T16:39:42.581 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.60120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44754.log 2024-07-24T16:39:42.582 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60120.log.gz/var/log/ceph/ceph-client.admin.52831.log: 2024-07-24T16:39:42.582 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54121.log 2024-07-24T16:39:42.582 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52831.log.gz 2024-07-24T16:39:42.582 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47604.log/var/log/ceph/ceph-client.admin.44754.log: 2024-07-24T16:39:42.582 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.54121.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44754.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51205.log 2024-07-24T16:39:42.582 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-07-24T16:39:42.582 INFO:teuthology.orchestra.run.smithi159.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54121.log.gz 2024-07-24T16:39:42.583 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46218.log 2024-07-24T16:39:42.583 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.51205.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-07-24T16:39:42.583 INFO:teuthology.orchestra.run.smithi159.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47604.log.gz 2024-07-24T16:39:42.583 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46218.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51205.log.gz 2024-07-24T16:39:42.583 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52099.log 2024-07-24T16:39:42.583 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46218.log.gz 2024-07-24T16:39:42.584 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60330.log 2024-07-24T16:39:42.584 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.52099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46983.log 2024-07-24T16:39:42.584 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.60330.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52099.log.gz 2024-07-24T16:39:42.584 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46386.log 2024-07-24T16:39:42.584 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60330.log.gz 2024-07-24T16:39:42.584 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46983.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46983.log.gz 2024-07-24T16:39:42.584 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54239.log 2024-07-24T16:39:42.585 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44924.log 2024-07-24T16:39:42.585 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46386.log: 87.6%/var/log/ceph/ceph-client.admin.54239.log: -- replaced with /var/log/ceph/ceph-client.admin.46386.log.gz 2024-07-24T16:39:42.585 INFO:teuthology.orchestra.run.smithi159.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.54239.log.gz 2024-07-24T16:39:42.585 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47320.log 2024-07-24T16:39:42.585 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.44924.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44924.log.gz 2024-07-24T16:39:42.585 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.48743.log 2024-07-24T16:39:42.585 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50390.log 2024-07-24T16:39:42.585 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.2.48743.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47320.log.gz 2024-07-24T16:39:42.586 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.48743.log.gz 2024-07-24T16:39:42.586 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44584.log 2024-07-24T16:39:42.586 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47730.log 2024-07-24T16:39:42.586 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4%/var/log/ceph/ceph-client.admin.44584.log: -- replaced with /var/log/ceph/ceph-client.admin.50390.log.gz 2024-07-24T16:39:42.586 INFO:teuthology.orchestra.run.smithi159.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44584.log.gz 2024-07-24T16:39:42.586 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44838.log 2024-07-24T16:39:42.586 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47730.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47730.log.gz 2024-07-24T16:39:42.586 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49880.log 2024-07-24T16:39:42.587 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.44838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39018.log 2024-07-24T16:39:42.587 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49880.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44838.log.gz 2024-07-24T16:39:42.587 INFO:teuthology.orchestra.run.smithi159.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49880.log.gz 2024-07-24T16:39:42.587 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58205.log 2024-07-24T16:39:42.587 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.39018.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.39018.log.gz 2024-07-24T16:39:42.587 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60496.log 2024-07-24T16:39:42.587 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.58205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48297.log 2024-07-24T16:39:42.587 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.60496.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58205.log.gz 2024-07-24T16:39:42.588 INFO:teuthology.orchestra.run.smithi159.stderr: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46176.log 2024-07-24T16:39:42.588 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60496.log.gz 2024-07-24T16:39:42.588 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.0.48297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48297.log.gz 2024-07-24T16:39:42.588 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51247.log 2024-07-24T16:39:42.588 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48302.log 2024-07-24T16:39:42.588 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.51247.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46176.log.gz 2024-07-24T16:39:42.588 INFO:teuthology.orchestra.run.smithi159.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51247.log.gz 2024-07-24T16:39:42.588 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51289.log 2024-07-24T16:39:42.589 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.0.48302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51331.log 2024-07-24T16:39:42.589 INFO:teuthology.orchestra.run.smithi159.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.48302.log.gz 2024-07-24T16:39:42.589 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.51289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44362.log 2024-07-24T16:39:42.589 INFO:teuthology.orchestra.run.smithi159.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.51289.log.gz 2024-07-24T16:39:42.589 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.51331.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.51331.log.gz 2024-07-24T16:39:42.589 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50739.log 2024-07-24T16:39:42.589 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.44362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59544.log 2024-07-24T16:39:42.589 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.50739.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44362.log.gz 2024-07-24T16:39:42.590 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54340.log 2024-07-24T16:39:42.590 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50739.log.gz 2024-07-24T16:39:42.590 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.59544.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59544.log.gz 2024-07-24T16:39:42.590 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60246.log 2024-07-24T16:39:42.590 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.54340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47324.log 2024-07-24T16:39:42.590 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.60246.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54340.log.gz 2024-07-24T16:39:42.590 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60246.log.gz 2024-07-24T16:39:42.590 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47772.log 2024-07-24T16:39:42.591 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47324.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47324.log.gz 2024-07-24T16:39:42.591 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49628.log 2024-07-24T16:39:42.591 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47814.log 2024-07-24T16:39:42.591 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49628.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47772.log.gz 2024-07-24T16:39:42.591 INFO:teuthology.orchestra.run.smithi159.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49628.log.gz 2024-07-24T16:39:42.591 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46652.log 2024-07-24T16:39:42.591 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49964.log 2024-07-24T16:39:42.592 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46652.log: 87.1% 91.2% -- replaced with /var/log/ceph/ceph-client.admin.47814.log.gz 2024-07-24T16:39:42.592 INFO:teuthology.orchestra.run.smithi159.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46652.log.gz 2024-07-24T16:39:42.592 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38253.log 2024-07-24T16:39:42.592 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47322.log 2024-07-24T16:39:42.592 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.38253.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49964.log.gz 2024-07-24T16:39:42.592 INFO:teuthology.orchestra.run.smithi159.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.38253.log.gz 2024-07-24T16:39:42.592 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51121.log 2024-07-24T16:39:42.592 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.47322.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47322.log.gz 2024-07-24T16:39:42.592 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49128.log 2024-07-24T16:39:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.51121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46428.log 2024-07-24T16:39:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.49128.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.51121.log.gz 2024-07-24T16:39:42.593 INFO:teuthology.orchestra.run.smithi159.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49128.log.gz 2024-07-24T16:39:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60036.log 2024-07-24T16:39:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.46428.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46428.log.gz 2024-07-24T16:39:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50181.log 2024-07-24T16:39:42.593 INFO:teuthology.orchestra.run.smithi159.stderr:/var/log/ceph/ceph-client.admin.60036.log: /var/log/ceph/ceph-client.admin.50181.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60036.log.gz 2024-07-24T16:39:42.593 INFO:teuthology.orchestra.run.smithi159.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50181.log.gz 2024-07-24T16:39:42.750 INFO:teuthology.orchestra.run.smithi193.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-07-24T16:39:42.768 INFO:teuthology.orchestra.run.smithi193.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-07-24T16:39:42.900 INFO:teuthology.orchestra.run.smithi193.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-07-24T16:39:42.954 INFO:teuthology.orchestra.run.smithi159.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-07-24T16:39:43.202 INFO:teuthology.orchestra.run.smithi159.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-07-24T16:39:43.634 INFO:teuthology.orchestra.run.smithi159.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-07-24T16:39:43.655 INFO:teuthology.orchestra.run.smithi193.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-07-24T16:39:43.802 INFO:teuthology.orchestra.run.smithi193.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-07-24T16:39:43.921 INFO:teuthology.orchestra.run.smithi159.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-07-24T16:39:44.177 INFO:teuthology.orchestra.run.smithi159.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-07-24T16:39:44.400 INFO:teuthology.orchestra.run.smithi193.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-07-24T16:39:44.440 INFO:teuthology.orchestra.run.smithi193.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-07-24T16:39:44.443 INFO:teuthology.orchestra.run.smithi193.stderr: 2024-07-24T16:39:44.443 INFO:teuthology.orchestra.run.smithi193.stderr:real 0m2.046s 2024-07-24T16:39:44.443 INFO:teuthology.orchestra.run.smithi193.stderr:user 0m7.620s 2024-07-24T16:39:44.443 INFO:teuthology.orchestra.run.smithi193.stderr:sys 0m0.282s 2024-07-24T16:39:46.153 INFO:teuthology.orchestra.run.smithi159.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-07-24T16:39:46.155 INFO:teuthology.orchestra.run.smithi159.stderr: 2024-07-24T16:39:46.155 INFO:teuthology.orchestra.run.smithi159.stderr:real 0m3.781s 2024-07-24T16:39:46.155 INFO:teuthology.orchestra.run.smithi159.stderr:user 0m9.296s 2024-07-24T16:39:46.155 INFO:teuthology.orchestra.run.smithi159.stderr:sys 0m0.493s 2024-07-24T16:39:46.155 INFO:tasks.ceph:Archiving logs... 2024-07-24T16:39:46.156 DEBUG:teuthology.misc:Transferring archived files from smithi159:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816776/remote/smithi159/log 2024-07-24T16:39:46.156 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /var/log/ceph -- . 2024-07-24T16:39:47.683 DEBUG:teuthology.misc:Transferring archived files from smithi193:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816776/remote/smithi193/log 2024-07-24T16:39:47.684 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /var/log/ceph -- . 2024-07-24T16:39:48.730 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-07-24T16:39:48.739 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-07-24T16:39:48.739 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-07-24T16:39:48.742 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-07-24T16:39:48.822 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-07-24T16:39:48.830 INFO:teuthology.task.clock:Checking final clock skew... 2024-07-24T16:39:48.830 DEBUG:teuthology.orchestra.run.smithi159:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-24T16:39:48.833 DEBUG:teuthology.orchestra.run.smithi193:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-07-24T16:39:48.848 INFO:teuthology.orchestra.run.smithi159.stderr:bash: line 1: ntpq: command not found 2024-07-24T16:39:48.849 INFO:teuthology.orchestra.run.smithi193.stderr:bash: line 1: ntpq: command not found 2024-07-24T16:39:48.853 INFO:teuthology.orchestra.run.smithi159.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-24T16:39:48.853 INFO:teuthology.orchestra.run.smithi159.stdout:=============================================================================== 2024-07-24T16:39:48.853 INFO:teuthology.orchestra.run.smithi159.stdout:^* hv01.front.sepia.ceph.com 3 6 377 55 -332us[ -325us] +/- 49ms 2024-07-24T16:39:48.853 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -616us[ -616us] +/- 52ms 2024-07-24T16:39:48.853 INFO:teuthology.orchestra.run.smithi159.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +1138us[+1138us] +/- 63ms 2024-07-24T16:39:48.854 INFO:teuthology.orchestra.run.smithi159.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T16:39:48.855 INFO:teuthology.orchestra.run.smithi193.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-07-24T16:39:48.855 INFO:teuthology.orchestra.run.smithi193.stdout:=============================================================================== 2024-07-24T16:39:48.855 INFO:teuthology.orchestra.run.smithi193.stdout:^* hv01.front.sepia.ceph.com 3 6 377 54 -325us[ -327us] +/- 49ms 2024-07-24T16:39:48.856 INFO:teuthology.orchestra.run.smithi193.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 54 -582us[ -583us] +/- 52ms 2024-07-24T16:39:48.856 INFO:teuthology.orchestra.run.smithi193.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 +1156us[+1154us] +/- 63ms 2024-07-24T16:39:48.856 INFO:teuthology.orchestra.run.smithi193.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-07-24T16:39:48.856 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-07-24T16:39:48.865 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-07-24T16:39:48.865 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-07-24T16:39:48.874 DEBUG:teuthology.orchestra.run.smithi159:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-07-24T16:39:48.972 DEBUG:teuthology.orchestra.run.smithi193:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-07-24T16:39:49.043 DEBUG:teuthology.orchestra.run.smithi159:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-24T16:39:49.072 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T16:39:49.072 DEBUG:teuthology.orchestra.run.smithi193:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-07-24T16:39:49.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T16:39:49.103 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-07-24T16:39:49.112 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-07-24T16:39:49.156 INFO:teuthology.task.internal:Duration was 1359.176880 seconds 2024-07-24T16:39:49.157 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-07-24T16:39:49.166 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-07-24T16:39:49.166 DEBUG:teuthology.orchestra.run.smithi159:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-07-24T16:39:49.168 DEBUG:teuthology.orchestra.run.smithi193:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-07-24T16:39:49.206 INFO:teuthology.orchestra.run.smithi159.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-24T16:39:49.211 INFO:teuthology.orchestra.run.smithi193.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-07-24T16:39:49.543 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-07-24T16:39:49.543 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi159.front.sepia.ceph.com 2024-07-24T16:39:49.543 DEBUG:teuthology.orchestra.run.smithi159:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-07-24T16:39:49.604 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi193.front.sepia.ceph.com 2024-07-24T16:39:49.605 DEBUG:teuthology.orchestra.run.smithi193:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-07-24T16:39:49.631 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-07-24T16:39:49.631 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-07-24T16:39:49.647 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-07-24T16:39:49.699 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-07-24T16:39:49.700 DEBUG:teuthology.orchestra.run.smithi159:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-07-24T16:39:49.713 DEBUG:teuthology.orchestra.run.smithi193:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-07-24T16:39:49.848 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-07-24T16:39:49.857 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-07-24T16:39:49.858 DEBUG:teuthology.orchestra.run.smithi159:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-07-24T16:39:49.883 DEBUG:teuthology.orchestra.run.smithi193:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-07-24T16:39:49.907 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-07-24T16:39:49.917 DEBUG:teuthology.orchestra.run.smithi159:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-07-24T16:39:49.926 DEBUG:teuthology.orchestra.run.smithi193:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-07-24T16:39:49.946 INFO:teuthology.orchestra.run.smithi159.stdout:kernel.core_pattern = core 2024-07-24T16:39:49.971 INFO:teuthology.orchestra.run.smithi193.stdout:kernel.core_pattern = core 2024-07-24T16:39:49.984 DEBUG:teuthology.orchestra.run.smithi159:> test -e /home/ubuntu/cephtest/archive/coredump 2024-07-24T16:39:50.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T16:39:50.014 DEBUG:teuthology.orchestra.run.smithi193:> test -e /home/ubuntu/cephtest/archive/coredump 2024-07-24T16:39:50.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-07-24T16:39:50.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-07-24T16:39:50.049 INFO:teuthology.task.internal:Transferring archived files... 2024-07-24T16:39:50.050 DEBUG:teuthology.misc:Transferring archived files from smithi159:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816776/remote/smithi159 2024-07-24T16:39:50.050 DEBUG:teuthology.orchestra.run.smithi159:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-07-24T16:39:50.088 DEBUG:teuthology.misc:Transferring archived files from smithi193:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-07-24_14:14:53-fs-main-testing-default-smithi/7816776/remote/smithi193 2024-07-24T16:39:50.089 DEBUG:teuthology.orchestra.run.smithi193:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-07-24T16:39:50.120 INFO:teuthology.task.internal:Removing archive directory... 2024-07-24T16:39:50.121 DEBUG:teuthology.orchestra.run.smithi159:> rm -rf -- /home/ubuntu/cephtest/archive 2024-07-24T16:39:50.125 DEBUG:teuthology.orchestra.run.smithi193:> rm -rf -- /home/ubuntu/cephtest/archive 2024-07-24T16:39:50.171 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-07-24T16:39:50.182 INFO:teuthology.task.internal:Not uploading archives. 2024-07-24T16:39:50.182 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-07-24T16:39:50.192 INFO:teuthology.task.internal:Tidying up after the test... 2024-07-24T16:39:50.192 DEBUG:teuthology.orchestra.run.smithi159:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-07-24T16:39:50.194 DEBUG:teuthology.orchestra.run.smithi193:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-07-24T16:39:50.207 INFO:teuthology.orchestra.run.smithi159.stdout: 265307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 24 16:39 /home/ubuntu/cephtest 2024-07-24T16:39:50.226 INFO:teuthology.orchestra.run.smithi193.stdout: 265306 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 24 16:39 /home/ubuntu/cephtest 2024-07-24T16:39:50.227 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-07-24T16:39:50.237 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-07-24T16:39:50.258 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/snap-schedule} duration: 1359.1768803596497 failure_reason: 'Test failure: test_multi_snap_schedule (tasks.cephfs.test_snap_schedules.TestSnapSchedules)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=27afbc85fe54497999c51cae5f9efdfc status: fail success: false 2024-07-24T16:39:50.258 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-07-24T16:39:50.393 INFO:teuthology.run:FAIL